-- Logs begin at Wed 2022-07-27 15:49:15 UTC, end at Wed 2022-07-27 16:51:03 UTC. -- Jul 27 16:19:56.022722 dv-cinder-849690-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 16:19:56.030140 dv-cinder-849690-6-smb devstack@keystone.service[80194]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 16:19:56 2022] *** Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: nodename: dv-cinder-849690-6-smb Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: machine: x86_64 Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: clock source: unix Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: pcre jit disabled Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: detected number of CPU cores: 4 Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: current working directory: / Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: detected binary path: /usr/bin/uwsgi-core Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: your processes number limit is 47680 Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: your memory page size is 4096 bytes Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: detected max file descriptor number: 2048 Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: lock engine: pthread robust mutexes Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: thunder lock: enabled Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 16:19:56.034577 dv-cinder-849690-6-smb devstack@keystone.service[80194]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 16:19:56.073521 dv-cinder-849690-6-smb devstack@keystone.service[80194]: Python main interpreter initialized at 0x556b62a539c0 Jul 27 16:19:56.073521 dv-cinder-849690-6-smb devstack@keystone.service[80194]: python threads support enabled Jul 27 16:19:56.073521 dv-cinder-849690-6-smb devstack@keystone.service[80194]: your server socket listen backlog is limited to 100 connections Jul 27 16:19:56.073521 dv-cinder-849690-6-smb devstack@keystone.service[80194]: your mercy for graceful operations on workers is 90 seconds Jul 27 16:19:56.073883 dv-cinder-849690-6-smb devstack@keystone.service[80194]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 16:19:56.073964 dv-cinder-849690-6-smb devstack@keystone.service[80194]: *** Operational MODE: preforking *** Jul 27 16:19:56.074212 dv-cinder-849690-6-smb devstack@keystone.service[80194]: *** uWSGI is running in multiple interpreter mode *** Jul 27 16:19:56.074212 dv-cinder-849690-6-smb devstack@keystone.service[80194]: spawned uWSGI master process (pid: 80194) Jul 27 16:19:56.074418 dv-cinder-849690-6-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 27 16:19:56.075506 dv-cinder-849690-6-smb devstack@keystone.service[80194]: spawned uWSGI worker 1 (pid: 80205, cores: 1) Jul 27 16:19:56.075506 dv-cinder-849690-6-smb devstack@keystone.service[80194]: spawned uWSGI worker 2 (pid: 80206, cores: 1) Jul 27 16:19:56.075506 dv-cinder-849690-6-smb devstack@keystone.service[80194]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 16:20:01.547551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:20:01.547551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: from cryptography.utils import int_from_bytes Jul 27 16:20:01.548369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:20:01.548369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: from cryptography.utils import int_from_bytes Jul 27 16:20:01.548788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:20:01.548788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: from cryptography.utils import int_from_bytes Jul 27 16:20:01.548907 dv-cinder-849690-6-smb devstack@keystone.service[80206]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 16:20:01.548907 dv-cinder-849690-6-smb devstack@keystone.service[80206]: from cryptography.utils import int_from_bytes Jul 27 16:20:01.597544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 16:20:01.597718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 16:20:01.597805 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 16:20:01.597893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 16:20:01.597972 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] command line args: [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 16:20:01.598049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] command line args: [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 16:20:01.598176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 16:20:01.598255 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 16:20:01.598360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ================================================================================ {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 16:20:01.598446 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ================================================================================ {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 16:20:01.598619 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] admin_token = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.598703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] admin_token = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.599124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] config_dir = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.599207 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] config_dir = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.599322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.599446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.599528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] config_source = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.599618 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] config_source = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.599699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] debug = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.599772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] debug = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.599843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.600121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.600223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.600285 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.600427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.600512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.600638 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.600718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.600883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.600956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.601114 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.601186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.601291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_config_append = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.601369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_config_append = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.601467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.601533 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.601644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_dir = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.601717 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_dir = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.601822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_file = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.601898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_file = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.602143 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.602220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.602286 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.602354 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.602536 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.602656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.602781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.602886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.602948 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.603014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.603190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.603307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.603425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.603531 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.603696 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.603784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.603962 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.604099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.604198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.604267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.604421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.604510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.604655 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.604736 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.604902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.605005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.605143 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.605224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.605416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.605504 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.605916 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.605998 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.606119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] publish_errors = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.606198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] publish_errors = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.606336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.606437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.606564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.606648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.606710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.606773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.606961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.607060 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.607193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.607272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.607421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] standard_threads = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.607558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] standard_threads = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.607745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.607885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.608005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.608131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.608131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.608355 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.608482 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] use_journal = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.608599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] use_journal = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.608599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] use_json = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.608814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] use_json = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.608928 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] use_stderr = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.609042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] use_stderr = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.609167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] use_syslog = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.609283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] use_syslog = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.609446 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.609571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 16:20:01.609693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.609810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.609934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.610051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.610165 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.610286 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.610408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.610523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.610646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.610770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.610886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.610999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.611120 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.611235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.611358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.611473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.611588 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.611701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.611817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.611949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.612076 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.612193 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.612314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.612436 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.612436 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.612665 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.612790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.612907 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.613021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.613134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.613248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.613369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.613566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.613684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.613799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.613915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.614029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.614143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.614274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.614390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.614504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.614625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.614746 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.614868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.615002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.615119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.615233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.615351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.615473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.615589 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.615716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.615833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.615967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.616072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.616185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.616312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.616429 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.616543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.616678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.616799 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.616914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.617037 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.617154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.617267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.617380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.617494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.617608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.617730 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.617846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.617966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.618083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.618203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.618318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.618447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.618564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.618677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.618798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.618919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.619569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.619807 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.619997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.620115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.620241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.620359 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.620473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.620597 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.620714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.620827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.620827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.621048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.621169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.621294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.621416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.621531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.621645 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.621757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.621870 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.621992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.622108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.622221 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.622336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.622450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.622569 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.622696 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.622812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.622924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.623038 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.623158 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.623310 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.623441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.623542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.623640 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.623747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.623844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.623986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.624100 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.624210 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.624315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.624413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.624516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.624644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.624762 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.624887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.625010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.625125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.625251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.625376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.625500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.625624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.625753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.625870 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.625985 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.626100 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.626222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.626338 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.626463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.626580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.626703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.626820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.626934 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.627058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.627165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.627280 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.627394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.627508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.627631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.627757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.627922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.628041 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.628157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.628274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.628391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.628519 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.628637 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.628753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.628868 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.628984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.629099 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.629226 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.629344 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.629467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.629584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.629701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.629815 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.629939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.630057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.630172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.630287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.630401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.630526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.630652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.630771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.630887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.631002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.631118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.631233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.631426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.631552 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.631670 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.631777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.631893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.631997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.632115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.632225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.632336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.632437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.632543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.632649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.632756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.632857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.632964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.633070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.633170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.633268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.633373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.633471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.633578 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.633677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.633677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.633869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.633967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.634080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.634183 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.634287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.634392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.634496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.634595 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.634733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.635373 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.external = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.635482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.external = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.635580 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.635678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.635775 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.635972 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.636091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.636202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.636311 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.password = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.636412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.password = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.636511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] auth.token = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.636609 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] auth.token = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.636762 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.636885 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.636988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.637087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.637276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.637399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.637516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.637642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.637760 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.637877 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.638043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.638163 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.638315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.638442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.638591 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.638709 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.638824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.638941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.639059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.639205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.639324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.639442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.639558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.639674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.639790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.639934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.640056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.640174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.640299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.640424 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.640543 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.640669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.640788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.640906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.641030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.641158 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.641278 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.641404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.641542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.641660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.641776 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.641892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.642008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.642133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.642252 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.642369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.642485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.642601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.642717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.642846 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.642964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.643087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.643205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.643323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.643438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.643563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.643681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.643798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.643929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.644046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.644167 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.644297 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.644417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.644535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.644651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.644767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.644892 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.645011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.645128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.645253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.645371 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.645488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.645681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.645802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.645919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.646036 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.646152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.646268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.646394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.646514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.646631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.646631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.646850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.646966 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.647091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.647091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.647311 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.647427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.647544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.647544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.647777 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.647925 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.648044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.648161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.648278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.648407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.648601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.648731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.648850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.648967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.649084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.649201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.649327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.649446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.649564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.649564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.650189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.650189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.650469 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.650582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.650804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.650919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.651020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.651118 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.651226 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.651327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.651427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.651525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.651623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.651722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.651834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.651962 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.652073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.652175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.652274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.652374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.652482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.652605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.652730 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.652849 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.652967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.653084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.653210 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.653328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.653445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.653560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.653677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.653794 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.653919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.654038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.654159 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.654276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.654393 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.654509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.654635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.654753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.654871 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.655033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.655156 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.655272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.655398 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.656076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.656199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.656317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.656434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.656565 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.656686 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.656803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.656921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.657038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.657156 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.657288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.657408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.657525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.657641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.657758 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.657874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.658003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.658121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.658239 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.658364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.658481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.658608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.658726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.658843 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.658967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.659086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.659205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.659331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.659455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.659573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.659690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.659806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.659980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.660113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.660233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.660350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.660467 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.660584 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.660701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.660827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.660946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.661063 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.661181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.661297 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.661414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.661539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.661658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.661775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.661891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.662008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.662126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.662252 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.662252 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.662473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.662473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.662693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.662810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.662938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.663057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.663174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.663291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.663408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.663525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.663655 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.663775 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.663905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.664025 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.664145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.664263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.664392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.664512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.664629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.664746 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.664863 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.664981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.665107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.665226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.665344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.665460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.665577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.665693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.665819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.665973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.666102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.666220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.666339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.666456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.666582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.666701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.666818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.666935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.667051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.667167 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.667292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.667413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.667530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.667646 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.667763 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.667941 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.668075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.668195 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.668311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.668429 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.668547 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.668663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.668790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.668909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.669025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.669142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.669258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.669375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.669568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.669689 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.669806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.669923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] role.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.669923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] role.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.670238 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.670369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.670490 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] role.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.670608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.670725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] role.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.670841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.670959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.671085 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.671204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.671320 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.671437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.671554 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.671681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.671800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.671933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.672051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.672168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.672284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.672414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.672534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.672652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.672769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.672886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.673003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.673129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.673248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.673365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.673482 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.673599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.673599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.673830 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.673949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.674070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.674070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.674289 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.674405 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.674531 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.674649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.674767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.674884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.675001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.675116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.675243 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.675361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.675477 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.675593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.675709 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.675826 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.676005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.676125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.676241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.676358 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.676474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.676590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.676716 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.676835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.676951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.677067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.677183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.677308 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.677426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.677542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.677658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.677774 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.677892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.678252 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.678372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.678489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.678604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.678721 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.678838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.678964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.679083 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.679199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.679316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.679432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.679548 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.679673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.679792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.679923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.680042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.680159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.680274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.680403 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.680522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.680639 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.680756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.680872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.680989 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.681115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.681233 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.681349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.681466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.682243 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.682372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.682502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.682621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.682722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.682839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.682956 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.683072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.683199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.683319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.683435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.connection = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.683562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.683689 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.683809 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.683983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.684107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.connection = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.684244 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.684376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.684495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.684613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.684730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.684847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.684964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.685090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.685211 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.685328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.685445 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.685562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.685679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.685806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.685926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.686043 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.686166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.686286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.686404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.686530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.686649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.686767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.686884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.687001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.687118 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.687244 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.687364 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.687481 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.687588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.687687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.687804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.687804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 16:20:01.688056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.688056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.688056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 16:20:01.688056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 16:20:01.713449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.713676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.713901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.714245 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.714482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.714710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.722116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.723008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.752324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.752555 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.753148 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.753386 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.804897 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.805024 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.855613 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.855845 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.856260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.856501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.920612 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.920839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.920927 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.921062 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.921149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.921284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.921367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.921501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.921585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.921714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.921800 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.921974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.944945 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.945202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.945420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.945516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.945659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.945745 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.945871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.945964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.946084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.946168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.946296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.946378 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.946508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.946721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.957273 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.957675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.969964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.970201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.970331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.970415 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.970491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.970637 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.970762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.970852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.970930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.971037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.971121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.971251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.971334 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.971462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80206) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 16:20:01.989072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:01.989179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:01.989283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 16:20:01.989367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 16:20:01.989621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:01.989705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:01.989824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 16:20:01.989907 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 16:20:01.990092 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:01.990183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:01.990350 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:01.990433 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:01.990615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:01.990697 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:01.990870 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:01.990960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.000717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.000918 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.001005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.001197 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.001280 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.001468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.001553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.001747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.008365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.008716 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.013569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.013846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.014053 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.014138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.014335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.014435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.014620 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.014703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.014900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.014982 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.015164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.015249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.015425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.015508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.015686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.015766 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.015977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.016063 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.016242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.016324 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.016515 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.016779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.039579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.040331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.041229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.041511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.042031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.042311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.046188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.046466 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.046747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.046922 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.047204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.047487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.053334 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.053615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.054110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.054394 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.058061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.058295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.058588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.058881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.059156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.059238 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.059435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.059519 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.059711 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.059793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.060010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.060094 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.060286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.060586 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.060866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.061135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.076450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.076725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.077521 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.077800 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.080649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.081718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.083744 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.084070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.084905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.085201 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.089173 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.090136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.092381 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.093333 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.095512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.095809 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.096116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.096410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.096491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.096693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.096778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.096982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.097064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.097339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.097617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.097912 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.113175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.113452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.113718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.113981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.114106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.114385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.114649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.114910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.120888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.121927 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.122412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.122688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.123481 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.123755 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.125514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.125793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.126091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.126380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.126600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.126685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.126883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.127179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.127469 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.127750 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.138655 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.138935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.139215 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.139491 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.139765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.139897 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.140056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.140181 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.140328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.140461 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.140742 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.141024 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.141297 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.141569 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.156576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.157809 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.159500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.160796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.162451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.163740 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.164891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.166238 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.166587 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.166871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.167148 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.167854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.168163 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.168447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.173604 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.174892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.175198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.176535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.178116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.178404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.178684 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.178966 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.179447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.179738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.180052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.180343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.186993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.187281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.187570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.188458 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.188747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.189039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.194402 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.194678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.194955 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.195240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.195510 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.195788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.195892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80206) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 16:20:02.196098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.196195 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.196374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.196457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.196677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.196758 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.196954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.197037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.197744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.197971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.198128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.198272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.198360 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.198438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.198633 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.198726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.198913 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.199203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.199469 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.199745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.200032 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80206) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 16:20:02.232749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556b62a539c0 pid: 80205 (default app) Jul 27 16:20:02.234033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556b62a539c0 pid: 80206 (default app) Jul 27 16:20:02.236013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123ea61-a0d8-4eeb-97ba-b6ea9cf03a6c None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:02.236302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123ea61-a0d8-4eeb-97ba-b6ea9cf03a6c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:02.236577 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123ea61-a0d8-4eeb-97ba-b6ea9cf03a6c None None] PATH_INFO: `/v3` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:02.240863 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Wed Jul 27 16:20:02 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:09.848229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffa4ae-b551-4ee8-9368-c65e7620270c None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:09.848791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffa4ae-b551-4ee8-9368-c65e7620270c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:09.848791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffa4ae-b551-4ee8-9368-c65e7620270c None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:09.853799 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:20:09.859245 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7c97d-4269-4aad-80ac-cf9a921dea65 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:09.859684 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7c97d-4269-4aad-80ac-cf9a921dea65 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:09.859805 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7c97d-4269-4aad-80ac-cf9a921dea65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:09.929965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: INFO dbcounter [None req-58b7c97d-4269-4aad-80ac-cf9a921dea65 None None] Registered counter for database keystone Jul 27 16:20:09.951736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG oslo_db.sqlalchemy.engines [None req-58b7c97d-4269-4aad-80ac-cf9a921dea65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:20:09.957940 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writer thread running {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:20:10.134560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG passlib.handlers.bcrypt [None req-58b7c97d-4269-4aad-80ac-cf9a921dea65 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80205) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 16:20:10.134974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG passlib.handlers.bcrypt [None req-58b7c97d-4269-4aad-80ac-cf9a921dea65 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80205) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 16:20:10.189463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-58b7c97d-4269-4aad-80ac-cf9a921dea65 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:10.191017 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-58b7c97d-4269-4aad-80ac-cf9a921dea65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:10.317484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 27 16:20:10.437724 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffa4ae-b551-4ee8-9368-c65e7620270c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:10.506874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: INFO dbcounter [None req-82ffa4ae-b551-4ee8-9368-c65e7620270c None None] Registered counter for database keystone Jul 27 16:20:10.525772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG oslo_db.sqlalchemy.engines [None req-82ffa4ae-b551-4ee8-9368-c65e7620270c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 16:20:10.532481 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writer thread running {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 16:20:10.651466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffa4ae-b551-4ee8-9368-c65e7620270c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:10.656622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf406bd-b7b0-4d8a-962d-70315aae7cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:10.657278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf406bd-b7b0-4d8a-962d-70315aae7cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:10.657568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf406bd-b7b0-4d8a-962d-70315aae7cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:10.657850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf406bd-b7b0-4d8a-962d-70315aae7cb0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:10.666102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf406bd-b7b0-4d8a-962d-70315aae7cb0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:10.717869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: WARNING keystone.common.rbac_enforcer.enforcer [None req-abf406bd-b7b0-4d8a-962d-70315aae7cb0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 16:20:10.718221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf406bd-b7b0-4d8a-962d-70315aae7cb0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:10.728271 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1324 bytes} [Wed Jul 27 16:20:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 16:20:10.734749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7c97d-4269-4aad-80ac-cf9a921dea65 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:10.749107 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7c97d-4269-4aad-80ac-cf9a921dea65 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:10.753531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e53fc-79e6-4056-aa2e-98b30df3c280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:10.754633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e53fc-79e6-4056-aa2e-98b30df3c280 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:10.754944 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e53fc-79e6-4056-aa2e-98b30df3c280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:10.755284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e53fc-79e6-4056-aa2e-98b30df3c280 admin admin] PATH_INFO: `/v3/projects/8fe6d635a22f4f83acd22dcb2e804bfc` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:10.756805 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e53fc-79e6-4056-aa2e-98b30df3c280 admin admin] RBAC: Authorizing `identity:get_project(project_id=8fe6d635a22f4f83acd22dcb2e804bfc)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:10.807366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: WARNING keystone.common.rbac_enforcer.enforcer [None req-321e53fc-79e6-4056-aa2e-98b30df3c280 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 16:20:10.807651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e53fc-79e6-4056-aa2e-98b30df3c280 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:10.812617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 3/5] 10.222.0.67 () {56 vars in 1207 bytes} [Wed Jul 27 16:20:10 2022] GET /identity/v3/projects/8fe6d635a22f4f83acd22dcb2e804bfc => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:12.815698 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628f1f-85ab-4229-ac78-d42a8638c502 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:12.816339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628f1f-85ab-4229-ac78-d42a8638c502 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:12.816688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628f1f-85ab-4229-ac78-d42a8638c502 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:12.825906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 3/6] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:12 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:12.831437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38ec56-8f23-4981-bc2a-75e0f86c30b6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:12.831882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38ec56-8f23-4981-bc2a-75e0f86c30b6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:12.832031 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38ec56-8f23-4981-bc2a-75e0f86c30b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:12.852495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7d38ec56-8f23-4981-bc2a-75e0f86c30b6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:12.853987 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7d38ec56-8f23-4981-bc2a-75e0f86c30b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:12.862482 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 16:20:12.883766 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628f1f-85ab-4229-ac78-d42a8638c502 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:12.895948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628f1f-85ab-4229-ac78-d42a8638c502 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:12.900223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099709c9-d4a2-4e81-8ce3-be9b54266f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:12.900840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099709c9-d4a2-4e81-8ce3-be9b54266f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:12.901128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099709c9-d4a2-4e81-8ce3-be9b54266f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:12.901407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099709c9-d4a2-4e81-8ce3-be9b54266f79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:12.909900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099709c9-d4a2-4e81-8ce3-be9b54266f79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:12.911645 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099709c9-d4a2-4e81-8ce3-be9b54266f79 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:12.921050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1324 bytes} [Wed Jul 27 16:20:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 16:20:12.926528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38ec56-8f23-4981-bc2a-75e0f86c30b6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:12.936188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38ec56-8f23-4981-bc2a-75e0f86c30b6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:12.940610 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f9f8b-722f-4724-9278-e674bd2316f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:12.941246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f9f8b-722f-4724-9278-e674bd2316f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:12.941531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f9f8b-722f-4724-9278-e674bd2316f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:12.941811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f9f8b-722f-4724-9278-e674bd2316f4 admin admin] PATH_INFO: `/v3/users/fa3cd04e53bd44eeabd80a82ed088455` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:12.943184 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f9f8b-722f-4724-9278-e674bd2316f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=fa3cd04e53bd44eeabd80a82ed088455)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:12.945029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f9f8b-722f-4724-9278-e674bd2316f4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:12.946562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 5/9] 10.222.0.67 () {56 vars in 1198 bytes} [Wed Jul 27 16:20:12 2022] GET /identity/v3/users/fa3cd04e53bd44eeabd80a82ed088455 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:14.991211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39220757-2c7d-43af-9d59-0c84cdb8a9bd None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:14.991739 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39220757-2c7d-43af-9d59-0c84cdb8a9bd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:14.991832 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39220757-2c7d-43af-9d59-0c84cdb8a9bd None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:14.993146 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:20:14.998308 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dca66-43dd-480b-9602-fc621da869cf None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:14.998735 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dca66-43dd-480b-9602-fc621da869cf None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:14.998879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dca66-43dd-480b-9602-fc621da869cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:15.018439 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-169dca66-43dd-480b-9602-fc621da869cf None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:15.019647 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-169dca66-43dd-480b-9602-fc621da869cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:15.053352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b21ab7-b1fd-4ca9-9fb3-90a36fc0bd61 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:15.053757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b21ab7-b1fd-4ca9-9fb3-90a36fc0bd61 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:15.053947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b21ab7-b1fd-4ca9-9fb3-90a36fc0bd61 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:15.055294 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 6/11] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:20:15.061517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dff2b-1529-46a1-8fb2-ede16a8ac56c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:15.061811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dff2b-1529-46a1-8fb2-ede16a8ac56c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:15.062093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dff2b-1529-46a1-8fb2-ede16a8ac56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:15.101401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 6/12] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:15.104368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG passlib.handlers.bcrypt [None req-505dff2b-1529-46a1-8fb2-ede16a8ac56c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80206) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 16:20:15.104793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG passlib.handlers.bcrypt [None req-505dff2b-1529-46a1-8fb2-ede16a8ac56c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80206) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 16:20:15.124228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dca66-43dd-480b-9602-fc621da869cf None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:15.147709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:15.150836 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-505dff2b-1529-46a1-8fb2-ede16a8ac56c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:15.152761 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-505dff2b-1529-46a1-8fb2-ede16a8ac56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:15.227676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dca66-43dd-480b-9602-fc621da869cf None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:15.252846 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:15.261240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e7c64-9e7a-4a2f-b9b5-83897c9b6b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:15.262617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e7c64-9e7a-4a2f-b9b5-83897c9b6b3e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:15.262900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e7c64-9e7a-4a2f-b9b5-83897c9b6b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:15.263179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e7c64-9e7a-4a2f-b9b5-83897c9b6b3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:15.274486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e7c64-9e7a-4a2f-b9b5-83897c9b6b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:15.274689 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dff2b-1529-46a1-8fb2-ede16a8ac56c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-443e7c64-9e7a-4a2f-b9b5-83897c9b6b3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:15.283598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:15.284575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:15.285560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:15.285560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:15.285560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:15.285560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:15.285560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:15.285560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:15.285560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:15.285560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:15.285560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:15.285560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:15.285560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:15.285560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:15.285560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 7/14] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:20:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:20:15.290488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e7c64-9e7a-4a2f-b9b5-83897c9b6b3e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:15.375126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:15.378276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dff2b-1529-46a1-8fb2-ede16a8ac56c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:15.380575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:15.394507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e7c64-9e7a-4a2f-b9b5-83897c9b6b3e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:15.417267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecbb9d-db59-4e49-97e6-96cf2daa0d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:15.418665 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecbb9d-db59-4e49-97e6-96cf2daa0d0f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:15.418946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecbb9d-db59-4e49-97e6-96cf2daa0d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:15.419220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecbb9d-db59-4e49-97e6-96cf2daa0d0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:15.429780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432821b-60a6-4679-b04b-4b3f6b467581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:15.430474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432821b-60a6-4679-b04b-4b3f6b467581 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:15.430876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432821b-60a6-4679-b04b-4b3f6b467581 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:15.431274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432821b-60a6-4679-b04b-4b3f6b467581 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:15.432363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432821b-60a6-4679-b04b-4b3f6b467581 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:15.432776 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432821b-60a6-4679-b04b-4b3f6b467581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:15.435434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432821b-60a6-4679-b04b-4b3f6b467581 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:15.455799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 8/15] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:15.457050 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432821b-60a6-4679-b04b-4b3f6b467581 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:15.493632 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecbb9d-db59-4e49-97e6-96cf2daa0d0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:15.495146 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecbb9d-db59-4e49-97e6-96cf2daa0d0f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:15.563831 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432821b-60a6-4679-b04b-4b3f6b467581 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:15.595321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 8/16] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 16:20:15.601390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecbb9d-db59-4e49-97e6-96cf2daa0d0f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:15.604593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:15.708146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c9710-b37c-454c-9846-49e9e660acaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:15.708786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c9710-b37c-454c-9846-49e9e660acaa None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:15.709067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c9710-b37c-454c-9846-49e9e660acaa None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:15.709339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c9710-b37c-454c-9846-49e9e660acaa None admin] PATH_INFO: `/v3/users/fa3cd04e53bd44eeabd80a82ed088455` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:15.710502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c9710-b37c-454c-9846-49e9e660acaa None admin] RBAC: Authorizing `identity:get_user(user_id=fa3cd04e53bd44eeabd80a82ed088455)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:15.711970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c9710-b37c-454c-9846-49e9e660acaa None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:15.713559 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 9/17] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:15 2022] GET /identity/v3/users/fa3cd04e53bd44eeabd80a82ed088455 => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:15.714958 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecbb9d-db59-4e49-97e6-96cf2daa0d0f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:15.718992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c9710-b37c-454c-9846-49e9e660acaa None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:15.734210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:15.750001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f49df6-27e9-4e37-9c2b-4ce159f41087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:15.750854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f49df6-27e9-4e37-9c2b-4ce159f41087 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:15.751136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f49df6-27e9-4e37-9c2b-4ce159f41087 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:15.751413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f49df6-27e9-4e37-9c2b-4ce159f41087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:15.769587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f49df6-27e9-4e37-9c2b-4ce159f41087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:15.771026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f49df6-27e9-4e37-9c2b-4ce159f41087 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-76f49df6-27e9-4e37-9c2b-4ce159f41087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:20:15.789470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:15.790389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:15.791239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:20:15.791239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:20:15.791239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:20:15.791239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:15.791239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 9/18] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:20:15.797710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f49df6-27e9-4e37-9c2b-4ce159f41087 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:15.823086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c9710-b37c-454c-9846-49e9e660acaa None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:15.857002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:15.857890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604e268-d1d3-41fb-a75d-30fca58ffc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:15.858576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604e268-d1d3-41fb-a75d-30fca58ffc5b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:15.858818 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604e268-d1d3-41fb-a75d-30fca58ffc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:15.859094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604e268-d1d3-41fb-a75d-30fca58ffc5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:15.860285 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604e268-d1d3-41fb-a75d-30fca58ffc5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:15.861723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604e268-d1d3-41fb-a75d-30fca58ffc5b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:15.863291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 10/19] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:15.868876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604e268-d1d3-41fb-a75d-30fca58ffc5b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:15.903234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f49df6-27e9-4e37-9c2b-4ce159f41087 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:15.937227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb875115-d1f0-40a1-9512-2e9ba8248465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:15.937841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb875115-d1f0-40a1-9512-2e9ba8248465 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:15.938128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb875115-d1f0-40a1-9512-2e9ba8248465 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:15.938407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb875115-d1f0-40a1-9512-2e9ba8248465 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:15.939099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb875115-d1f0-40a1-9512-2e9ba8248465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:15.939404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb875115-d1f0-40a1-9512-2e9ba8248465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:15.940802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb875115-d1f0-40a1-9512-2e9ba8248465 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:15.950254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:15.958064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 10/20] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:15.970868 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604e268-d1d3-41fb-a75d-30fca58ffc5b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:16.008619 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f56b4-6edd-4c47-ae67-ea48a66f9540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:16.009309 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f56b4-6edd-4c47-ae67-ea48a66f9540 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:16.009546 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f56b4-6edd-4c47-ae67-ea48a66f9540 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:16.009830 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f56b4-6edd-4c47-ae67-ea48a66f9540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:16.010649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f56b4-6edd-4c47-ae67-ea48a66f9540 None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.domain.id=default, user.id=fa3cd04e53bd44eeabd80a82ed088455) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:16.010968 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f56b4-6edd-4c47-ae67-ea48a66f9540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:16.013202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f56b4-6edd-4c47-ae67-ea48a66f9540 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:16.020842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 11/21] 10.222.0.67 () {56 vars in 1322 bytes} [Wed Jul 27 16:20:15 2022] GET /identity/v3/role_assignments?user.id=fa3cd04e53bd44eeabd80a82ed088455&scope.domain.id=default&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:18.374160 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507b624-43f0-4ddf-b65c-40edce5bb5ae None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:18.374678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507b624-43f0-4ddf-b65c-40edce5bb5ae None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:18.374770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507b624-43f0-4ddf-b65c-40edce5bb5ae None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:18.376438 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 11/22] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:18.389025 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8381c12-1ebd-4410-ae8f-ea89c50a9241 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:18.389542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8381c12-1ebd-4410-ae8f-ea89c50a9241 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:18.389616 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8381c12-1ebd-4410-ae8f-ea89c50a9241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:18.416860 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b8381c12-1ebd-4410-ae8f-ea89c50a9241 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:18.418134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b8381c12-1ebd-4410-ae8f-ea89c50a9241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:18.509984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 12/23] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:18.564276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507b624-43f0-4ddf-b65c-40edce5bb5ae None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:18.574075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8f468-14f0-43c8-bb1f-7a55e5eb256b None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:18.574919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8f468-14f0-43c8-bb1f-7a55e5eb256b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:18.575243 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8f468-14f0-43c8-bb1f-7a55e5eb256b None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:18.576755 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:18.582877 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a6fa7-6e58-42f9-a3a4-98168b2bdd7a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:18.583171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a6fa7-6e58-42f9-a3a4-98168b2bdd7a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:18.583458 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a6fa7-6e58-42f9-a3a4-98168b2bdd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:18.612871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f39a6fa7-6e58-42f9-a3a4-98168b2bdd7a None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:18.614377 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f39a6fa7-6e58-42f9-a3a4-98168b2bdd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:18.720488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507b624-43f0-4ddf-b65c-40edce5bb5ae None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:18.745546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:18.750352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 14/25] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:18.751803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bdd78-b696-466e-a8a5-148269a93b96 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:18.752568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bdd78-b696-466e-a8a5-148269a93b96 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:18.752965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bdd78-b696-466e-a8a5-148269a93b96 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:18.754495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 15/26] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:18.761249 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae918-c0ba-4c3b-8c63-da5b224972a9 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:18.761541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae918-c0ba-4c3b-8c63-da5b224972a9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:18.762363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae918-c0ba-4c3b-8c63-da5b224972a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:18.774780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:18.790440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33014ec4-8ed3-4793-bd50-cb85b0329534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:18.791112 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33014ec4-8ed3-4793-bd50-cb85b0329534 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:18.791399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33014ec4-8ed3-4793-bd50-cb85b0329534 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:18.791680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33014ec4-8ed3-4793-bd50-cb85b0329534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:18.798325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a27ae918-c0ba-4c3b-8c63-da5b224972a9 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:18.799534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a27ae918-c0ba-4c3b-8c63-da5b224972a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:18.818223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33014ec4-8ed3-4793-bd50-cb85b0329534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:18.819704 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33014ec4-8ed3-4793-bd50-cb85b0329534 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-33014ec4-8ed3-4793-bd50-cb85b0329534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:20:18.847008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:18.848098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:18.849323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:20:18.849323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:20:18.849323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:20:18.849323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:18.849323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 12/27] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:18.849578 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33014ec4-8ed3-4793-bd50-cb85b0329534 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:18.938577 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 16/28] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:18.939382 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ae918-c0ba-4c3b-8c63-da5b224972a9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:19.061587 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ae918-c0ba-4c3b-8c63-da5b224972a9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:19.099902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d92a0d-8a5f-44d4-9b7d-002cc20b61a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:19.100546 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d92a0d-8a5f-44d4-9b7d-002cc20b61a6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:19.101094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d92a0d-8a5f-44d4-9b7d-002cc20b61a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:19.101371 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d92a0d-8a5f-44d4-9b7d-002cc20b61a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:19.102181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d92a0d-8a5f-44d4-9b7d-002cc20b61a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:19.102516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d92a0d-8a5f-44d4-9b7d-002cc20b61a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:19.104022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d92a0d-8a5f-44d4-9b7d-002cc20b61a6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:19.106005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:19.124282 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 17/29] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:19.125119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d92a0d-8a5f-44d4-9b7d-002cc20b61a6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:19.149095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33014ec4-8ed3-4793-bd50-cb85b0329534 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:19.186702 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6dc38-e175-45eb-a68a-81270e724109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:19.187355 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6dc38-e175-45eb-a68a-81270e724109 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:19.187638 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6dc38-e175-45eb-a68a-81270e724109 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:19.188027 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6dc38-e175-45eb-a68a-81270e724109 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:19.201042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6dc38-e175-45eb-a68a-81270e724109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-77c6dc38-e175-45eb-a68a-81270e724109 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:19.207573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:19.209659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 13/30] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:20:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:19.211599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6dc38-e175-45eb-a68a-81270e724109 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:19.241651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d92a0d-8a5f-44d4-9b7d-002cc20b61a6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:19.251147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:19.280181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec66ea-9f5e-4681-96ab-47bbd0a35770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:19.280818 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec66ea-9f5e-4681-96ab-47bbd0a35770 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:19.281100 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec66ea-9f5e-4681-96ab-47bbd0a35770 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:19.281377 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec66ea-9f5e-4681-96ab-47bbd0a35770 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:19.282105 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec66ea-9f5e-4681-96ab-47bbd0a35770 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:19.283683 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec66ea-9f5e-4681-96ab-47bbd0a35770 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:19.336302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6dc38-e175-45eb-a68a-81270e724109 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:19.375707 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b682f-6ce6-4e60-be7e-dfe9ffd67ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:19.376374 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b682f-6ce6-4e60-be7e-dfe9ffd67ba1 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:19.376648 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b682f-6ce6-4e60-be7e-dfe9ffd67ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:19.376930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b682f-6ce6-4e60-be7e-dfe9ffd67ba1 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:19.377879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b682f-6ce6-4e60-be7e-dfe9ffd67ba1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:19.379330 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b682f-6ce6-4e60-be7e-dfe9ffd67ba1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:19.428910 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 18/31] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 27 16:20:19 2022] POST /identity/v3/roles => generated 219 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:20:19.430397 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83931ee-0641-4614-a84e-e56acb3e9fcb None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:19.430698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83931ee-0641-4614-a84e-e56acb3e9fcb None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:19.430988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83931ee-0641-4614-a84e-e56acb3e9fcb None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:19.432284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 19/32] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:19.433030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83931ee-0641-4614-a84e-e56acb3e9fcb None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:19.504932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:19.521429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 14/33] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:20:19 2022] POST /identity/v3/projects => generated 301 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:20:19.523096 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4e6f6-c99a-4bcb-a1e5-cb927eedb8ba None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:19.523468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4e6f6-c99a-4bcb-a1e5-cb927eedb8ba None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:19.523829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4e6f6-c99a-4bcb-a1e5-cb927eedb8ba None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:19.525452 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 15/34] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:19.531699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019306f2-cf37-4934-9a1f-b8af9c425666 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:19.532144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019306f2-cf37-4934-9a1f-b8af9c425666 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:19.532507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019306f2-cf37-4934-9a1f-b8af9c425666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:19.558336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-019306f2-cf37-4934-9a1f-b8af9c425666 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:19.560957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-019306f2-cf37-4934-9a1f-b8af9c425666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:19.582901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83931ee-0641-4614-a84e-e56acb3e9fcb None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:19.634015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2588b-8172-4401-8ab0-6f2aa0afc610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:19.634669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2588b-8172-4401-8ab0-6f2aa0afc610 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:19.634959 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2588b-8172-4401-8ab0-6f2aa0afc610 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:19.635570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2588b-8172-4401-8ab0-6f2aa0afc610 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:19.636385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2588b-8172-4401-8ab0-6f2aa0afc610 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:19.636701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2588b-8172-4401-8ab0-6f2aa0afc610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:19.643986 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2588b-8172-4401-8ab0-6f2aa0afc610 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:19.648087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 16/35] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:19.649454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece04af8-1631-4cfb-851e-698e8894db84 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:19.649825 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece04af8-1631-4cfb-851e-698e8894db84 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:19.650185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece04af8-1631-4cfb-851e-698e8894db84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:19.651145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 20/36] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:19.657465 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2588b-8172-4401-8ab0-6f2aa0afc610 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:19.688502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ece04af8-1631-4cfb-851e-698e8894db84 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:19.689999 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ece04af8-1631-4cfb-851e-698e8894db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:19.694118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:19.786493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 17/37] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:19.792556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece04af8-1631-4cfb-851e-698e8894db84 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:19.806026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2588b-8172-4401-8ab0-6f2aa0afc610 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:19.826253 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:19.847366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1706e2-3317-4ec7-a936-f8107a19c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:19.848057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1706e2-3317-4ec7-a936-f8107a19c82a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:19.848562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1706e2-3317-4ec7-a936-f8107a19c82a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:19.849084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1706e2-3317-4ec7-a936-f8107a19c82a None admin] PATH_INFO: `/v3/users/fa3cd04e53bd44eeabd80a82ed088455` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:19.850728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1706e2-3317-4ec7-a936-f8107a19c82a None admin] RBAC: Authorizing `identity:get_user(user_id=fa3cd04e53bd44eeabd80a82ed088455)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:19.852598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1706e2-3317-4ec7-a936-f8107a19c82a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:19.854381 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 21/38] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:19 2022] GET /identity/v3/users/fa3cd04e53bd44eeabd80a82ed088455 => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:19.855142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1706e2-3317-4ec7-a936-f8107a19c82a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:19.910617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece04af8-1631-4cfb-851e-698e8894db84 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:19.946478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778da68-c32e-4d44-9edc-b29618a443e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:19.947115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778da68-c32e-4d44-9edc-b29618a443e5 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:19.947399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778da68-c32e-4d44-9edc-b29618a443e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:19.947679 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778da68-c32e-4d44-9edc-b29618a443e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:19.948430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778da68-c32e-4d44-9edc-b29618a443e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:19.950502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778da68-c32e-4d44-9edc-b29618a443e5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:19.962404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:19.967888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1706e2-3317-4ec7-a936-f8107a19c82a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:19.976795 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 18/39] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 27 16:20:19 2022] POST /identity/v3/roles => generated 225 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:20:19.979335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778da68-c32e-4d44-9edc-b29618a443e5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:20.022653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35319e73-1a7b-4cf6-95e8-ec2108f6686e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:20.023346 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35319e73-1a7b-4cf6-95e8-ec2108f6686e None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:20.023640 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35319e73-1a7b-4cf6-95e8-ec2108f6686e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:20.023950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35319e73-1a7b-4cf6-95e8-ec2108f6686e None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:20.024693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35319e73-1a7b-4cf6-95e8-ec2108f6686e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:20.026910 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35319e73-1a7b-4cf6-95e8-ec2108f6686e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:20.050815 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 22/40] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 27 16:20:19 2022] POST /identity/v3/roles => generated 223 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:20:20.094725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480f764-0321-40c8-8b33-119bed7fa4e7 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:20.095026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480f764-0321-40c8-8b33-119bed7fa4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:20.095317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480f764-0321-40c8-8b33-119bed7fa4e7 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:20.096782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 23/41] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:20:20.102843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4d94d-c0b3-4dd1-be5d-714707f8d94e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:20.103132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4d94d-c0b3-4dd1-be5d-714707f8d94e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:20.103418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4d94d-c0b3-4dd1-be5d-714707f8d94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:20.120311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778da68-c32e-4d44-9edc-b29618a443e5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:20.123989 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-9dc4d94d-c0b3-4dd1-be5d-714707f8d94e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:20.125780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9dc4d94d-c0b3-4dd1-be5d-714707f8d94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:20.172717 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ba7a8-c1d5-4df9-809d-0a525c8266a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:20.173708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ba7a8-c1d5-4df9-809d-0a525c8266a9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:20.173996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ba7a8-c1d5-4df9-809d-0a525c8266a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:20.174354 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ba7a8-c1d5-4df9-809d-0a525c8266a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:20.177137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ba7a8-c1d5-4df9-809d-0a525c8266a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:20.177902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ba7a8-c1d5-4df9-809d-0a525c8266a9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:20.178949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:20.179909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 19/42] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:20.187726 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ba7a8-c1d5-4df9-809d-0a525c8266a9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:20.226925 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 24/43] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:20.250351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4d94d-c0b3-4dd1-be5d-714707f8d94e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:20.271425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:20.307118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ba7a8-c1d5-4df9-809d-0a525c8266a9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:20.341361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274b0c5-72f4-4a21-91c2-c549719e8253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:20.342030 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274b0c5-72f4-4a21-91c2-c549719e8253 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:20.342317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274b0c5-72f4-4a21-91c2-c549719e8253 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:20.342597 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274b0c5-72f4-4a21-91c2-c549719e8253 None admin] PATH_INFO: `/v3/domains/default/users/fa3cd04e53bd44eeabd80a82ed088455/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:20.344848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274b0c5-72f4-4a21-91c2-c549719e8253 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fa3cd04e53bd44eeabd80a82ed088455, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:20.346347 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274b0c5-72f4-4a21-91c2-c549719e8253 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:20.359066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4d94d-c0b3-4dd1-be5d-714707f8d94e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:20.361347 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 20/44] 10.222.0.67 () {58 vars in 1361 bytes} [Wed Jul 27 16:20:20 2022] PUT /identity/v3/domains/default/users/fa3cd04e53bd44eeabd80a82ed088455/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:20:20.396727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e39c3e-6c63-41b7-b17b-e091a2da2df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:20.397405 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e39c3e-6c63-41b7-b17b-e091a2da2df8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:20.397698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e39c3e-6c63-41b7-b17b-e091a2da2df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:20.397983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e39c3e-6c63-41b7-b17b-e091a2da2df8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:20.399206 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e39c3e-6c63-41b7-b17b-e091a2da2df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:20.400731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e39c3e-6c63-41b7-b17b-e091a2da2df8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:20.402402 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 25/45] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:20.408849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274b0c5-72f4-4a21-91c2-c549719e8253 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:20.517695 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274b0c5-72f4-4a21-91c2-c549719e8253 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:20.545225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:20.554615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf3e8a-b81d-4831-a4ff-2589b1596cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:20.555249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf3e8a-b81d-4831-a4ff-2589b1596cf1 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:20.555541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf3e8a-b81d-4831-a4ff-2589b1596cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:20.555823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf3e8a-b81d-4831-a4ff-2589b1596cf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:20.556557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf3e8a-b81d-4831-a4ff-2589b1596cf1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:20.558055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf3e8a-b81d-4831-a4ff-2589b1596cf1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:20.583912 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 21/46] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:20:20 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:20:22.342832 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73b317-e427-4626-801a-10d530fcfe1e None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:22.343353 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73b317-e427-4626-801a-10d530fcfe1e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:22.343550 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73b317-e427-4626-801a-10d530fcfe1e None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:22.344935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 26/47] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:22.350330 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63687d0-8aa8-4269-8c05-11dc6a1b29ec None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:22.350756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63687d0-8aa8-4269-8c05-11dc6a1b29ec None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:22.350911 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63687d0-8aa8-4269-8c05-11dc6a1b29ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:22.369160 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e63687d0-8aa8-4269-8c05-11dc6a1b29ec None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:22.370336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e63687d0-8aa8-4269-8c05-11dc6a1b29ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:22.435549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 22/48] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:22.458098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73b317-e427-4626-801a-10d530fcfe1e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:22.502986 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:22.563328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73b317-e427-4626-801a-10d530fcfe1e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:22.597335 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92621e-9f32-4fb6-b114-b1c5463dd668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:22.597912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92621e-9f32-4fb6-b114-b1c5463dd668 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:22.598200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92621e-9f32-4fb6-b114-b1c5463dd668 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:22.598481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92621e-9f32-4fb6-b114-b1c5463dd668 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:22.609481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92621e-9f32-4fb6-b114-b1c5463dd668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-4c92621e-9f32-4fb6-b114-b1c5463dd668 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:22.614524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:22.615502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:22.616528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:22.616528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:22.616528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:22.616528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:22.616528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:22.616528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:22.616528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:22.616528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:22.616528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:22.616528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:22.616528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:22.616528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:22.616528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 27/49] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:20:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:22.623415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63687d0-8aa8-4269-8c05-11dc6a1b29ec None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:22.650131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6dfc6-e870-49ea-8e87-5fdc782014e7 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:22.650422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6dfc6-e870-49ea-8e87-5fdc782014e7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:22.650704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6dfc6-e870-49ea-8e87-5fdc782014e7 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:22.652226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 28/50] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:22.658259 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfdfa9-ff35-4795-b684-ca831a3aeaf2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:22.658552 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfdfa9-ff35-4795-b684-ca831a3aeaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:22.658837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfdfa9-ff35-4795-b684-ca831a3aeaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:22.677499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b6cfdfa9-ff35-4795-b684-ca831a3aeaf2 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:22.678694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b6cfdfa9-ff35-4795-b684-ca831a3aeaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:22.725968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63687d0-8aa8-4269-8c05-11dc6a1b29ec None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:22.737173 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:22.747136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 29/51] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:22.761186 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adda27d-bf79-4c21-b962-c8cfe22585df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:22.761819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adda27d-bf79-4c21-b962-c8cfe22585df None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:22.762116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adda27d-bf79-4c21-b962-c8cfe22585df None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:22.762423 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adda27d-bf79-4c21-b962-c8cfe22585df None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:22.763148 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adda27d-bf79-4c21-b962-c8cfe22585df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:22.763463 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adda27d-bf79-4c21-b962-c8cfe22585df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:22.764881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adda27d-bf79-4c21-b962-c8cfe22585df None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:22.769144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfdfa9-ff35-4795-b684-ca831a3aeaf2 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:22.778246 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 23/52] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:22.783799 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adda27d-bf79-4c21-b962-c8cfe22585df None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:22.799744 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:22.867069 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfdfa9-ff35-4795-b684-ca831a3aeaf2 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:22.886766 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adda27d-bf79-4c21-b962-c8cfe22585df None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:22.900275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb35ee-7db6-482e-9d13-109e9d1981d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:22.900924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb35ee-7db6-482e-9d13-109e9d1981d2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:22.901203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb35ee-7db6-482e-9d13-109e9d1981d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:22.901478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb35ee-7db6-482e-9d13-109e9d1981d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:22.902633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb35ee-7db6-482e-9d13-109e9d1981d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:22.904649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb35ee-7db6-482e-9d13-109e9d1981d2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:22.906230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 30/53] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:22.911708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb35ee-7db6-482e-9d13-109e9d1981d2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:22.924054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e3c93-1e34-4701-b9a0-192d968d60a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:22.924708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e3c93-1e34-4701-b9a0-192d968d60a3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:22.924997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e3c93-1e34-4701-b9a0-192d968d60a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:22.925278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e3c93-1e34-4701-b9a0-192d968d60a3 None admin] PATH_INFO: `/v3/users/fa3cd04e53bd44eeabd80a82ed088455` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:22.926477 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e3c93-1e34-4701-b9a0-192d968d60a3 None admin] RBAC: Authorizing `identity:get_user(user_id=fa3cd04e53bd44eeabd80a82ed088455)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:22.927951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e3c93-1e34-4701-b9a0-192d968d60a3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:22.929567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 24/54] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:22 2022] GET /identity/v3/users/fa3cd04e53bd44eeabd80a82ed088455 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:22.934916 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e3c93-1e34-4701-b9a0-192d968d60a3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:22.976965 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:23.009532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:23.013166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb35ee-7db6-482e-9d13-109e9d1981d2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:23.034465 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e3c93-1e34-4701-b9a0-192d968d60a3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:23.047037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3135f3-5a10-4352-8a3a-0a7de0143989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:23.047663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3135f3-5a10-4352-8a3a-0a7de0143989 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:23.047982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3135f3-5a10-4352-8a3a-0a7de0143989 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:23.048289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3135f3-5a10-4352-8a3a-0a7de0143989 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:23.048986 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3135f3-5a10-4352-8a3a-0a7de0143989 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:23.050452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3135f3-5a10-4352-8a3a-0a7de0143989 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:23.066417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21ec9d-3e03-4eae-9a28-38a0e6d01d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:23.067059 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21ec9d-3e03-4eae-9a28-38a0e6d01d9f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:23.067344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21ec9d-3e03-4eae-9a28-38a0e6d01d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:23.067641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21ec9d-3e03-4eae-9a28-38a0e6d01d9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:23.068813 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21ec9d-3e03-4eae-9a28-38a0e6d01d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:23.070246 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21ec9d-3e03-4eae-9a28-38a0e6d01d9f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:23.071811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 25/55] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:23.078279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21ec9d-3e03-4eae-9a28-38a0e6d01d9f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:23.079696 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 31/56] 10.222.0.67 () {60 vars in 1140 bytes} [Wed Jul 27 16:20:22 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:20:23.185948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21ec9d-3e03-4eae-9a28-38a0e6d01d9f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:23.195719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:23.221701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c510bf-daa4-497c-94ec-a6800251f951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:23.222343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c510bf-daa4-497c-94ec-a6800251f951 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:23.222639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c510bf-daa4-497c-94ec-a6800251f951 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:23.222921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c510bf-daa4-497c-94ec-a6800251f951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:23.223721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c510bf-daa4-497c-94ec-a6800251f951 None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.domain.id=default, user.id=fa3cd04e53bd44eeabd80a82ed088455) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:23.224072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c510bf-daa4-497c-94ec-a6800251f951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:23.225530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c510bf-daa4-497c-94ec-a6800251f951 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:23.234497 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 26/57] 10.222.0.67 () {56 vars in 1322 bytes} [Wed Jul 27 16:20:23 2022] GET /identity/v3/role_assignments?user.id=fa3cd04e53bd44eeabd80a82ed088455&scope.domain.id=default&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:25.096809 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f16c0b-855e-443f-8d95-44519150c357 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:25.097325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f16c0b-855e-443f-8d95-44519150c357 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:25.097409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f16c0b-855e-443f-8d95-44519150c357 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:25.098723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 32/58] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:25.104166 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a749a41-fd32-492a-8f97-3ff9401188f1 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:25.104561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a749a41-fd32-492a-8f97-3ff9401188f1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:25.104738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a749a41-fd32-492a-8f97-3ff9401188f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:25.123300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3a749a41-fd32-492a-8f97-3ff9401188f1 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:25.124507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3a749a41-fd32-492a-8f97-3ff9401188f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:25.189383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 27/59] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:25.212623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f16c0b-855e-443f-8d95-44519150c357 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:25.312323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f16c0b-855e-443f-8d95-44519150c357 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:25.344058 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa284c3-e60d-4629-8799-efb6b3883e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:25.344691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa284c3-e60d-4629-8799-efb6b3883e9a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:25.344981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa284c3-e60d-4629-8799-efb6b3883e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:25.345265 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa284c3-e60d-4629-8799-efb6b3883e9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:25.346450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa284c3-e60d-4629-8799-efb6b3883e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:25.347990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa284c3-e60d-4629-8799-efb6b3883e9a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:25.349511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 33/60] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:25.355111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a749a41-fd32-492a-8f97-3ff9401188f1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:25.450889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a749a41-fd32-492a-8f97-3ff9401188f1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:25.452402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:25.485239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dee9a-e71a-4ee1-805e-bf00aa4fa79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:25.485863 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dee9a-e71a-4ee1-805e-bf00aa4fa79e None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:25.486154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dee9a-e71a-4ee1-805e-bf00aa4fa79e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:25.486435 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dee9a-e71a-4ee1-805e-bf00aa4fa79e None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:25.487128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dee9a-e71a-4ee1-805e-bf00aa4fa79e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:25.488608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dee9a-e71a-4ee1-805e-bf00aa4fa79e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:25.514485 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 28/61] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:20:25 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:20:28.336752 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd17e4b-7568-4067-9e39-a0796a4368f8 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:28.337691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd17e4b-7568-4067-9e39-a0796a4368f8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:28.338139 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd17e4b-7568-4067-9e39-a0796a4368f8 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:28.339797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 34/62] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:28.345273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfbdc2-bc8e-40c2-a138-5e39afe5f30d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:28.345712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfbdc2-bc8e-40c2-a138-5e39afe5f30d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:28.345858 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfbdc2-bc8e-40c2-a138-5e39afe5f30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:28.373164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e9dfbdc2-bc8e-40c2-a138-5e39afe5f30d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:28.374382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e9dfbdc2-bc8e-40c2-a138-5e39afe5f30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:28.450343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 29/63] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:28.473156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd17e4b-7568-4067-9e39-a0796a4368f8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:28.496913 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:28.613586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd17e4b-7568-4067-9e39-a0796a4368f8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:28.665115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f28d87-b31c-40ac-afc7-f96391752eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:28.666039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f28d87-b31c-40ac-afc7-f96391752eda None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:28.666552 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f28d87-b31c-40ac-afc7-f96391752eda None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:28.667052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f28d87-b31c-40ac-afc7-f96391752eda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:28.684470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f28d87-b31c-40ac-afc7-f96391752eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e4f28d87-b31c-40ac-afc7-f96391752eda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:28.690284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:28.691135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:28.691947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:28.691947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:28.691947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:28.691947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:28.691947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:28.691947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:28.691947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:28.691947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:28.691947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:28.691947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:28.691947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:28.691947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:28.694218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 35/64] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:28.700986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfbdc2-bc8e-40c2-a138-5e39afe5f30d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:28.783623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb5438-1f2b-43ec-8a3a-4ba6d1b18c2c None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:28.783960 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb5438-1f2b-43ec-8a3a-4ba6d1b18c2c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:28.784236 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb5438-1f2b-43ec-8a3a-4ba6d1b18c2c None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:28.785865 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 36/65] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:28.791116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d597f7-b6af-4e61-be92-5b9dc2f3dc1d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:28.791416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d597f7-b6af-4e61-be92-5b9dc2f3dc1d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:28.791819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d597f7-b6af-4e61-be92-5b9dc2f3dc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:28.826270 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:28.837421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-23d597f7-b6af-4e61-be92-5b9dc2f3dc1d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:28.838656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-23d597f7-b6af-4e61-be92-5b9dc2f3dc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:28.848498 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfbdc2-bc8e-40c2-a138-5e39afe5f30d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:28.916342 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4709a93-e48b-41b8-b1f8-b3a96e46fbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:28.918343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4709a93-e48b-41b8-b1f8-b3a96e46fbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:28.918819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4709a93-e48b-41b8-b1f8-b3a96e46fbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:28.919285 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4709a93-e48b-41b8-b1f8-b3a96e46fbf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:28.920691 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4709a93-e48b-41b8-b1f8-b3a96e46fbf3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:28.921191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4709a93-e48b-41b8-b1f8-b3a96e46fbf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:28.923537 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4709a93-e48b-41b8-b1f8-b3a96e46fbf3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:28.942102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 30/66] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:28.944662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56babf13-b46f-4818-adde-9f0c04b6afe9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:28.945142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56babf13-b46f-4818-adde-9f0c04b6afe9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:28.945604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56babf13-b46f-4818-adde-9f0c04b6afe9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:28.951681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 31/67] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:28.951826 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 37/68] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:28.951826 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d597f7-b6af-4e61-be92-5b9dc2f3dc1d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:28.954636 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184be3e-ef99-4191-977f-bc2dbb95e2e8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:28.954831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184be3e-ef99-4191-977f-bc2dbb95e2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:28.955072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184be3e-ef99-4191-977f-bc2dbb95e2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:28.965706 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:28.974228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d184be3e-ef99-4191-977f-bc2dbb95e2e8 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:28.975991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d184be3e-ef99-4191-977f-bc2dbb95e2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:29.055882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 32/69] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:29.055882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184be3e-ef99-4191-977f-bc2dbb95e2e8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:29.106932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d597f7-b6af-4e61-be92-5b9dc2f3dc1d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:29.146373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:29.156991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07728d0-ea84-465f-a807-aa109237cac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:29.158164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07728d0-ea84-465f-a807-aa109237cac8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:29.159012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07728d0-ea84-465f-a807-aa109237cac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:29.159788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07728d0-ea84-465f-a807-aa109237cac8 None admin] PATH_INFO: `/v3/users/f1e2907aa13946e8a0176f034f6fb069` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:29.173921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184be3e-ef99-4191-977f-bc2dbb95e2e8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:29.175756 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07728d0-ea84-465f-a807-aa109237cac8 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e2907aa13946e8a0176f034f6fb069)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:29.177745 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07728d0-ea84-465f-a807-aa109237cac8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:29.179459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 38/70] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:28 2022] GET /identity/v3/users/f1e2907aa13946e8a0176f034f6fb069 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:29.180419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07728d0-ea84-465f-a807-aa109237cac8 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:29.221800 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a436b-9d32-493a-8ab6-1b7b1122b204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:29.222794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a436b-9d32-493a-8ab6-1b7b1122b204 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:29.223278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a436b-9d32-493a-8ab6-1b7b1122b204 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:29.223773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a436b-9d32-493a-8ab6-1b7b1122b204 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:29.239379 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a436b-9d32-493a-8ab6-1b7b1122b204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-3b3a436b-9d32-493a-8ab6-1b7b1122b204 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:29.245045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:29.247145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:29.247938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:29.247938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:29.247938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:29.247938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:29.247938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:29.247938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:29.247938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:29.247938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:29.247938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:29.247938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:29.247938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:29.247938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:29.247938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 33/71] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:20:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:29.248566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a436b-9d32-493a-8ab6-1b7b1122b204 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:29.265982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:29.311891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07728d0-ea84-465f-a807-aa109237cac8 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:29.348765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b903541-355b-44c6-9669-f7ae68069353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:29.349446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903541-355b-44c6-9669-f7ae68069353 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:29.349697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903541-355b-44c6-9669-f7ae68069353 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:29.349975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903541-355b-44c6-9669-f7ae68069353 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:29.360932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b903541-355b-44c6-9669-f7ae68069353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:29.362403 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a436b-9d32-493a-8ab6-1b7b1122b204 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-4b903541-355b-44c6-9669-f7ae68069353 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:29.365895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:29.366833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:29.367672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:29.367672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:29.367672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:29.367672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:29.367672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:29.367672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:29.367672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:29.367672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:29.367672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:29.367672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:29.367672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:20:29.367672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:29.367672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 39/72] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:20:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:29.368351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b903541-355b-44c6-9669-f7ae68069353 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:29.399952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea057-c0bd-46f2-8502-b967fd81360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:29.400579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea057-c0bd-46f2-8502-b967fd81360e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:29.400869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea057-c0bd-46f2-8502-b967fd81360e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:29.401150 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea057-c0bd-46f2-8502-b967fd81360e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:29.411482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:29.468714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b903541-355b-44c6-9669-f7ae68069353 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:29.469958 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fea057-c0bd-46f2-8502-b967fd81360e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:29.471405 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fea057-c0bd-46f2-8502-b967fd81360e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:29.494850 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:29.503890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5c1fe-8304-4137-adef-15a11f74fa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:29.504516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5c1fe-8304-4137-adef-15a11f74fa16 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:29.504804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5c1fe-8304-4137-adef-15a11f74fa16 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:29.505085 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5c1fe-8304-4137-adef-15a11f74fa16 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:29.505802 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5c1fe-8304-4137-adef-15a11f74fa16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:29.506113 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5c1fe-8304-4137-adef-15a11f74fa16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:29.507485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5c1fe-8304-4137-adef-15a11f74fa16 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:29.516075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 40/73] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:29.517401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ecd5d-3716-450f-beed-b39244076be6 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:29.517695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ecd5d-3716-450f-beed-b39244076be6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:29.517974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ecd5d-3716-450f-beed-b39244076be6 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:29.523060 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 41/74] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:29.523060 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff940e-d8a2-407f-ad11-4c03f3458dd7 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:29.523060 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff940e-d8a2-407f-ad11-4c03f3458dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:29.523060 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff940e-d8a2-407f-ad11-4c03f3458dd7 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:29.523060 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 42/75] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:29.523529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff940e-d8a2-407f-ad11-4c03f3458dd7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:29.575170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 34/76] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:29.576066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea057-c0bd-46f2-8502-b967fd81360e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:29.617211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:29.624474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff940e-d8a2-407f-ad11-4c03f3458dd7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:29.663389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0aa87-0570-4eb6-85a8-08a04387ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:29.664055 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0aa87-0570-4eb6-85a8-08a04387ece3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:29.664351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0aa87-0570-4eb6-85a8-08a04387ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:29.664635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0aa87-0570-4eb6-85a8-08a04387ece3 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:29.665362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0aa87-0570-4eb6-85a8-08a04387ece3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:29.665672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0aa87-0570-4eb6-85a8-08a04387ece3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:29.667079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0aa87-0570-4eb6-85a8-08a04387ece3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:29.674717 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea057-c0bd-46f2-8502-b967fd81360e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:29.675551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 43/77] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:20:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:29.676744 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9722eed-5a55-496a-b35f-7fc45d6359ef None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:29.677035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9722eed-5a55-496a-b35f-7fc45d6359ef None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:29.677316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9722eed-5a55-496a-b35f-7fc45d6359ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:29.694455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b9722eed-5a55-496a-b35f-7fc45d6359ef None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:29.695646 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b9722eed-5a55-496a-b35f-7fc45d6359ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:29.714043 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5127d-86f2-42ee-83fb-d1f2e8ef01c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:29.715271 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5127d-86f2-42ee-83fb-d1f2e8ef01c6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:29.715551 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5127d-86f2-42ee-83fb-d1f2e8ef01c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:29.715825 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5127d-86f2-42ee-83fb-d1f2e8ef01c6 None admin] PATH_INFO: `/v3/users/fa3cd04e53bd44eeabd80a82ed088455` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:29.717035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5127d-86f2-42ee-83fb-d1f2e8ef01c6 None admin] RBAC: Authorizing `identity:get_user(user_id=fa3cd04e53bd44eeabd80a82ed088455)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:29.718474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5127d-86f2-42ee-83fb-d1f2e8ef01c6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:29.720167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 35/78] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:29 2022] GET /identity/v3/users/fa3cd04e53bd44eeabd80a82ed088455 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:29.721224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62c21-0bb5-461c-8838-cd90020fb724 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:29.721516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62c21-0bb5-461c-8838-cd90020fb724 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:29.721795 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62c21-0bb5-461c-8838-cd90020fb724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:29.739206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d3c62c21-0bb5-461c-8838-cd90020fb724 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:29.740424 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d3c62c21-0bb5-461c-8838-cd90020fb724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:29.744226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:29.764600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 44/79] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:29.765429 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9722eed-5a55-496a-b35f-7fc45d6359ef None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:29.808833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 36/80] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:29.809687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c62c21-0bb5-461c-8838-cd90020fb724 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:29.849068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:29.878363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9722eed-5a55-496a-b35f-7fc45d6359ef None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:29.907852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c62c21-0bb5-461c-8838-cd90020fb724 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:29.911102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd855f1-9590-4c89-b030-273d7614d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:29.911747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd855f1-9590-4c89-b030-273d7614d00a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:29.912065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd855f1-9590-4c89-b030-273d7614d00a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:29.912353 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd855f1-9590-4c89-b030-273d7614d00a None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:29.913512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd855f1-9590-4c89-b030-273d7614d00a None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:29.914967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd855f1-9590-4c89-b030-273d7614d00a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:29.916872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 45/81] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:29 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:29.917947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd855f1-9590-4c89-b030-273d7614d00a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:29.942652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703241e3-ddcf-47ca-85bb-9bc78a8320d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:29.943290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703241e3-ddcf-47ca-85bb-9bc78a8320d1 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:29.943575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703241e3-ddcf-47ca-85bb-9bc78a8320d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:29.943851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703241e3-ddcf-47ca-85bb-9bc78a8320d1 None admin] PATH_INFO: `/v3/users/f1e2907aa13946e8a0176f034f6fb069` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:29.945051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703241e3-ddcf-47ca-85bb-9bc78a8320d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e2907aa13946e8a0176f034f6fb069)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:29.946501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703241e3-ddcf-47ca-85bb-9bc78a8320d1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:29.953361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 37/82] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:29 2022] GET /identity/v3/users/f1e2907aa13946e8a0176f034f6fb069 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:29.953361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703241e3-ddcf-47ca-85bb-9bc78a8320d1 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:29.967123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:30.020195 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd855f1-9590-4c89-b030-273d7614d00a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:30.046635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703241e3-ddcf-47ca-85bb-9bc78a8320d1 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:30.053505 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:30.053768 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cdf69-6b24-46f1-a214-4185a276bb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:30.054504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cdf69-6b24-46f1-a214-4185a276bb7e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:30.054664 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cdf69-6b24-46f1-a214-4185a276bb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:30.054935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cdf69-6b24-46f1-a214-4185a276bb7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:30.081948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa42f2-0bef-4331-bf15-ad4f57723c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:30.082591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa42f2-0bef-4331-bf15-ad4f57723c18 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:30.082880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa42f2-0bef-4331-bf15-ad4f57723c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:30.083161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa42f2-0bef-4331-bf15-ad4f57723c18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:30.093185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa42f2-0bef-4331-bf15-ad4f57723c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-58aa42f2-0bef-4331-bf15-ad4f57723c18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:30.098161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:30.099185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:30.100008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:30.100008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:30.100008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:30.100008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:30.100008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:30.100008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:30.100008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:30.100008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:30.100008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:30.100008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:30.100008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:30.100008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:30.100008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 38/83] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:30.100910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa42f2-0bef-4331-bf15-ad4f57723c18 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:30.126090 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cdf69-6b24-46f1-a214-4185a276bb7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:30.127572 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cdf69-6b24-46f1-a214-4185a276bb7e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:30.176386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:30.199241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa42f2-0bef-4331-bf15-ad4f57723c18 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:30.229902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 46/84] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:30.230977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cdf69-6b24-46f1-a214-4185a276bb7e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:30.232783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de672845-9956-49d0-bd06-4d160c4e243a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:30.233432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de672845-9956-49d0-bd06-4d160c4e243a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:30.233722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de672845-9956-49d0-bd06-4d160c4e243a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:30.234088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de672845-9956-49d0-bd06-4d160c4e243a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:30.235417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de672845-9956-49d0-bd06-4d160c4e243a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:30.236888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de672845-9956-49d0-bd06-4d160c4e243a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:30.242787 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 39/85] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:30.242787 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de672845-9956-49d0-bd06-4d160c4e243a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:30.273001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:30.327920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cdf69-6b24-46f1-a214-4185a276bb7e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:30.340248 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de672845-9956-49d0-bd06-4d160c4e243a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:30.362347 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d29126-05b0-4981-ac8d-d2e91746db44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:30.363124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d29126-05b0-4981-ac8d-d2e91746db44 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:30.363410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d29126-05b0-4981-ac8d-d2e91746db44 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:30.364029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d29126-05b0-4981-ac8d-d2e91746db44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:30.364815 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d29126-05b0-4981-ac8d-d2e91746db44 None admin] RBAC: Adding query filter params (role.id=19570429b77848d998cb882f8b16aa76, scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd, user.id=f1e2907aa13946e8a0176f034f6fb069) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:30.365134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d29126-05b0-4981-ac8d-d2e91746db44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:30.366574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d29126-05b0-4981-ac8d-d2e91746db44 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:30.372429 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 47/86] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:30 2022] GET /identity/v3/role_assignments?user.id=f1e2907aa13946e8a0176f034f6fb069&scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd&role.id=19570429b77848d998cb882f8b16aa76 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:30.373200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d29126-05b0-4981-ac8d-d2e91746db44 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:30.379510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628a2dc-3067-488d-aa20-8916dc4447e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:30.380401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628a2dc-3067-488d-aa20-8916dc4447e9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:30.380755 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628a2dc-3067-488d-aa20-8916dc4447e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:30.381041 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628a2dc-3067-488d-aa20-8916dc4447e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:30.397654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:30.460818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628a2dc-3067-488d-aa20-8916dc4447e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:30.462446 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628a2dc-3067-488d-aa20-8916dc4447e9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:30.496817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d29126-05b0-4981-ac8d-d2e91746db44 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:30.500435 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:30.545791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdf3f6-ccf0-4f11-ad97-ce28ec908ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:30.546355 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdf3f6-ccf0-4f11-ad97-ce28ec908ead None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:30.546643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdf3f6-ccf0-4f11-ad97-ce28ec908ead None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:30.546923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdf3f6-ccf0-4f11-ad97-ce28ec908ead None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:30.547642 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdf3f6-ccf0-4f11-ad97-ce28ec908ead None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:30.547979 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdf3f6-ccf0-4f11-ad97-ce28ec908ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:30.549443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdf3f6-ccf0-4f11-ad97-ce28ec908ead None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:30.559013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 48/87] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:30.559831 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdf3f6-ccf0-4f11-ad97-ce28ec908ead None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:30.583501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 40/88] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:30.584377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628a2dc-3067-488d-aa20-8916dc4447e9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:30.647495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:30.680282 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdf3f6-ccf0-4f11-ad97-ce28ec908ead None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:30.693361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628a2dc-3067-488d-aa20-8916dc4447e9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:30.718068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ecd46-e05c-484c-a503-1ba08286a22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:30.718721 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ecd46-e05c-484c-a503-1ba08286a22d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:30.719009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ecd46-e05c-484c-a503-1ba08286a22d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:30.719513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ecd46-e05c-484c-a503-1ba08286a22d None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:30.720472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ecd46-e05c-484c-a503-1ba08286a22d None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:30.721923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ecd46-e05c-484c-a503-1ba08286a22d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:30.723577 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 49/89] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:30 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:30.728843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ecd46-e05c-484c-a503-1ba08286a22d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:30.736175 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cfe42-3942-433a-8f4e-2a6a6a31e9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:30.736883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cfe42-3942-433a-8f4e-2a6a6a31e9b3 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:30.737176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cfe42-3942-433a-8f4e-2a6a6a31e9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:30.737723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cfe42-3942-433a-8f4e-2a6a6a31e9b3 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:30.738147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cfe42-3942-433a-8f4e-2a6a6a31e9b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:30.739573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cfe42-3942-433a-8f4e-2a6a6a31e9b3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:30.747704 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:30.763412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 41/90] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:20:30 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:20:30.764564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cfe42-3942-433a-8f4e-2a6a6a31e9b3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:30.854142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ecd46-e05c-484c-a503-1ba08286a22d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:30.899709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a8187-b5c0-4326-84c1-711a81b2cf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:30.900568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8187-b5c0-4326-84c1-711a81b2cf84 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:30.900910 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8187-b5c0-4326-84c1-711a81b2cf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:30.901533 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8187-b5c0-4326-84c1-711a81b2cf84 None admin] PATH_INFO: `/v3/users/f1e2907aa13946e8a0176f034f6fb069` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:30.903662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a8187-b5c0-4326-84c1-711a81b2cf84 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e2907aa13946e8a0176f034f6fb069)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:30.905970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a8187-b5c0-4326-84c1-711a81b2cf84 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:30.907823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 50/91] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:30 2022] GET /identity/v3/users/f1e2907aa13946e8a0176f034f6fb069 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:30.907962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cfe42-3942-433a-8f4e-2a6a6a31e9b3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:30.908485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a8187-b5c0-4326-84c1-711a81b2cf84 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:30.928300 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:30.957263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a856204-d762-409a-973c-605c7ee84a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:30.958208 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856204-d762-409a-973c-605c7ee84a29 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:30.958646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856204-d762-409a-973c-605c7ee84a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:30.959067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856204-d762-409a-973c-605c7ee84a29 None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:30.960422 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a856204-d762-409a-973c-605c7ee84a29 None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:30.962294 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a856204-d762-409a-973c-605c7ee84a29 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:30.964696 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 42/92] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:30 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:30.968745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a856204-d762-409a-973c-605c7ee84a29 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:31.045167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:31.053124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a8187-b5c0-4326-84c1-711a81b2cf84 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:31.107989 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a856204-d762-409a-973c-605c7ee84a29 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:31.109171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5c23b-2552-434f-980a-37d9c4aaba47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:31.110867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5c23b-2552-434f-980a-37d9c4aaba47 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:31.111342 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5c23b-2552-434f-980a-37d9c4aaba47 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:31.111785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5c23b-2552-434f-980a-37d9c4aaba47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:31.112824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5c23b-2552-434f-980a-37d9c4aaba47 None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd, user.id=fa3cd04e53bd44eeabd80a82ed088455) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:31.113341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5c23b-2552-434f-980a-37d9c4aaba47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:31.115431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5c23b-2552-434f-980a-37d9c4aaba47 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:31.122754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 51/93] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:30 2022] GET /identity/v3/role_assignments?user.id=fa3cd04e53bd44eeabd80a82ed088455&scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:31.124399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5c23b-2552-434f-980a-37d9c4aaba47 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:31.156118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc66d0-9b0d-453c-8a4d-5a0d100e9bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:31.156764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc66d0-9b0d-453c-8a4d-5a0d100e9bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:31.157374 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc66d0-9b0d-453c-8a4d-5a0d100e9bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:31.157667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc66d0-9b0d-453c-8a4d-5a0d100e9bc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:31.251722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:31.261017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc66d0-9b0d-453c-8a4d-5a0d100e9bc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:31.263380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc66d0-9b0d-453c-8a4d-5a0d100e9bc1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:31.280218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5c23b-2552-434f-980a-37d9c4aaba47 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:31.319790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07d55e-8abe-4446-9c2e-1998410a8474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:31.320717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07d55e-8abe-4446-9c2e-1998410a8474 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:31.321148 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07d55e-8abe-4446-9c2e-1998410a8474 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:31.321570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07d55e-8abe-4446-9c2e-1998410a8474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:31.322585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07d55e-8abe-4446-9c2e-1998410a8474 None admin] RBAC: Adding query filter params (role.id=84e73bacaaef4e4ab018e94824f9d891, scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd, user.id=f1e2907aa13946e8a0176f034f6fb069) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:31.323116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07d55e-8abe-4446-9c2e-1998410a8474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:31.325351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07d55e-8abe-4446-9c2e-1998410a8474 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:31.331888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 52/94] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:31 2022] GET /identity/v3/role_assignments?user.id=f1e2907aa13946e8a0176f034f6fb069&scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd&role.id=84e73bacaaef4e4ab018e94824f9d891 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:31.336383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:31.392455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 43/95] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:31.397979 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07d55e-8abe-4446-9c2e-1998410a8474 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:31.542969 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07d55e-8abe-4446-9c2e-1998410a8474 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:31.579305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fe0f3-5c7f-4f8d-a01a-35fc125c4144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:31.580371 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fe0f3-5c7f-4f8d-a01a-35fc125c4144 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:31.580863 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fe0f3-5c7f-4f8d-a01a-35fc125c4144 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:31.581341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fe0f3-5c7f-4f8d-a01a-35fc125c4144 None admin] PATH_INFO: `/v3/projects/1b139189c3764032ba292267e750c713` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:31.582765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fe0f3-5c7f-4f8d-a01a-35fc125c4144 None admin] RBAC: Authorizing `identity:get_project(project_id=1b139189c3764032ba292267e750c713)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:31.584450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fe0f3-5c7f-4f8d-a01a-35fc125c4144 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:31.586354 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 53/96] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:31 2022] GET /identity/v3/projects/1b139189c3764032ba292267e750c713 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:31.597014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc66d0-9b0d-453c-8a4d-5a0d100e9bc1 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:31.742996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc66d0-9b0d-453c-8a4d-5a0d100e9bc1 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:31.789695 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aeb781-528b-43cc-8852-d62dc9653979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:31.790696 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aeb781-528b-43cc-8852-d62dc9653979 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:31.791182 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aeb781-528b-43cc-8852-d62dc9653979 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:31.791655 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aeb781-528b-43cc-8852-d62dc9653979 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:31.793232 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aeb781-528b-43cc-8852-d62dc9653979 None admin] RBAC: Adding query filter params (role.id=19570429b77848d998cb882f8b16aa76, scope.project.id=1b139189c3764032ba292267e750c713, user.id=f1e2907aa13946e8a0176f034f6fb069) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:31.793746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aeb781-528b-43cc-8852-d62dc9653979 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:31.795382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aeb781-528b-43cc-8852-d62dc9653979 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:31.804134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 44/97] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:31 2022] GET /identity/v3/role_assignments?user.id=f1e2907aa13946e8a0176f034f6fb069&scope.project.id=1b139189c3764032ba292267e750c713&role.id=19570429b77848d998cb882f8b16aa76 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:32.945269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7778-c80f-4c69-85dd-178d80813362 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:32.945759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7778-c80f-4c69-85dd-178d80813362 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:32.945759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7778-c80f-4c69-85dd-178d80813362 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:32.947140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 54/98] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:32.953649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77a4c5-011f-4d32-ad6d-69bfd1abe883 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:32.954149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77a4c5-011f-4d32-ad6d-69bfd1abe883 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:32.954426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77a4c5-011f-4d32-ad6d-69bfd1abe883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:32.978402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4c77a4c5-011f-4d32-ad6d-69bfd1abe883 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:32.979803 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4c77a4c5-011f-4d32-ad6d-69bfd1abe883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:32.997323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:33.063629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 45/99] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:33.086698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d7778-c80f-4c69-85dd-178d80813362 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:33.098132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:33.211991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d7778-c80f-4c69-85dd-178d80813362 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:33.246738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0f784-96b7-4048-8ac3-7a1b90a22e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:33.247396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0f784-96b7-4048-8ac3-7a1b90a22e51 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:33.247687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0f784-96b7-4048-8ac3-7a1b90a22e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:33.247996 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0f784-96b7-4048-8ac3-7a1b90a22e51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:33.263146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0f784-96b7-4048-8ac3-7a1b90a22e51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-47e0f784-96b7-4048-8ac3-7a1b90a22e51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:33.268654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:33.269538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:33.270313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:33.270313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:33.270313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:33.270313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:33.270313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:33.270313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:33.270313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:33.270313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:33.270313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:33.270313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:33.270313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:33.270313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:33.270313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 55/100] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:33.275893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77a4c5-011f-4d32-ad6d-69bfd1abe883 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:33.389018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77a4c5-011f-4d32-ad6d-69bfd1abe883 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:33.441137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bfae8-7d17-4c5e-a0cd-c289f2ca3243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:33.441783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bfae8-7d17-4c5e-a0cd-c289f2ca3243 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:33.442078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bfae8-7d17-4c5e-a0cd-c289f2ca3243 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:33.442361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bfae8-7d17-4c5e-a0cd-c289f2ca3243 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:33.443090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bfae8-7d17-4c5e-a0cd-c289f2ca3243 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:33.443405 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bfae8-7d17-4c5e-a0cd-c289f2ca3243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:33.444824 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bfae8-7d17-4c5e-a0cd-c289f2ca3243 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:33.457991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 46/101] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:33.464001 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0f784-96b7-4048-8ac3-7a1b90a22e51 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:33.564398 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:33.614827 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0f784-96b7-4048-8ac3-7a1b90a22e51 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:33.662979 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682a2f3-1b7e-4b5a-be5f-ea2640a676d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:33.663637 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682a2f3-1b7e-4b5a-be5f-ea2640a676d9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:33.663952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682a2f3-1b7e-4b5a-be5f-ea2640a676d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:33.664238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682a2f3-1b7e-4b5a-be5f-ea2640a676d9 None admin] PATH_INFO: `/v3/users/f1e2907aa13946e8a0176f034f6fb069` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:33.665503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682a2f3-1b7e-4b5a-be5f-ea2640a676d9 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e2907aa13946e8a0176f034f6fb069)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:33.668114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682a2f3-1b7e-4b5a-be5f-ea2640a676d9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:33.669933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 56/102] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:33 2022] GET /identity/v3/users/f1e2907aa13946e8a0176f034f6fb069 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:33.675718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bfae8-7d17-4c5e-a0cd-c289f2ca3243 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:33.705051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:33.822672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bfae8-7d17-4c5e-a0cd-c289f2ca3243 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:33.871240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af27cc5-40a6-46d7-88af-a10c2b99f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:33.872020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af27cc5-40a6-46d7-88af-a10c2b99f219 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:33.872365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af27cc5-40a6-46d7-88af-a10c2b99f219 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:33.872708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af27cc5-40a6-46d7-88af-a10c2b99f219 None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:33.874139 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af27cc5-40a6-46d7-88af-a10c2b99f219 None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:33.875837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af27cc5-40a6-46d7-88af-a10c2b99f219 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:33.877778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 47/103] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:33 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:33.883626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682a2f3-1b7e-4b5a-be5f-ea2640a676d9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:34.033232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682a2f3-1b7e-4b5a-be5f-ea2640a676d9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:34.077651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc0f8-85c8-4f64-b64d-992f741c5a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:34.078260 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc0f8-85c8-4f64-b64d-992f741c5a9e None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.078550 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc0f8-85c8-4f64-b64d-992f741c5a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.078833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc0f8-85c8-4f64-b64d-992f741c5a9e None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd/users/f1e2907aa13946e8a0176f034f6fb069/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.080851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dc0f8-85c8-4f64-b64d-992f741c5a9e None admin] RBAC: Authorizing `identity:create_grant(project_id=a5026856c5ec49ea9b8ef8af75a466dd, user_id=f1e2907aa13946e8a0176f034f6fb069, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:34.082307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dc0f8-85c8-4f64-b64d-992f741c5a9e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:34.086596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:34.111459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 57/104] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:20:33 2022] PUT /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd/users/f1e2907aa13946e8a0176f034f6fb069/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:20:34.127038 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833d096-b579-46a5-9782-cd4f3f61085e None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.127543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833d096-b579-46a5-9782-cd4f3f61085e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.127772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833d096-b579-46a5-9782-cd4f3f61085e None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.129056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 48/105] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:34.134786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c402f-dbc0-4938-837c-bbb5639d395e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.135081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c402f-dbc0-4938-837c-bbb5639d395e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.135547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c402f-dbc0-4938-837c-bbb5639d395e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.161413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c33c402f-dbc0-4938-837c-bbb5639d395e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:34.162682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c33c402f-dbc0-4938-837c-bbb5639d395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:34.256326 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 58/106] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:34.295596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833d096-b579-46a5-9782-cd4f3f61085e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:34.383499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a27e5-a1fb-46aa-896f-53cb6155c337 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.383785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a27e5-a1fb-46aa-896f-53cb6155c337 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.384017 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a27e5-a1fb-46aa-896f-53cb6155c337 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.386067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 59/107] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:34.391467 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63419f8-aacf-4658-af5a-dc739dc47d22 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.392043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63419f8-aacf-4658-af5a-dc739dc47d22 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.392531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63419f8-aacf-4658-af5a-dc739dc47d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.402634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:34.418606 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e63419f8-aacf-4658-af5a-dc739dc47d22 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:34.419336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e63419f8-aacf-4658-af5a-dc739dc47d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:34.427123 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833d096-b579-46a5-9782-cd4f3f61085e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:34.464760 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249876ad-ce26-459d-80d9-628ebc2af9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:34.465540 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249876ad-ce26-459d-80d9-628ebc2af9dd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.465891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249876ad-ce26-459d-80d9-628ebc2af9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.467382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249876ad-ce26-459d-80d9-628ebc2af9dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.478718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249876ad-ce26-459d-80d9-628ebc2af9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-249876ad-ce26-459d-80d9-628ebc2af9dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:34.484019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:34.484895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 49/108] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:34.489126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2a3ff-c27e-4184-b735-d8df1a7299b8 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.490012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2a3ff-c27e-4184-b735-d8df1a7299b8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.490012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2a3ff-c27e-4184-b735-d8df1a7299b8 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.490012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 50/109] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:34.491647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e3bdf-0f7c-49de-b63e-b65b683fcaa5 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.491765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e3bdf-0f7c-49de-b63e-b65b683fcaa5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.492183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e3bdf-0f7c-49de-b63e-b65b683fcaa5 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.494511 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 51/110] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:34.494619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d2398-7602-4e3f-aafe-2306228cd2a9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.494936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d2398-7602-4e3f-aafe-2306228cd2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.495273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d2398-7602-4e3f-aafe-2306228cd2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.513868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f52d2398-7602-4e3f-aafe-2306228cd2a9 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:34.515157 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f52d2398-7602-4e3f-aafe-2306228cd2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:34.518721 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 60/111] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:34.520433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daadca7-8ec9-4092-9d75-0b20597847ad None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.520907 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daadca7-8ec9-4092-9d75-0b20597847ad None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.521369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daadca7-8ec9-4092-9d75-0b20597847ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.542321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1daadca7-8ec9-4092-9d75-0b20597847ad None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:34.543979 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1daadca7-8ec9-4092-9d75-0b20597847ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:34.602682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:34.606256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 52/112] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:34.607190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d2398-7602-4e3f-aafe-2306228cd2a9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:34.625093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 61/113] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:34.626495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daadca7-8ec9-4092-9d75-0b20597847ad None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:34.701045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:34.734305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d2398-7602-4e3f-aafe-2306228cd2a9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:34.743235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daadca7-8ec9-4092-9d75-0b20597847ad None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:34.770337 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf51bd6-8fba-4ce6-bc11-122a699cf753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:34.770868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf51bd6-8fba-4ce6-bc11-122a699cf753 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.771158 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf51bd6-8fba-4ce6-bc11-122a699cf753 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.771440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf51bd6-8fba-4ce6-bc11-122a699cf753 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.772191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf51bd6-8fba-4ce6-bc11-122a699cf753 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:34.772504 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf51bd6-8fba-4ce6-bc11-122a699cf753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:34.773900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf51bd6-8fba-4ce6-bc11-122a699cf753 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:34.783633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b3fba-ed64-41df-918a-a3c3dde9f24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:34.784429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 53/114] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:34.784859 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b3fba-ed64-41df-918a-a3c3dde9f24b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.785381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf51bd6-8fba-4ce6-bc11-122a699cf753 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:34.785485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b3fba-ed64-41df-918a-a3c3dde9f24b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.785923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b3fba-ed64-41df-918a-a3c3dde9f24b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.787287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b3fba-ed64-41df-918a-a3c3dde9f24b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:34.789586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b3fba-ed64-41df-918a-a3c3dde9f24b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:34.791479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 62/115] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:34.792824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b3fba-ed64-41df-918a-a3c3dde9f24b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:34.858111 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:34.906744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf51bd6-8fba-4ce6-bc11-122a699cf753 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:34.911352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b3fba-ed64-41df-918a-a3c3dde9f24b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:34.950902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d30468-4fbb-4e9b-bc57-65ffe678fffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:34.952009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d30468-4fbb-4e9b-bc57-65ffe678fffa None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.952558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d30468-4fbb-4e9b-bc57-65ffe678fffa None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.953095 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d30468-4fbb-4e9b-bc57-65ffe678fffa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.954868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd56579-483a-41ff-b7e1-e358caab36af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:34.955787 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd56579-483a-41ff-b7e1-e358caab36af None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:34.956250 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd56579-483a-41ff-b7e1-e358caab36af None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:34.957159 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd56579-483a-41ff-b7e1-e358caab36af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:34.960374 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:34.968017 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d30468-4fbb-4e9b-bc57-65ffe678fffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:34.972785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd56579-483a-41ff-b7e1-e358caab36af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-06d30468-4fbb-4e9b-bc57-65ffe678fffa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:34.973686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:34.974544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:34.975571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:34.975571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:34.975571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:34.975571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:34.975571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:34.975571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:34.975571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:34.975571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:34.975571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:34.975571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:34.975571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:20:34.975571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:34.977963 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 63/116] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:20:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:34.979574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d30468-4fbb-4e9b-bc57-65ffe678fffa None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-dfd56579-483a-41ff-b7e1-e358caab36af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:34.984743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:34.985575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:34.986746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:34.986746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:34.986746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:34.986746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:34.986746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:34.986746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:34.986746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:34.986746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:34.986746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:34.986746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:34.986746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:34.986746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:34.986746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 54/117] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:20:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:34.987394 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd56579-483a-41ff-b7e1-e358caab36af None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:35.097672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd56579-483a-41ff-b7e1-e358caab36af None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:35.104885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d30468-4fbb-4e9b-bc57-65ffe678fffa None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:35.119438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:35.133933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234937fe-33da-4bfb-9454-e029e0e5d53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:35.134575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234937fe-33da-4bfb-9454-e029e0e5d53f None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:35.134866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234937fe-33da-4bfb-9454-e029e0e5d53f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:35.135147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234937fe-33da-4bfb-9454-e029e0e5d53f None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:35.136539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234937fe-33da-4bfb-9454-e029e0e5d53f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:35.137992 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234937fe-33da-4bfb-9454-e029e0e5d53f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:35.142811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35c545-02cb-447d-8b99-c08b631b683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:35.143456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c545-02cb-447d-8b99-c08b631b683a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:35.143741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c545-02cb-447d-8b99-c08b631b683a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:35.144053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c545-02cb-447d-8b99-c08b631b683a None admin] PATH_INFO: `/v3/users/affe7e43233541cbb293ef2ffa85e874` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:35.158476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35c545-02cb-447d-8b99-c08b631b683a None admin] RBAC: Authorizing `identity:get_user(user_id=affe7e43233541cbb293ef2ffa85e874)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:35.160303 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35c545-02cb-447d-8b99-c08b631b683a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:35.162047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 64/118] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:34 2022] GET /identity/v3/users/affe7e43233541cbb293ef2ffa85e874 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:35.167579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35c545-02cb-447d-8b99-c08b631b683a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:35.169318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 55/119] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:20:34 2022] POST /identity/v3/projects => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:20:35.170379 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234937fe-33da-4bfb-9454-e029e0e5d53f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:35.226211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:35.291432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234937fe-33da-4bfb-9454-e029e0e5d53f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:35.302385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35c545-02cb-447d-8b99-c08b631b683a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:35.335234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63df85-9985-4982-a405-8559ff851a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:35.335889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63df85-9985-4982-a405-8559ff851a58 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:35.336185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63df85-9985-4982-a405-8559ff851a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:35.336460 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63df85-9985-4982-a405-8559ff851a58 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:35.337242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63df85-9985-4982-a405-8559ff851a58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:35.337552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63df85-9985-4982-a405-8559ff851a58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:35.339747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63df85-9985-4982-a405-8559ff851a58 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:35.344718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09f884-49fc-4605-890c-b3bec116c886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:35.345754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09f884-49fc-4605-890c-b3bec116c886 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:35.346050 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09f884-49fc-4605-890c-b3bec116c886 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:35.346479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09f884-49fc-4605-890c-b3bec116c886 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:35.347625 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09f884-49fc-4605-890c-b3bec116c886 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:35.348762 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09f884-49fc-4605-890c-b3bec116c886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:35.348868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 56/120] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:35.349670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09f884-49fc-4605-890c-b3bec116c886 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:35.350389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41954c-0f92-4274-8f18-e9c928b6866e None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:35.350787 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41954c-0f92-4274-8f18-e9c928b6866e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:35.350974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41954c-0f92-4274-8f18-e9c928b6866e None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:35.352375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 57/121] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:35.353080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41954c-0f92-4274-8f18-e9c928b6866e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:35.370858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 65/122] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:20:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:35.371726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09f884-49fc-4605-890c-b3bec116c886 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:35.417909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:35.482190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09f884-49fc-4605-890c-b3bec116c886 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:35.489383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41954c-0f92-4274-8f18-e9c928b6866e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:35.508263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:35.524994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d22811-f88e-4afc-be1b-a7c63b2a63ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:35.527227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d22811-f88e-4afc-be1b-a7c63b2a63ff None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:35.527589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d22811-f88e-4afc-be1b-a7c63b2a63ff None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:35.527914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d22811-f88e-4afc-be1b-a7c63b2a63ff None admin] PATH_INFO: `/v3/users/fa3cd04e53bd44eeabd80a82ed088455` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:35.530319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d22811-f88e-4afc-be1b-a7c63b2a63ff None admin] RBAC: Authorizing `identity:get_user(user_id=fa3cd04e53bd44eeabd80a82ed088455)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:35.532323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d22811-f88e-4afc-be1b-a7c63b2a63ff None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:35.534220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 66/123] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:35 2022] GET /identity/v3/users/fa3cd04e53bd44eeabd80a82ed088455 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:35.534339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf5f7e-3993-47bb-acab-2f54b3fe98ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:35.535081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf5f7e-3993-47bb-acab-2f54b3fe98ab None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:35.535443 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf5f7e-3993-47bb-acab-2f54b3fe98ab None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:35.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf5f7e-3993-47bb-acab-2f54b3fe98ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:35.540420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c02da9-cdd5-4858-8ea1-9b4e46d66cc1 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:35.540739 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c02da9-cdd5-4858-8ea1-9b4e46d66cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:35.541025 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c02da9-cdd5-4858-8ea1-9b4e46d66cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:35.566626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a6c02da9-cdd5-4858-8ea1-9b4e46d66cc1 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:35.568644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a6c02da9-cdd5-4858-8ea1-9b4e46d66cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:35.620568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf5f7e-3993-47bb-acab-2f54b3fe98ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:35.622196 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf5f7e-3993-47bb-acab-2f54b3fe98ab None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:35.664581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 67/124] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:35.667081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c02da9-cdd5-4858-8ea1-9b4e46d66cc1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:35.719823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:35.754018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 58/125] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:35.755324 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf5f7e-3993-47bb-acab-2f54b3fe98ab None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:35.767317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:35.815643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c02da9-cdd5-4858-8ea1-9b4e46d66cc1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:35.863952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55318c3-a55c-45f0-ad5f-5bba6eea6e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:35.864878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55318c3-a55c-45f0-ad5f-5bba6eea6e5f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:35.865173 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55318c3-a55c-45f0-ad5f-5bba6eea6e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:35.865459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55318c3-a55c-45f0-ad5f-5bba6eea6e5f None admin] PATH_INFO: `/v3/users/f1e2907aa13946e8a0176f034f6fb069` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:35.867389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55318c3-a55c-45f0-ad5f-5bba6eea6e5f None admin] RBAC: Authorizing `identity:get_user(user_id=f1e2907aa13946e8a0176f034f6fb069)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:35.869189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55318c3-a55c-45f0-ad5f-5bba6eea6e5f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:35.871614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 68/126] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:35 2022] GET /identity/v3/users/f1e2907aa13946e8a0176f034f6fb069 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:35.872695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55318c3-a55c-45f0-ad5f-5bba6eea6e5f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:35.876083 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf5f7e-3993-47bb-acab-2f54b3fe98ab None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:35.920434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eb009-90e8-4383-9d09-c4fcbf871d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:35.921092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eb009-90e8-4383-9d09-c4fcbf871d16 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:35.921384 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eb009-90e8-4383-9d09-c4fcbf871d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:35.921669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eb009-90e8-4383-9d09-c4fcbf871d16 None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:35.923407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34eb009-90e8-4383-9d09-c4fcbf871d16 None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:35.925406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34eb009-90e8-4383-9d09-c4fcbf871d16 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:35.927851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 59/127] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:35 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:35.932804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eb009-90e8-4383-9d09-c4fcbf871d16 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:36.002915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:36.006836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55318c3-a55c-45f0-ad5f-5bba6eea6e5f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:36.026819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:36.048202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8da497-4912-4716-a082-677cbb46d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:36.049245 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8da497-4912-4716-a082-677cbb46d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:36.049730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8da497-4912-4716-a082-677cbb46d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:36.050202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8da497-4912-4716-a082-677cbb46d6f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:36.052389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eb009-90e8-4383-9d09-c4fcbf871d16 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:36.062792 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8da497-4912-4716-a082-677cbb46d6f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-9d8da497-4912-4716-a082-677cbb46d6f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:36.068420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:36.069339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:36.070171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:36.070171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:36.070171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:36.070171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:36.070171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:36.070171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:36.070171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:36.070171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:36.070171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:36.070171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:36.070171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:36.070171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:36.077401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 69/128] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:36.078552 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8da497-4912-4716-a082-677cbb46d6f7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:36.089648 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993837d-2d5c-46ad-905a-20ead3de0d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:36.090427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993837d-2d5c-46ad-905a-20ead3de0d9d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:36.090811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993837d-2d5c-46ad-905a-20ead3de0d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:36.091202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993837d-2d5c-46ad-905a-20ead3de0d9d None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:36.092502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993837d-2d5c-46ad-905a-20ead3de0d9d None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:36.094048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993837d-2d5c-46ad-905a-20ead3de0d9d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:36.095870 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 60/129] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:35 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:36.096928 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993837d-2d5c-46ad-905a-20ead3de0d9d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:36.194501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8da497-4912-4716-a082-677cbb46d6f7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:36.198924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993837d-2d5c-46ad-905a-20ead3de0d9d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:36.233659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a9fd2-8cf4-42ed-9510-40fc0b3fe2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:36.234483 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a9fd2-8cf4-42ed-9510-40fc0b3fe2eb None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:36.234990 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a9fd2-8cf4-42ed-9510-40fc0b3fe2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:36.235368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a9fd2-8cf4-42ed-9510-40fc0b3fe2eb None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd/users/fa3cd04e53bd44eeabd80a82ed088455/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:36.235736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6050a5-1abf-49d0-835d-86b29d47367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:36.236697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6050a5-1abf-49d0-835d-86b29d47367e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:36.237241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6050a5-1abf-49d0-835d-86b29d47367e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:36.237671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6050a5-1abf-49d0-835d-86b29d47367e None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:36.237779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a9fd2-8cf4-42ed-9510-40fc0b3fe2eb None admin] RBAC: Authorizing `identity:create_grant(project_id=a5026856c5ec49ea9b8ef8af75a466dd, user_id=fa3cd04e53bd44eeabd80a82ed088455, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:36.239093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6050a5-1abf-49d0-835d-86b29d47367e None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:36.239533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a9fd2-8cf4-42ed-9510-40fc0b3fe2eb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:36.241006 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6050a5-1abf-49d0-835d-86b29d47367e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:36.243601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 70/130] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:36 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:36.245246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6050a5-1abf-49d0-835d-86b29d47367e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:36.263242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 61/131] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:20:36 2022] PUT /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd/users/fa3cd04e53bd44eeabd80a82ed088455/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:20:36.271963 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a9fd2-8cf4-42ed-9510-40fc0b3fe2eb None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:36.274732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:36.299036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:36.390835 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a9fd2-8cf4-42ed-9510-40fc0b3fe2eb None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:36.456795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6050a5-1abf-49d0-835d-86b29d47367e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:36.467773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71f827-d634-4768-8d0f-a0b3f265e301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:36.468456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71f827-d634-4768-8d0f-a0b3f265e301 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:36.468746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71f827-d634-4768-8d0f-a0b3f265e301 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:36.469030 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71f827-d634-4768-8d0f-a0b3f265e301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:36.469954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71f827-d634-4768-8d0f-a0b3f265e301 None admin] RBAC: Adding query filter params (role.id=f8835028095e42448f0322ba8f1011e8, scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd, user.id=affe7e43233541cbb293ef2ffa85e874) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:36.470278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71f827-d634-4768-8d0f-a0b3f265e301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:36.471731 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71f827-d634-4768-8d0f-a0b3f265e301 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:36.478721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 62/132] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:36 2022] GET /identity/v3/role_assignments?user.id=affe7e43233541cbb293ef2ffa85e874&scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd&role.id=f8835028095e42448f0322ba8f1011e8 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:36.480014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71f827-d634-4768-8d0f-a0b3f265e301 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:36.522848 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3a714-7b60-4406-901b-124447d95d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:36.523418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3a714-7b60-4406-901b-124447d95d4b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:36.523705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3a714-7b60-4406-901b-124447d95d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:36.524013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3a714-7b60-4406-901b-124447d95d4b None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:36.524738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3a714-7b60-4406-901b-124447d95d4b None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:36.525043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3a714-7b60-4406-901b-124447d95d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:36.526531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3a714-7b60-4406-901b-124447d95d4b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:36.542699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 71/133] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:36.546905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e722f-389f-437e-8bc9-a947034f5a4f None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:36.550562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e722f-389f-437e-8bc9-a947034f5a4f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:36.552040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e722f-389f-437e-8bc9-a947034f5a4f None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:36.553774 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 72/134] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:36.554729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e722f-389f-437e-8bc9-a947034f5a4f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:36.570509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:36.617229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71f827-d634-4768-8d0f-a0b3f265e301 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:36.663439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143409f7-2e77-4c63-9c6f-1fb9c6f50c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:36.664579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143409f7-2e77-4c63-9c6f-1fb9c6f50c0f None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:36.665081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143409f7-2e77-4c63-9c6f-1fb9c6f50c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:36.665588 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143409f7-2e77-4c63-9c6f-1fb9c6f50c0f None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd/users/f1e2907aa13946e8a0176f034f6fb069/roles/84e73bacaaef4e4ab018e94824f9d891` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:36.674253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143409f7-2e77-4c63-9c6f-1fb9c6f50c0f None admin] RBAC: Authorizing `identity:create_grant(project_id=a5026856c5ec49ea9b8ef8af75a466dd, user_id=f1e2907aa13946e8a0176f034f6fb069, role_id=84e73bacaaef4e4ab018e94824f9d891)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:36.676288 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143409f7-2e77-4c63-9c6f-1fb9c6f50c0f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:36.678002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:36.694524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e722f-389f-437e-8bc9-a947034f5a4f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:36.716079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 63/135] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:20:36 2022] PUT /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd/users/f1e2907aa13946e8a0176f034f6fb069/roles/84e73bacaaef4e4ab018e94824f9d891 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:20:36.718325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c539df-0433-42b7-a7b6-db0c16f8ff10 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:36.721494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c539df-0433-42b7-a7b6-db0c16f8ff10 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:36.722080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c539df-0433-42b7-a7b6-db0c16f8ff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:36.762032 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a3c539df-0433-42b7-a7b6-db0c16f8ff10 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:36.763579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a3c539df-0433-42b7-a7b6-db0c16f8ff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:36.789816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b3bc3-e57a-4804-b052-32ccc8d21c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:36.790413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3bc3-e57a-4804-b052-32ccc8d21c0e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:36.791328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3bc3-e57a-4804-b052-32ccc8d21c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:36.791616 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3bc3-e57a-4804-b052-32ccc8d21c0e None admin] PATH_INFO: `/v3/users/f1e2907aa13946e8a0176f034f6fb069` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:36.794161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b3bc3-e57a-4804-b052-32ccc8d21c0e None admin] RBAC: Authorizing `identity:get_user(user_id=f1e2907aa13946e8a0176f034f6fb069)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:36.795657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b3bc3-e57a-4804-b052-32ccc8d21c0e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:36.801632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 73/136] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:36 2022] GET /identity/v3/users/f1e2907aa13946e8a0176f034f6fb069 => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:36.810307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b3bc3-e57a-4804-b052-32ccc8d21c0e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:36.927981 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 64/137] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:36.964110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c539df-0433-42b7-a7b6-db0c16f8ff10 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:37.037421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b3bc3-e57a-4804-b052-32ccc8d21c0e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:37.075097 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:37.083024 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0e806-c017-43d6-a24b-3b760f5bef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:37.083835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0e806-c017-43d6-a24b-3b760f5bef86 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:37.084160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0e806-c017-43d6-a24b-3b760f5bef86 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:37.084472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0e806-c017-43d6-a24b-3b760f5bef86 None admin] PATH_INFO: `/v3/projects/1b139189c3764032ba292267e750c713` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:37.085789 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0e806-c017-43d6-a24b-3b760f5bef86 None admin] RBAC: Authorizing `identity:get_project(project_id=1b139189c3764032ba292267e750c713)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:37.090110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0e806-c017-43d6-a24b-3b760f5bef86 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:37.093187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 74/138] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:36 2022] GET /identity/v3/projects/1b139189c3764032ba292267e750c713 => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:37.100983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0e806-c017-43d6-a24b-3b760f5bef86 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:37.164155 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:37.177406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c539df-0433-42b7-a7b6-db0c16f8ff10 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:37.274045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c51d6-5663-428b-b65a-77da8e126f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:37.274693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c51d6-5663-428b-b65a-77da8e126f45 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:37.274973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c51d6-5663-428b-b65a-77da8e126f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:37.275250 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c51d6-5663-428b-b65a-77da8e126f45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:37.300339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c51d6-5663-428b-b65a-77da8e126f45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-892c51d6-5663-428b-b65a-77da8e126f45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:37.305346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:37.306194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:37.306996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:37.306996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:37.306996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:37.306996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:37.306996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:37.306996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:37.306996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:37.306996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:37.306996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:37.306996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:37.306996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:37.306996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:37.306996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 65/139] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:37.318036 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c51d6-5663-428b-b65a-77da8e126f45 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:37.344783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0e806-c017-43d6-a24b-3b760f5bef86 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:37.419884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def18802-f194-44e1-8fe4-95d9fe9b21a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:37.420993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def18802-f194-44e1-8fe4-95d9fe9b21a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:37.421626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def18802-f194-44e1-8fe4-95d9fe9b21a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:37.422114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def18802-f194-44e1-8fe4-95d9fe9b21a7 None admin] PATH_INFO: `/v3/projects/1b139189c3764032ba292267e750c713/users/f1e2907aa13946e8a0176f034f6fb069/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:37.425334 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def18802-f194-44e1-8fe4-95d9fe9b21a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b139189c3764032ba292267e750c713, user_id=f1e2907aa13946e8a0176f034f6fb069, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:37.427403 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def18802-f194-44e1-8fe4-95d9fe9b21a7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:37.450251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 75/140] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:20:37 2022] PUT /identity/v3/projects/1b139189c3764032ba292267e750c713/users/f1e2907aa13946e8a0176f034f6fb069/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:20:37.454031 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61039e71-34da-4f40-b19b-83ff022abbde None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:37.456437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61039e71-34da-4f40-b19b-83ff022abbde None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:37.457553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61039e71-34da-4f40-b19b-83ff022abbde None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:37.460563 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 76/141] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:37.490030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57a26e-9aba-4622-a6da-c8783f12ac70 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:37.490732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57a26e-9aba-4622-a6da-c8783f12ac70 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:37.491276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57a26e-9aba-4622-a6da-c8783f12ac70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:37.524716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-af57a26e-9aba-4622-a6da-c8783f12ac70 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:37.530241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-af57a26e-9aba-4622-a6da-c8783f12ac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:37.559117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c51d6-5663-428b-b65a-77da8e126f45 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:37.582336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:37.607041 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f41fce-9691-4822-a3ee-f4356caaa04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:37.608286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f41fce-9691-4822-a3ee-f4356caaa04f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:37.608778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f41fce-9691-4822-a3ee-f4356caaa04f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:37.609253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f41fce-9691-4822-a3ee-f4356caaa04f None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:37.610214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f41fce-9691-4822-a3ee-f4356caaa04f None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:37.610753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f41fce-9691-4822-a3ee-f4356caaa04f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:37.613197 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f41fce-9691-4822-a3ee-f4356caaa04f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:37.624685 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 66/142] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:37.632820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f41fce-9691-4822-a3ee-f4356caaa04f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:37.696581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 77/143] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:37.779040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57a26e-9aba-4622-a6da-c8783f12ac70 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:37.825862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:37.829400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f41fce-9691-4822-a3ee-f4356caaa04f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:37.900069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d46ff7-1cf7-4dc1-8702-f357c2e86bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:37.901362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d46ff7-1cf7-4dc1-8702-f357c2e86bda None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:37.901693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d46ff7-1cf7-4dc1-8702-f357c2e86bda None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:37.901974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d46ff7-1cf7-4dc1-8702-f357c2e86bda None admin] PATH_INFO: `/v3/users/f1e2907aa13946e8a0176f034f6fb069` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:37.903805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d46ff7-1cf7-4dc1-8702-f357c2e86bda None admin] RBAC: Authorizing `identity:get_user(user_id=f1e2907aa13946e8a0176f034f6fb069)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:37.905289 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d46ff7-1cf7-4dc1-8702-f357c2e86bda None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:37.906894 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 67/144] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:37 2022] GET /identity/v3/users/f1e2907aa13946e8a0176f034f6fb069 => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:37.913184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d46ff7-1cf7-4dc1-8702-f357c2e86bda None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:37.971938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:38.018081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57a26e-9aba-4622-a6da-c8783f12ac70 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:38.048701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d46ff7-1cf7-4dc1-8702-f357c2e86bda None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:38.084582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249618a9-d984-49e6-8f01-3e05fcc036d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:38.085263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249618a9-d984-49e6-8f01-3e05fcc036d1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:38.085557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249618a9-d984-49e6-8f01-3e05fcc036d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:38.085841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249618a9-d984-49e6-8f01-3e05fcc036d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:38.087114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249618a9-d984-49e6-8f01-3e05fcc036d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:38.088649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249618a9-d984-49e6-8f01-3e05fcc036d1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:38.090570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 78/145] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:38.104848 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249618a9-d984-49e6-8f01-3e05fcc036d1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:38.109896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358309e9-e53f-4529-a41b-53fe9ec1d290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:38.110532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358309e9-e53f-4529-a41b-53fe9ec1d290 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:38.110818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358309e9-e53f-4529-a41b-53fe9ec1d290 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:38.111095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358309e9-e53f-4529-a41b-53fe9ec1d290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:38.228116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:38.234105 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358309e9-e53f-4529-a41b-53fe9ec1d290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:38.235813 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358309e9-e53f-4529-a41b-53fe9ec1d290 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:38.246030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249618a9-d984-49e6-8f01-3e05fcc036d1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:38.282974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0e896-e562-427e-a119-0104c3a48031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:38.283770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0e896-e562-427e-a119-0104c3a48031 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:38.284177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0e896-e562-427e-a119-0104c3a48031 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:38.284549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0e896-e562-427e-a119-0104c3a48031 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:38.287885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0e896-e562-427e-a119-0104c3a48031 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:38.287885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0e896-e562-427e-a119-0104c3a48031 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:38.318819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 79/146] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:20:38 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:20:38.323067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:38.396939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 68/147] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:38.403538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0e896-e562-427e-a119-0104c3a48031 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:38.526740 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0e896-e562-427e-a119-0104c3a48031 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:38.563549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3021de4-71da-4b38-88b7-521006508936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:38.564395 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021de4-71da-4b38-88b7-521006508936 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:38.564786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021de4-71da-4b38-88b7-521006508936 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:38.565165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021de4-71da-4b38-88b7-521006508936 None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:38.566502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3021de4-71da-4b38-88b7-521006508936 None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:38.568106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3021de4-71da-4b38-88b7-521006508936 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:38.570361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 80/148] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:38 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:38.576396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358309e9-e53f-4529-a41b-53fe9ec1d290 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:38.696216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358309e9-e53f-4529-a41b-53fe9ec1d290 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:38.737894 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae8d1d-34b1-43c8-b938-14cf8c281799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:38.738531 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae8d1d-34b1-43c8-b938-14cf8c281799 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:38.738823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae8d1d-34b1-43c8-b938-14cf8c281799 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:38.739104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae8d1d-34b1-43c8-b938-14cf8c281799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:38.740000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae8d1d-34b1-43c8-b938-14cf8c281799 None admin] RBAC: Adding query filter params (role.id=19570429b77848d998cb882f8b16aa76, scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd, user.id=f1e2907aa13946e8a0176f034f6fb069) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:38.740318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae8d1d-34b1-43c8-b938-14cf8c281799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:38.741806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae8d1d-34b1-43c8-b938-14cf8c281799 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:38.748962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 69/149] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:38 2022] GET /identity/v3/role_assignments?user.id=f1e2907aa13946e8a0176f034f6fb069&scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd&role.id=19570429b77848d998cb882f8b16aa76 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:39.100793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347bf06-66c9-409f-9d1d-88aa8060cc6d None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:39.101500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347bf06-66c9-409f-9d1d-88aa8060cc6d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:39.102047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347bf06-66c9-409f-9d1d-88aa8060cc6d None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:39.103807 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 81/150] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:39.110087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f1f3f-5217-44ec-bf37-07570017aec0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:39.110385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f1f3f-5217-44ec-bf37-07570017aec0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:39.110683 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f1f3f-5217-44ec-bf37-07570017aec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:39.136860 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-128f1f3f-5217-44ec-bf37-07570017aec0 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:39.138075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-128f1f3f-5217-44ec-bf37-07570017aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:39.146327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:39.219684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 70/151] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:39.249952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347bf06-66c9-409f-9d1d-88aa8060cc6d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:39.263681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:39.348814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c492e7-e16a-4e24-b787-eba7b24b7d02 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:39.349639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c492e7-e16a-4e24-b787-eba7b24b7d02 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:39.349860 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c492e7-e16a-4e24-b787-eba7b24b7d02 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:39.351692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 71/152] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:39.358417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72264395-c43b-48b1-a0a7-f71606762c33 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:39.358842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72264395-c43b-48b1-a0a7-f71606762c33 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:39.359233 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72264395-c43b-48b1-a0a7-f71606762c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:39.390034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-72264395-c43b-48b1-a0a7-f71606762c33 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:39.391588 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-72264395-c43b-48b1-a0a7-f71606762c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:39.398904 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347bf06-66c9-409f-9d1d-88aa8060cc6d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:39.444095 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f7307-13e1-4617-8aca-5e617bbfdab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:39.444853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f7307-13e1-4617-8aca-5e617bbfdab6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:39.445170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f7307-13e1-4617-8aca-5e617bbfdab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:39.445334 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f7307-13e1-4617-8aca-5e617bbfdab6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:39.458030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f7307-13e1-4617-8aca-5e617bbfdab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-3f0f7307-13e1-4617-8aca-5e617bbfdab6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:39.463814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:39.464690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:39.465864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:39.465864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:39.465864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:39.465864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:39.465864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:39.465864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:39.465864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:39.465864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:39.465864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:39.465864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:39.465864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:39.465864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:39.465864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 82/153] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:20:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:39.466744 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29d825-9b2a-4343-a1f7-5779be3fdefc None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:39.467408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29d825-9b2a-4343-a1f7-5779be3fdefc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:39.467408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29d825-9b2a-4343-a1f7-5779be3fdefc None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:39.468654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 83/154] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:39.473589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29d825-9b2a-4343-a1f7-5779be3fdefc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:39.496009 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 72/155] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:39.497185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200af2-b859-490f-b95b-469dae2cf8d6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:39.497477 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200af2-b859-490f-b95b-469dae2cf8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:39.497752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200af2-b859-490f-b95b-469dae2cf8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:39.527012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1a200af2-b859-490f-b95b-469dae2cf8d6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:39.528441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1a200af2-b859-490f-b95b-469dae2cf8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:39.546513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:39.583787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29d825-9b2a-4343-a1f7-5779be3fdefc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:39.620209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 73/156] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:39.620788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a200af2-b859-490f-b95b-469dae2cf8d6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:39.623086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:39.636801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db56a0-3aa3-4a10-b7da-abb52a285f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:39.637458 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db56a0-3aa3-4a10-b7da-abb52a285f37 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:39.637747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db56a0-3aa3-4a10-b7da-abb52a285f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:39.638030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db56a0-3aa3-4a10-b7da-abb52a285f37 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:39.638786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db56a0-3aa3-4a10-b7da-abb52a285f37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:39.639075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db56a0-3aa3-4a10-b7da-abb52a285f37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:39.640525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db56a0-3aa3-4a10-b7da-abb52a285f37 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:39.649713 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 84/157] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:39.658179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db56a0-3aa3-4a10-b7da-abb52a285f37 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:39.749445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a200af2-b859-490f-b95b-469dae2cf8d6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:39.769724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db56a0-3aa3-4a10-b7da-abb52a285f37 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:39.786320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0632e13-1eb1-4be1-9f66-9e586165da08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:39.787318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0632e13-1eb1-4be1-9f66-9e586165da08 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:39.787872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0632e13-1eb1-4be1-9f66-9e586165da08 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:39.788286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0632e13-1eb1-4be1-9f66-9e586165da08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:39.799574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:39.800097 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0632e13-1eb1-4be1-9f66-9e586165da08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:39.805533 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa0d45-958b-437e-be24-4a971dd01a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:39.806199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa0d45-958b-437e-be24-4a971dd01a52 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-c0632e13-1eb1-4be1-9f66-9e586165da08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:39.806895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:39.809209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:39.810223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:39.810223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:39.810223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:39.810223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:39.810223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:39.810223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:39.810223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:39.810223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:39.810223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:39.810223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:39.810223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:20:39.810223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:39.810949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa0d45-958b-437e-be24-4a971dd01a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:39.810949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa0d45-958b-437e-be24-4a971dd01a52 None admin] PATH_INFO: `/v3/users/fa3cd04e53bd44eeabd80a82ed088455` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:39.810949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa0d45-958b-437e-be24-4a971dd01a52 None admin] RBAC: Authorizing `identity:get_user(user_id=fa3cd04e53bd44eeabd80a82ed088455)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:39.811734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa0d45-958b-437e-be24-4a971dd01a52 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:39.812898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 74/158] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:20:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:39.813855 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0632e13-1eb1-4be1-9f66-9e586165da08 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:39.818851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 85/159] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:39 2022] GET /identity/v3/users/fa3cd04e53bd44eeabd80a82ed088455 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:39.820070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa0d45-958b-437e-be24-4a971dd01a52 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:39.892324 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:39.941688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0632e13-1eb1-4be1-9f66-9e586165da08 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:39.972043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa0d45-958b-437e-be24-4a971dd01a52 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:39.994671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16472520-120a-4c76-a715-2bb49568bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:39.995343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16472520-120a-4c76-a715-2bb49568bdad None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:39.995633 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16472520-120a-4c76-a715-2bb49568bdad None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:39.995942 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16472520-120a-4c76-a715-2bb49568bdad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:40.018744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16472520-120a-4c76-a715-2bb49568bdad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-16472520-120a-4c76-a715-2bb49568bdad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:40.023821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:40.024805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:40.026278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:40.026278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:40.026278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:40.026278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:40.026278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:40.026278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:40.026278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:40.026278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:40.026278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:40.026278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:40.026278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:40.026278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:40.026278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 75/160] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:40.026932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16472520-120a-4c76-a715-2bb49568bdad None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:40.038488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167eeba8-fa0b-4165-bf18-66e6517f562d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:40.039134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eeba8-fa0b-4165-bf18-66e6517f562d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:40.039423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eeba8-fa0b-4165-bf18-66e6517f562d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:40.039702 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eeba8-fa0b-4165-bf18-66e6517f562d None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:40.040462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167eeba8-fa0b-4165-bf18-66e6517f562d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:40.040901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167eeba8-fa0b-4165-bf18-66e6517f562d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:40.042537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167eeba8-fa0b-4165-bf18-66e6517f562d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:40.063592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 86/161] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:20:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:40.064795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167eeba8-fa0b-4165-bf18-66e6517f562d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:40.193871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:40.258037 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16472520-120a-4c76-a715-2bb49568bdad None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:40.281174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167eeba8-fa0b-4165-bf18-66e6517f562d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:40.316520 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:40.348707 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff550f1-6a28-44fe-acee-bcf069be1ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:40.349679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff550f1-6a28-44fe-acee-bcf069be1ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:40.349973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff550f1-6a28-44fe-acee-bcf069be1ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:40.350248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff550f1-6a28-44fe-acee-bcf069be1ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:40.350970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff550f1-6a28-44fe-acee-bcf069be1ef6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:40.351276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff550f1-6a28-44fe-acee-bcf069be1ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:40.352544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae2d2b-4d9b-43a1-98e1-1ad44dcae463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:40.353010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff550f1-6a28-44fe-acee-bcf069be1ef6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:40.353744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae2d2b-4d9b-43a1-98e1-1ad44dcae463 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:40.354042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae2d2b-4d9b-43a1-98e1-1ad44dcae463 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:40.354616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae2d2b-4d9b-43a1-98e1-1ad44dcae463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:40.378528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 87/162] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:40.379459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff550f1-6a28-44fe-acee-bcf069be1ef6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:40.474002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae2d2b-4d9b-43a1-98e1-1ad44dcae463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:40.475738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae2d2b-4d9b-43a1-98e1-1ad44dcae463 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:40.620297 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff550f1-6a28-44fe-acee-bcf069be1ef6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:40.660278 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:40.663925 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1291deb-1779-4626-903b-ed1c581cf809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:40.664587 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291deb-1779-4626-903b-ed1c581cf809 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:40.664876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291deb-1779-4626-903b-ed1c581cf809 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:40.665159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291deb-1779-4626-903b-ed1c581cf809 None admin] PATH_INFO: `/v3/users/f1e2907aa13946e8a0176f034f6fb069` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:40.668624 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1291deb-1779-4626-903b-ed1c581cf809 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e2907aa13946e8a0176f034f6fb069)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:40.670098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1291deb-1779-4626-903b-ed1c581cf809 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:40.671764 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 88/163] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:40 2022] GET /identity/v3/users/f1e2907aa13946e8a0176f034f6fb069 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:40.673519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1291deb-1779-4626-903b-ed1c581cf809 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:40.675611 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 76/164] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:40.676916 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5754d0d-5117-4edd-a648-cf88e18f030a None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:40.677210 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5754d0d-5117-4edd-a648-cf88e18f030a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:40.677612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5754d0d-5117-4edd-a648-cf88e18f030a None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:40.678999 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 77/165] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:40.679590 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5754d0d-5117-4edd-a648-cf88e18f030a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:40.714189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:40.847894 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5754d0d-5117-4edd-a648-cf88e18f030a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:40.873766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1291deb-1779-4626-903b-ed1c581cf809 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:40.909244 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a74e3-f0a3-4109-9304-195d7f945747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:40.909899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a74e3-f0a3-4109-9304-195d7f945747 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:40.910189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a74e3-f0a3-4109-9304-195d7f945747 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:40.910474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a74e3-f0a3-4109-9304-195d7f945747 None admin] PATH_INFO: `/v3/users/affe7e43233541cbb293ef2ffa85e874` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:40.911963 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a74e3-f0a3-4109-9304-195d7f945747 None admin] RBAC: Authorizing `identity:get_user(user_id=affe7e43233541cbb293ef2ffa85e874)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:40.913424 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a74e3-f0a3-4109-9304-195d7f945747 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:40.919712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 89/166] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:40 2022] GET /identity/v3/users/affe7e43233541cbb293ef2ffa85e874 => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:40.919712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df843c71-00b9-4103-9307-c422ccabd20e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:40.919712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df843c71-00b9-4103-9307-c422ccabd20e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:40.919712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df843c71-00b9-4103-9307-c422ccabd20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:40.935253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eefb99-799b-44d5-bce4-d43988725b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:40.935896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eefb99-799b-44d5-bce4-d43988725b4c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:40.943936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eefb99-799b-44d5-bce4-d43988725b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:40.944225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eefb99-799b-44d5-bce4-d43988725b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:40.953480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-df843c71-00b9-4103-9307-c422ccabd20e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:40.956538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-df843c71-00b9-4103-9307-c422ccabd20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:41.043891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:41.078038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 90/167] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:41.079649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df843c71-00b9-4103-9307-c422ccabd20e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:41.097829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eefb99-799b-44d5-bce4-d43988725b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:41.099725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eefb99-799b-44d5-bce4-d43988725b4c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:41.158496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:41.201683 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df843c71-00b9-4103-9307-c422ccabd20e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:41.238438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6f26e-13fa-4c8f-ac0d-0fe047e327e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:41.239358 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6f26e-13fa-4c8f-ac0d-0fe047e327e0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:41.239836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6f26e-13fa-4c8f-ac0d-0fe047e327e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:41.241356 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6f26e-13fa-4c8f-ac0d-0fe047e327e0 None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:41.244537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6f26e-13fa-4c8f-ac0d-0fe047e327e0 None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:41.247546 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6f26e-13fa-4c8f-ac0d-0fe047e327e0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:41.255986 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 91/168] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:41 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:41.263390 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6f26e-13fa-4c8f-ac0d-0fe047e327e0 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:41.310233 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 78/169] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:41.311445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eefb99-799b-44d5-bce4-d43988725b4c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:41.401101 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:41.466316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eefb99-799b-44d5-bce4-d43988725b4c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:41.488668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6f26e-13fa-4c8f-ac0d-0fe047e327e0 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:41.503799 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:41.518876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3caee-a01d-44a8-b943-57650175994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:41.519890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3caee-a01d-44a8-b943-57650175994a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:41.520422 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3caee-a01d-44a8-b943-57650175994a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:41.520892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3caee-a01d-44a8-b943-57650175994a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:41.532839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3caee-a01d-44a8-b943-57650175994a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-a6e3caee-a01d-44a8-b943-57650175994a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:41.538668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:41.539560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:41.540367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:41.540367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:41.540367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:41.540367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:41.540367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:41.540367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:41.540367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:41.540367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:41.540367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:41.540367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:41.540367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:41.540367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:41.543203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 79/170] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:41.544488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3caee-a01d-44a8-b943-57650175994a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:41.577816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b34fc-3fd5-4f99-b227-6f54dc6e4a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:41.578462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b34fc-3fd5-4f99-b227-6f54dc6e4a32 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:41.578742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b34fc-3fd5-4f99-b227-6f54dc6e4a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:41.579012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b34fc-3fd5-4f99-b227-6f54dc6e4a32 None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:41.580825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b34fc-3fd5-4f99-b227-6f54dc6e4a32 None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:41.582265 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b34fc-3fd5-4f99-b227-6f54dc6e4a32 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:41.585020 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 92/171] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:41 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:41.585799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b34fc-3fd5-4f99-b227-6f54dc6e4a32 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:41.728971 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3caee-a01d-44a8-b943-57650175994a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:41.772688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b34fc-3fd5-4f99-b227-6f54dc6e4a32 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:41.792923 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a31b7c-0efa-4229-9392-f6e5074e9d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:41.793552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a31b7c-0efa-4229-9392-f6e5074e9d04 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:41.793833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a31b7c-0efa-4229-9392-f6e5074e9d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:41.794104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a31b7c-0efa-4229-9392-f6e5074e9d04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:41.794893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a31b7c-0efa-4229-9392-f6e5074e9d04 None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd, user.id=fa3cd04e53bd44eeabd80a82ed088455) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:41.795205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a31b7c-0efa-4229-9392-f6e5074e9d04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:41.796669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a31b7c-0efa-4229-9392-f6e5074e9d04 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:41.805305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 80/172] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:41 2022] GET /identity/v3/role_assignments?user.id=fa3cd04e53bd44eeabd80a82ed088455&scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:41.806234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a31b7c-0efa-4229-9392-f6e5074e9d04 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:41.814115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:41.828535 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03292b0-9d2f-4903-80f8-f96df41481c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:41.829409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03292b0-9d2f-4903-80f8-f96df41481c5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:41.829800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03292b0-9d2f-4903-80f8-f96df41481c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:41.830181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03292b0-9d2f-4903-80f8-f96df41481c5 None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:41.835912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03292b0-9d2f-4903-80f8-f96df41481c5 None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:41.835912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03292b0-9d2f-4903-80f8-f96df41481c5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:41.835912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 93/173] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:41 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:41.836500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03292b0-9d2f-4903-80f8-f96df41481c5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:41.897176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:41.974366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03292b0-9d2f-4903-80f8-f96df41481c5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:42.007099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a31b7c-0efa-4229-9392-f6e5074e9d04 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:42.026834 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb6ef1-b407-44de-a5d9-acf763b9a9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:42.028133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb6ef1-b407-44de-a5d9-acf763b9a9b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.029018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb6ef1-b407-44de-a5d9-acf763b9a9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.029479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb6ef1-b407-44de-a5d9-acf763b9a9b9 None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd/users/affe7e43233541cbb293ef2ffa85e874/roles/f8835028095e42448f0322ba8f1011e8` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.032218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb6ef1-b407-44de-a5d9-acf763b9a9b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5026856c5ec49ea9b8ef8af75a466dd, user_id=affe7e43233541cbb293ef2ffa85e874, role_id=f8835028095e42448f0322ba8f1011e8)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:42.034387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb6ef1-b407-44de-a5d9-acf763b9a9b9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:42.048998 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f2cfd-6f81-4cca-9ea1-47ca243983e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:42.049780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f2cfd-6f81-4cca-9ea1-47ca243983e3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.050951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f2cfd-6f81-4cca-9ea1-47ca243983e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.051306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f2cfd-6f81-4cca-9ea1-47ca243983e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.052202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f2cfd-6f81-4cca-9ea1-47ca243983e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:42.052573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f2cfd-6f81-4cca-9ea1-47ca243983e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:42.053359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 94/174] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:20:41 2022] PUT /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd/users/affe7e43233541cbb293ef2ffa85e874/roles/f8835028095e42448f0322ba8f1011e8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:20:42.054206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f2cfd-6f81-4cca-9ea1-47ca243983e3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:42.055265 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e77545-54fa-4c87-b45f-6b78b3df45ce None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.055782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e77545-54fa-4c87-b45f-6b78b3df45ce None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.056850 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e77545-54fa-4c87-b45f-6b78b3df45ce None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.058487 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 95/175] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:42.059472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e77545-54fa-4c87-b45f-6b78b3df45ce None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:42.076487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 81/176] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:42.078044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ea61-a7b8-427f-9f51-bae5e9bcc987 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.078413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ea61-a7b8-427f-9f51-bae5e9bcc987 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.078756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ea61-a7b8-427f-9f51-bae5e9bcc987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.108959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e7f5ea61-a7b8-427f-9f51-bae5e9bcc987 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:42.110211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e7f5ea61-a7b8-427f-9f51-bae5e9bcc987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:42.173062 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:42.244065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 82/177] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:42.246299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5ea61-a7b8-427f-9f51-bae5e9bcc987 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:42.279967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e77545-54fa-4c87-b45f-6b78b3df45ce None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:42.307020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:42.322132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe343e-648d-428c-827b-a58a4c7f5adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:42.323080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe343e-648d-428c-827b-a58a4c7f5adf None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.323527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe343e-648d-428c-827b-a58a4c7f5adf None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.324004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe343e-648d-428c-827b-a58a4c7f5adf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.325001 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe343e-648d-428c-827b-a58a4c7f5adf None admin] RBAC: Adding query filter params (role.id=84e73bacaaef4e4ab018e94824f9d891, scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd, user.id=f1e2907aa13946e8a0176f034f6fb069) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:42.325453 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe343e-648d-428c-827b-a58a4c7f5adf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:42.327116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe343e-648d-428c-827b-a58a4c7f5adf None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:42.338196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 96/178] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:42 2022] GET /identity/v3/role_assignments?user.id=f1e2907aa13946e8a0176f034f6fb069&scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd&role.id=84e73bacaaef4e4ab018e94824f9d891 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:42.338196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277d846-fd46-4e65-9346-35ffec47a847 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.338196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277d846-fd46-4e65-9346-35ffec47a847 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.338196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277d846-fd46-4e65-9346-35ffec47a847 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.339712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 97/179] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:42.340228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277d846-fd46-4e65-9346-35ffec47a847 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:42.396800 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5ea61-a7b8-427f-9f51-bae5e9bcc987 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:42.444337 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efcadd-f6be-4be2-877b-2a5edd478121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:42.445432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efcadd-f6be-4be2-877b-2a5edd478121 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.445722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efcadd-f6be-4be2-877b-2a5edd478121 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.446283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efcadd-f6be-4be2-877b-2a5edd478121 None admin] PATH_INFO: `/v3/users/f1e2907aa13946e8a0176f034f6fb069` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.448325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efcadd-f6be-4be2-877b-2a5edd478121 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e2907aa13946e8a0176f034f6fb069)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:42.450155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efcadd-f6be-4be2-877b-2a5edd478121 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:42.452039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 83/180] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:42 2022] GET /identity/v3/users/f1e2907aa13946e8a0176f034f6fb069 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:42.453870 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c57435-1d6e-4cbb-896f-a18d9ceeca36 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.458964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c57435-1d6e-4cbb-896f-a18d9ceeca36 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.459258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c57435-1d6e-4cbb-896f-a18d9ceeca36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.470518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277d846-fd46-4e65-9346-35ffec47a847 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:42.481516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-83c57435-1d6e-4cbb-896f-a18d9ceeca36 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:42.483213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-83c57435-1d6e-4cbb-896f-a18d9ceeca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:42.489994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:42.516592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b13add-ca40-48cf-b159-0fe1051f709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:42.517265 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b13add-ca40-48cf-b159-0fe1051f709f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.517445 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b13add-ca40-48cf-b159-0fe1051f709f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.517723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b13add-ca40-48cf-b159-0fe1051f709f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.534667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b13add-ca40-48cf-b159-0fe1051f709f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-50b13add-ca40-48cf-b159-0fe1051f709f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:42.542053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:42.542999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:42.543812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:42.543812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:42.543812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:42.543812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:42.543812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:42.543812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:42.543812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:42.543812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:42.543812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:42.543812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:42.543812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:42.543812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:42.543812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 98/181] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:20:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:42.544512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4119f0a-d97d-4f78-a434-1f44624da618 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.545209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4119f0a-d97d-4f78-a434-1f44624da618 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.545209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4119f0a-d97d-4f78-a434-1f44624da618 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.546416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 99/182] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:42.546979 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4119f0a-d97d-4f78-a434-1f44624da618 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:42.577050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 84/183] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:42.577910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c57435-1d6e-4cbb-896f-a18d9ceeca36 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:42.626785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:42.677580 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4119f0a-d97d-4f78-a434-1f44624da618 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:42.704225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c57435-1d6e-4cbb-896f-a18d9ceeca36 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:42.713022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da069472-aa36-4c60-baf2-7b364a363a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:42.713654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da069472-aa36-4c60-baf2-7b364a363a23 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.713945 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da069472-aa36-4c60-baf2-7b364a363a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.714233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da069472-aa36-4c60-baf2-7b364a363a23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.741812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3e18-5616-4042-af6a-844698056851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:42.742760 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3e18-5616-4042-af6a-844698056851 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.743093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3e18-5616-4042-af6a-844698056851 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.744124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3e18-5616-4042-af6a-844698056851 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.744858 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3e18-5616-4042-af6a-844698056851 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:42.745169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3e18-5616-4042-af6a-844698056851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:42.746548 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3e18-5616-4042-af6a-844698056851 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:42.754769 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 85/184] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:42.759457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e4b58-509a-4e53-96c7-b71caaa16966 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.759457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e4b58-509a-4e53-96c7-b71caaa16966 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.759457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e4b58-509a-4e53-96c7-b71caaa16966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.775449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:42.776091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-882e4b58-509a-4e53-96c7-b71caaa16966 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:42.777437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-882e4b58-509a-4e53-96c7-b71caaa16966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:42.802417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da069472-aa36-4c60-baf2-7b364a363a23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:42.804027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da069472-aa36-4c60-baf2-7b364a363a23 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:42.849525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 86/185] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:42.850198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e4b58-509a-4e53-96c7-b71caaa16966 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:42.878219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:42.924842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 100/186] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:42.929903 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da069472-aa36-4c60-baf2-7b364a363a23 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:42.952905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e4b58-509a-4e53-96c7-b71caaa16966 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:42.996907 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c74044-af3e-4853-ba30-b670b1efb6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:42.997563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c74044-af3e-4853-ba30-b670b1efb6aa None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:42.997849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c74044-af3e-4853-ba30-b670b1efb6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:42.998132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c74044-af3e-4853-ba30-b670b1efb6aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:42.999289 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c74044-af3e-4853-ba30-b670b1efb6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:43.000759 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c74044-af3e-4853-ba30-b670b1efb6aa None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:43.003984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 87/187] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:43.003984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c74044-af3e-4853-ba30-b670b1efb6aa None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:43.015522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:43.039442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da069472-aa36-4c60-baf2-7b364a363a23 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:43.079748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616a023-598a-4f2e-b44f-2788b64948cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:43.080425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a023-598a-4f2e-b44f-2788b64948cc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:43.080711 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a023-598a-4f2e-b44f-2788b64948cc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:43.080995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a023-598a-4f2e-b44f-2788b64948cc None admin] PATH_INFO: `/v3/users/1bf5e32994d84c8ba6bfe34723a345e4` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:43.097156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616a023-598a-4f2e-b44f-2788b64948cc None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e32994d84c8ba6bfe34723a345e4)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:43.098646 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616a023-598a-4f2e-b44f-2788b64948cc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:43.106996 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 101/188] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:42 2022] GET /identity/v3/users/1bf5e32994d84c8ba6bfe34723a345e4 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:43.106996 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616a023-598a-4f2e-b44f-2788b64948cc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:43.122750 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:43.130461 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c74044-af3e-4853-ba30-b670b1efb6aa None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:43.167630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3583-98a2-4673-b081-10ef6d493df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:43.169133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3583-98a2-4673-b081-10ef6d493df6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:43.169492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3583-98a2-4673-b081-10ef6d493df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:43.169958 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3583-98a2-4673-b081-10ef6d493df6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:43.180356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e3583-98a2-4673-b081-10ef6d493df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d93e3583-98a2-4673-b081-10ef6d493df6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:43.186154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:43.187241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:43.188265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:43.188265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:43.188265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:43.188265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:43.188265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:43.188265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:43.188265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:43.188265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:43.188265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:43.188265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:43.188265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:20:43.188265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:43.189466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 88/189] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:20:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:43.190026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3583-98a2-4673-b081-10ef6d493df6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:43.219603 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616a023-598a-4f2e-b44f-2788b64948cc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:43.256540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ad060-43eb-473a-ae52-6c8e595bfb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:43.257184 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ad060-43eb-473a-ae52-6c8e595bfb10 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:43.257468 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ad060-43eb-473a-ae52-6c8e595bfb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:43.257742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ad060-43eb-473a-ae52-6c8e595bfb10 None admin] PATH_INFO: `/v3/projects/1b139189c3764032ba292267e750c713` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:43.258902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ad060-43eb-473a-ae52-6c8e595bfb10 None admin] RBAC: Authorizing `identity:get_project(project_id=1b139189c3764032ba292267e750c713)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:43.261023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ad060-43eb-473a-ae52-6c8e595bfb10 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:43.262705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 102/190] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:43 2022] GET /identity/v3/projects/1b139189c3764032ba292267e750c713 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:43.263466 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ad060-43eb-473a-ae52-6c8e595bfb10 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:43.269659 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:43.302802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3583-98a2-4673-b081-10ef6d493df6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:43.338456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488dae3-19e4-4fb0-96b9-da89891a5874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:43.339088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dae3-19e4-4fb0-96b9-da89891a5874 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:43.339374 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dae3-19e4-4fb0-96b9-da89891a5874 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:43.339655 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dae3-19e4-4fb0-96b9-da89891a5874 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:43.340391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488dae3-19e4-4fb0-96b9-da89891a5874 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:43.341837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488dae3-19e4-4fb0-96b9-da89891a5874 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:43.365833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 89/191] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:20:43 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:20:43.365833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488dae3-19e4-4fb0-96b9-da89891a5874 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:43.381614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ad060-43eb-473a-ae52-6c8e595bfb10 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:43.394896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:43.426726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d19e2-bca8-4c08-8aad-419ec2f6eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:43.427378 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d19e2-bca8-4c08-8aad-419ec2f6eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:43.427668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d19e2-bca8-4c08-8aad-419ec2f6eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:43.427981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d19e2-bca8-4c08-8aad-419ec2f6eaa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:43.519900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d19e2-bca8-4c08-8aad-419ec2f6eaa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:43.519900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d19e2-bca8-4c08-8aad-419ec2f6eaa6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:43.526417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488dae3-19e4-4fb0-96b9-da89891a5874 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:43.533151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:43.565752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73432b3-dbba-4303-9dbf-eb8a5455cf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:43.566198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73432b3-dbba-4303-9dbf-eb8a5455cf45 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:43.566487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73432b3-dbba-4303-9dbf-eb8a5455cf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:43.566769 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73432b3-dbba-4303-9dbf-eb8a5455cf45 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:43.567507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73432b3-dbba-4303-9dbf-eb8a5455cf45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:43.567818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73432b3-dbba-4303-9dbf-eb8a5455cf45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:43.569219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73432b3-dbba-4303-9dbf-eb8a5455cf45 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:43.581966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 90/192] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:20:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:43.582633 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73432b3-dbba-4303-9dbf-eb8a5455cf45 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:43.648771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 103/193] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:43.650133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d19e2-bca8-4c08-8aad-419ec2f6eaa6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:43.686486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:43.721251 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73432b3-dbba-4303-9dbf-eb8a5455cf45 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:43.765074 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951c487-4b7b-46c9-b0da-95998bca2e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:43.765703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951c487-4b7b-46c9-b0da-95998bca2e6c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:43.765985 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951c487-4b7b-46c9-b0da-95998bca2e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:43.766258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951c487-4b7b-46c9-b0da-95998bca2e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:43.767049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951c487-4b7b-46c9-b0da-95998bca2e6c None admin] RBAC: Adding query filter params (role.id=19570429b77848d998cb882f8b16aa76, scope.project.id=1b139189c3764032ba292267e750c713, user.id=f1e2907aa13946e8a0176f034f6fb069) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:43.767359 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951c487-4b7b-46c9-b0da-95998bca2e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:43.768917 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951c487-4b7b-46c9-b0da-95998bca2e6c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:43.776492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 91/194] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:43 2022] GET /identity/v3/role_assignments?user.id=f1e2907aa13946e8a0176f034f6fb069&scope.project.id=1b139189c3764032ba292267e750c713&role.id=19570429b77848d998cb882f8b16aa76 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:43.777505 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951c487-4b7b-46c9-b0da-95998bca2e6c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:43.793447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d19e2-bca8-4c08-8aad-419ec2f6eaa6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:43.795241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:43.838051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a68e4d-315b-4a2d-9e67-ff5ab3e9fc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:43.838753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a68e4d-315b-4a2d-9e67-ff5ab3e9fc4b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:43.839040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a68e4d-315b-4a2d-9e67-ff5ab3e9fc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:43.839316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a68e4d-315b-4a2d-9e67-ff5ab3e9fc4b None admin] PATH_INFO: `/v3/users/1bf5e32994d84c8ba6bfe34723a345e4` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:43.840576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a68e4d-315b-4a2d-9e67-ff5ab3e9fc4b None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e32994d84c8ba6bfe34723a345e4)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:43.842091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a68e4d-315b-4a2d-9e67-ff5ab3e9fc4b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:43.846395 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 104/195] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:43 2022] GET /identity/v3/users/1bf5e32994d84c8ba6bfe34723a345e4 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:43.852446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a68e4d-315b-4a2d-9e67-ff5ab3e9fc4b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:43.938221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951c487-4b7b-46c9-b0da-95998bca2e6c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:43.984714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a68e4d-315b-4a2d-9e67-ff5ab3e9fc4b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:44.006134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5bde7-d1bc-4695-9613-3d42d39eeab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:44.007135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5bde7-d1bc-4695-9613-3d42d39eeab6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:44.007618 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5bde7-d1bc-4695-9613-3d42d39eeab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:44.008312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5bde7-d1bc-4695-9613-3d42d39eeab6 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:44.010424 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5bde7-d1bc-4695-9613-3d42d39eeab6 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:44.015619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5bde7-d1bc-4695-9613-3d42d39eeab6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:44.017669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 92/196] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:43 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:44.023922 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5bde7-d1bc-4695-9613-3d42d39eeab6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:44.030432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069ccdf-8ad0-4a25-8d6f-5b1080c9f2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:44.031081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069ccdf-8ad0-4a25-8d6f-5b1080c9f2bd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:44.031369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069ccdf-8ad0-4a25-8d6f-5b1080c9f2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:44.031658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069ccdf-8ad0-4a25-8d6f-5b1080c9f2bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:44.035911 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:44.091019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:44.125479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069ccdf-8ad0-4a25-8d6f-5b1080c9f2bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:44.127300 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069ccdf-8ad0-4a25-8d6f-5b1080c9f2bd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:44.142002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5bde7-d1bc-4695-9613-3d42d39eeab6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:44.179697 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec1b79-2080-42b6-9cae-b07240b75a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:44.180600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1b79-2080-42b6-9cae-b07240b75a5a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:44.181093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1b79-2080-42b6-9cae-b07240b75a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:44.181544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1b79-2080-42b6-9cae-b07240b75a5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:44.182549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec1b79-2080-42b6-9cae-b07240b75a5a None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5, user.id=1bf5e32994d84c8ba6bfe34723a345e4) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:44.183053 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec1b79-2080-42b6-9cae-b07240b75a5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:44.184701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec1b79-2080-42b6-9cae-b07240b75a5a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:44.191099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 93/197] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:44 2022] GET /identity/v3/role_assignments?user.id=1bf5e32994d84c8ba6bfe34723a345e4&scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:44.258360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 105/198] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 16:20:44.265074 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec1b79-2080-42b6-9cae-b07240b75a5a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:44.345083 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:44.378805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec1b79-2080-42b6-9cae-b07240b75a5a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:44.419489 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0677d-2a11-41fb-8fbe-064febd5b569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:44.420572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0677d-2a11-41fb-8fbe-064febd5b569 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:44.421085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0677d-2a11-41fb-8fbe-064febd5b569 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:44.421564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0677d-2a11-41fb-8fbe-064febd5b569 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:44.428728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0677d-2a11-41fb-8fbe-064febd5b569 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:44.430585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0677d-2a11-41fb-8fbe-064febd5b569 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:44.433723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 94/199] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:44 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:44.440196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069ccdf-8ad0-4a25-8d6f-5b1080c9f2bd None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:44.477318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d594c-3bbd-4486-adc5-f4311a5edaa9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:44.478146 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d594c-3bbd-4486-adc5-f4311a5edaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:44.478440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d594c-3bbd-4486-adc5-f4311a5edaa9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:44.479971 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 95/200] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:44.498237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487c13b-2d9c-459b-8fb0-6deec11bf778 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:44.498834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487c13b-2d9c-459b-8fb0-6deec11bf778 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:44.499671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487c13b-2d9c-459b-8fb0-6deec11bf778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:44.523032 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e487c13b-2d9c-459b-8fb0-6deec11bf778 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:44.525684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e487c13b-2d9c-459b-8fb0-6deec11bf778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:44.536057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:44.572647 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069ccdf-8ad0-4a25-8d6f-5b1080c9f2bd None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:44.611220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e5352-74e1-4870-a502-253b39f9efd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:44.611824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e5352-74e1-4870-a502-253b39f9efd7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:44.612148 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e5352-74e1-4870-a502-253b39f9efd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:44.612436 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e5352-74e1-4870-a502-253b39f9efd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:44.613238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e5352-74e1-4870-a502-253b39f9efd7 None admin] RBAC: Adding query filter params (role.id=84e73bacaaef4e4ab018e94824f9d891, scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5, user.id=1bf5e32994d84c8ba6bfe34723a345e4) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:44.613557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e5352-74e1-4870-a502-253b39f9efd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:44.615013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e5352-74e1-4870-a502-253b39f9efd7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:44.621182 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 106/201] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:44 2022] GET /identity/v3/role_assignments?user.id=1bf5e32994d84c8ba6bfe34723a345e4&scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5&role.id=84e73bacaaef4e4ab018e94824f9d891 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:44.667623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 96/202] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:44.691007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e5352-74e1-4870-a502-253b39f9efd7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:44.803389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e5352-74e1-4870-a502-253b39f9efd7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:44.840400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b3117-0ec4-46d3-8e0e-aecdeca389ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:44.841116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b3117-0ec4-46d3-8e0e-aecdeca389ad None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:44.841407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b3117-0ec4-46d3-8e0e-aecdeca389ad None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:44.841736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b3117-0ec4-46d3-8e0e-aecdeca389ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:44.843717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:44.857432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b3117-0ec4-46d3-8e0e-aecdeca389ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-b06b3117-0ec4-46d3-8e0e-aecdeca389ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:44.863096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:44.864038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:44.864858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:44.864858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:44.864858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:44.864858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:44.864858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:44.864858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:44.864858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:44.864858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:44.864858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:44.864858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:44.864858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:44.864858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:44.868857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 107/203] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:44.871492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487c13b-2d9c-459b-8fb0-6deec11bf778 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:44.955176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:44.999445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487c13b-2d9c-459b-8fb0-6deec11bf778 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:45.037823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29968f-faf8-4f46-862a-cf21f9588130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:45.038456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29968f-faf8-4f46-862a-cf21f9588130 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:45.038740 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29968f-faf8-4f46-862a-cf21f9588130 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:45.039017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29968f-faf8-4f46-862a-cf21f9588130 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:45.039745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29968f-faf8-4f46-862a-cf21f9588130 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:45.040231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29968f-faf8-4f46-862a-cf21f9588130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:45.041757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29968f-faf8-4f46-862a-cf21f9588130 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:45.059226 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 97/204] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:45.064741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b3117-0ec4-46d3-8e0e-aecdeca389ad None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:45.185636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b3117-0ec4-46d3-8e0e-aecdeca389ad None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:45.220653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a0d3e-ee1d-435f-a6b2-a59932de53f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:45.221309 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a0d3e-ee1d-435f-a6b2-a59932de53f4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:45.221596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a0d3e-ee1d-435f-a6b2-a59932de53f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:45.221876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a0d3e-ee1d-435f-a6b2-a59932de53f4 None admin] PATH_INFO: `/v3/users/affe7e43233541cbb293ef2ffa85e874` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:45.223069 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a0d3e-ee1d-435f-a6b2-a59932de53f4 None admin] RBAC: Authorizing `identity:get_user(user_id=affe7e43233541cbb293ef2ffa85e874)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:45.224887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a0d3e-ee1d-435f-a6b2-a59932de53f4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:45.226880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 108/205] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:45 2022] GET /identity/v3/users/affe7e43233541cbb293ef2ffa85e874 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:45.232523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29968f-faf8-4f46-862a-cf21f9588130 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:45.382865 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29968f-faf8-4f46-862a-cf21f9588130 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:45.423311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:45.433458 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d2e80-64f3-402e-bde8-7f9213422c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:45.434092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d2e80-64f3-402e-bde8-7f9213422c9a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:45.434380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d2e80-64f3-402e-bde8-7f9213422c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:45.434659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d2e80-64f3-402e-bde8-7f9213422c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:45.537700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d2e80-64f3-402e-bde8-7f9213422c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:45.539178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d2e80-64f3-402e-bde8-7f9213422c9a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:45.664853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 98/206] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:45.671760 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a0d3e-ee1d-435f-a6b2-a59932de53f4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:45.764375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:45.806156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a0d3e-ee1d-435f-a6b2-a59932de53f4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:45.843095 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72b932-12a7-465e-a871-2ec2636e0bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:45.843751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b932-12a7-465e-a871-2ec2636e0bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:45.844069 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b932-12a7-465e-a871-2ec2636e0bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:45.844408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72b932-12a7-465e-a871-2ec2636e0bc5 None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:45.845648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72b932-12a7-465e-a871-2ec2636e0bc5 None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:45.847177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72b932-12a7-465e-a871-2ec2636e0bc5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:45.849473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 109/207] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:45 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:45.856092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d2e80-64f3-402e-bde8-7f9213422c9a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:45.917666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:46.023802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d2e80-64f3-402e-bde8-7f9213422c9a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:46.078932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2baaf-60d4-47f8-afd3-71d789d867d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:46.079230 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2baaf-60d4-47f8-afd3-71d789d867d6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:46.079504 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2baaf-60d4-47f8-afd3-71d789d867d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:46.079783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2baaf-60d4-47f8-afd3-71d789d867d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:46.080611 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2baaf-60d4-47f8-afd3-71d789d867d6 None admin] RBAC: Adding query filter params (role.id=f8835028095e42448f0322ba8f1011e8, scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd, user.id=affe7e43233541cbb293ef2ffa85e874) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:46.080920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2baaf-60d4-47f8-afd3-71d789d867d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:46.082365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2baaf-60d4-47f8-afd3-71d789d867d6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:46.092662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 99/208] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:45 2022] GET /identity/v3/role_assignments?user.id=affe7e43233541cbb293ef2ffa85e874&scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd&role.id=f8835028095e42448f0322ba8f1011e8 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:46.158373 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2b785-d11b-45d2-9bb0-84a13ed050e5 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:46.158688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2b785-d11b-45d2-9bb0-84a13ed050e5 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:46.158911 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2b785-d11b-45d2-9bb0-84a13ed050e5 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:46.160551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 110/209] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:46.166929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8391f2-8c69-479f-9d01-7c0ccee0f9ce None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:46.167215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8391f2-8c69-479f-9d01-7c0ccee0f9ce None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:46.167493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8391f2-8c69-479f-9d01-7c0ccee0f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:46.186163 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7f8391f2-8c69-479f-9d01-7c0ccee0f9ce None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:46.187474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7f8391f2-8c69-479f-9d01-7c0ccee0f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:46.301518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 100/210] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:46.335813 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2b785-d11b-45d2-9bb0-84a13ed050e5 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:46.410582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf75574-bf56-4e17-b60f-af1c3ca4ef4d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:46.410923 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf75574-bf56-4e17-b60f-af1c3ca4ef4d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:46.411151 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf75574-bf56-4e17-b60f-af1c3ca4ef4d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:46.417260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 101/211] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:46.419256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e254d-204a-4cb0-b2aa-1bc4c1df0eca None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:46.419770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e254d-204a-4cb0-b2aa-1bc4c1df0eca None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:46.420267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e254d-204a-4cb0-b2aa-1bc4c1df0eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:46.440335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e93e254d-204a-4cb0-b2aa-1bc4c1df0eca None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:46.441661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e93e254d-204a-4cb0-b2aa-1bc4c1df0eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:46.467302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:46.478514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2b785-d11b-45d2-9bb0-84a13ed050e5 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:46.523204 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:46.536188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3726b-5f89-4cea-8155-3e555f5526c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:46.537736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3726b-5f89-4cea-8155-3e555f5526c4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:46.538455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3726b-5f89-4cea-8155-3e555f5526c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:46.539143 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3726b-5f89-4cea-8155-3e555f5526c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:46.542327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 102/212] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:46.560468 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3726b-5f89-4cea-8155-3e555f5526c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-daf3726b-5f89-4cea-8155-3e555f5526c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:46.571838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:46.573540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:46.574942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:46.574942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:46.574942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:46.574942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:46.574942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:46.574942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:46.574942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:46.574942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:46.574942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:46.574942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:46.574942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:46.574942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:46.574942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 111/213] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:46.581939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e254d-204a-4cb0-b2aa-1bc4c1df0eca None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:46.588030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3726b-5f89-4cea-8155-3e555f5526c4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:46.734037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3726b-5f89-4cea-8155-3e555f5526c4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:46.734780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e254d-204a-4cb0-b2aa-1bc4c1df0eca None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:46.773509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5719c6-4fa2-42e5-8396-951beb15d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:46.774826 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5719c6-4fa2-42e5-8396-951beb15d08e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:46.775318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5719c6-4fa2-42e5-8396-951beb15d08e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:46.775834 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5719c6-4fa2-42e5-8396-951beb15d08e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:46.777247 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5719c6-4fa2-42e5-8396-951beb15d08e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:46.778978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5719c6-4fa2-42e5-8396-951beb15d08e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:46.780882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 112/214] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:46.781979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3180f-3df4-44aa-8710-8e06b8f8278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:46.782591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3180f-3df4-44aa-8710-8e06b8f8278a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:46.782881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3180f-3df4-44aa-8710-8e06b8f8278a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:46.783162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3180f-3df4-44aa-8710-8e06b8f8278a None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:46.789101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3180f-3df4-44aa-8710-8e06b8f8278a None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:46.789101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3180f-3df4-44aa-8710-8e06b8f8278a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:46.789101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3180f-3df4-44aa-8710-8e06b8f8278a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:46.789348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5719c6-4fa2-42e5-8396-951beb15d08e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:46.795946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 103/215] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:46.800481 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3180f-3df4-44aa-8710-8e06b8f8278a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:46.820171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:46.861088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:46.919242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5719c6-4fa2-42e5-8396-951beb15d08e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:46.928950 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3180f-3df4-44aa-8710-8e06b8f8278a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:46.964694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592b4c4-76f1-4e7f-a3e4-247ac72621cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:46.965595 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b4c4-76f1-4e7f-a3e4-247ac72621cd None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:46.966021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b4c4-76f1-4e7f-a3e4-247ac72621cd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:46.966291 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b565983-47d5-4781-a9fa-8eb3b32ac537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:46.966597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b4c4-76f1-4e7f-a3e4-247ac72621cd None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:46.967130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b565983-47d5-4781-a9fa-8eb3b32ac537 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:46.967516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b565983-47d5-4781-a9fa-8eb3b32ac537 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:46.967745 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592b4c4-76f1-4e7f-a3e4-247ac72621cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:46.968002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b565983-47d5-4781-a9fa-8eb3b32ac537 None admin] PATH_INFO: `/v3/users/23ecb050b324434182480bee2941149c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:46.969500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592b4c4-76f1-4e7f-a3e4-247ac72621cd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:46.988905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b565983-47d5-4781-a9fa-8eb3b32ac537 None admin] RBAC: Authorizing `identity:get_user(user_id=23ecb050b324434182480bee2941149c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:46.991172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b565983-47d5-4781-a9fa-8eb3b32ac537 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:46.993619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 104/216] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:46 2022] GET /identity/v3/users/23ecb050b324434182480bee2941149c => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:47.002736 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b565983-47d5-4781-a9fa-8eb3b32ac537 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:47.003236 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 113/217] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:20:46 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:20:47.016021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a24b-77d2-4848-b242-d009ef3d5cd4 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:47.016318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a24b-77d2-4848-b242-d009ef3d5cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:47.016605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a24b-77d2-4848-b242-d009ef3d5cd4 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:47.018314 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 114/218] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:20:47.023986 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6af5c6-d81b-4dae-8a27-cf7d2589c523 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:47.024348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6af5c6-d81b-4dae-8a27-cf7d2589c523 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:47.024639 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6af5c6-d81b-4dae-8a27-cf7d2589c523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:47.047664 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8a6af5c6-d81b-4dae-8a27-cf7d2589c523 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:47.048913 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8a6af5c6-d81b-4dae-8a27-cf7d2589c523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:47.103684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:47.144832 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b565983-47d5-4781-a9fa-8eb3b32ac537 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:47.163847 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 115/219] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:47.188705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6af5c6-d81b-4dae-8a27-cf7d2589c523 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:47.195647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c61a2c-9440-4707-8128-a6c5b75d0c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:47.197173 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c61a2c-9440-4707-8128-a6c5b75d0c65 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:47.197173 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c61a2c-9440-4707-8128-a6c5b75d0c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:47.197173 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c61a2c-9440-4707-8128-a6c5b75d0c65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:47.253693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:47.297600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c61a2c-9440-4707-8128-a6c5b75d0c65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:47.299474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c61a2c-9440-4707-8128-a6c5b75d0c65 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:47.346189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6af5c6-d81b-4dae-8a27-cf7d2589c523 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:47.395967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea0a6d-3620-434b-bfb8-abbd0a77c723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:47.395967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea0a6d-3620-434b-bfb8-abbd0a77c723 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:47.395967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea0a6d-3620-434b-bfb8-abbd0a77c723 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:47.395967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea0a6d-3620-434b-bfb8-abbd0a77c723 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:47.411885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea0a6d-3620-434b-bfb8-abbd0a77c723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:47.413128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-37ea0a6d-3620-434b-bfb8-abbd0a77c723 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:47.420857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:47.422425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:47.423241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:47.423241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:47.423241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:47.423241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:47.423241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:47.423241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:47.423241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:47.423241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:47.423241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:47.423241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:47.423241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:47.423241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:47.423241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 116/220] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:20:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:20:47.428978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17eebd-a5b9-42ce-a9d0-aa1533b2b82a None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:47.428978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17eebd-a5b9-42ce-a9d0-aa1533b2b82a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:47.428978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17eebd-a5b9-42ce-a9d0-aa1533b2b82a None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:47.428978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 117/221] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:47.432076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17eebd-a5b9-42ce-a9d0-aa1533b2b82a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:47.467741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 105/222] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:47.469058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0cb80-a713-4ec9-8c87-d4d7b8ff46a0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:47.469351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0cb80-a713-4ec9-8c87-d4d7b8ff46a0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:47.469630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0cb80-a713-4ec9-8c87-d4d7b8ff46a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:47.506709 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e8a0cb80-a713-4ec9-8c87-d4d7b8ff46a0 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:47.510551 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e8a0cb80-a713-4ec9-8c87-d4d7b8ff46a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:47.559304 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17eebd-a5b9-42ce-a9d0-aa1533b2b82a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:47.563287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:47.603383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a527292-826d-45d7-8d93-1fe6934224d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:47.607891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a527292-826d-45d7-8d93-1fe6934224d2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:47.607891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a527292-826d-45d7-8d93-1fe6934224d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:47.607891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a527292-826d-45d7-8d93-1fe6934224d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:47.607891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a527292-826d-45d7-8d93-1fe6934224d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:47.607891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a527292-826d-45d7-8d93-1fe6934224d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:47.607891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a527292-826d-45d7-8d93-1fe6934224d2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:47.617572 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 118/223] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:47.618667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a527292-826d-45d7-8d93-1fe6934224d2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:47.642191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 106/224] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:47.643899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0cb80-a713-4ec9-8c87-d4d7b8ff46a0 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:47.811517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a527292-826d-45d7-8d93-1fe6934224d2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:47.850978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0cb80-a713-4ec9-8c87-d4d7b8ff46a0 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:47.855572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:47.859881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3317fef-5686-403c-95e1-594d3f0983e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:47.859881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3317fef-5686-403c-95e1-594d3f0983e9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:47.859881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3317fef-5686-403c-95e1-594d3f0983e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:47.859881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3317fef-5686-403c-95e1-594d3f0983e9 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:47.863888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3317fef-5686-403c-95e1-594d3f0983e9 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:47.871885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3317fef-5686-403c-95e1-594d3f0983e9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:47.879884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 119/225] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:47 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:47.879884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3317fef-5686-403c-95e1-594d3f0983e9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:47.909694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33f100-55d3-4d1b-812e-bfd37da32d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:47.910758 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33f100-55d3-4d1b-812e-bfd37da32d67 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:47.910939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33f100-55d3-4d1b-812e-bfd37da32d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:47.911189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33f100-55d3-4d1b-812e-bfd37da32d67 None admin] PATH_INFO: `/v3/users/1bf5e32994d84c8ba6bfe34723a345e4` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:47.912482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33f100-55d3-4d1b-812e-bfd37da32d67 None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e32994d84c8ba6bfe34723a345e4)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:47.915501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33f100-55d3-4d1b-812e-bfd37da32d67 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:47.917680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 107/226] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:47 2022] GET /identity/v3/users/1bf5e32994d84c8ba6bfe34723a345e4 => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:47.918718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33f100-55d3-4d1b-812e-bfd37da32d67 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:47.941055 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:48.015357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3317fef-5686-403c-95e1-594d3f0983e9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:48.049974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ada079-cdbd-4ee1-903b-a48584c747de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:48.050632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ada079-cdbd-4ee1-903b-a48584c747de None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:48.050916 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ada079-cdbd-4ee1-903b-a48584c747de None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:48.051193 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ada079-cdbd-4ee1-903b-a48584c747de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:48.052392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33f100-55d3-4d1b-812e-bfd37da32d67 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:48.064057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ada079-cdbd-4ee1-903b-a48584c747de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-59ada079-cdbd-4ee1-903b-a48584c747de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:48.070686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:48.072725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:48.073522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:48.073522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:48.073522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:48.073522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:48.073522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:48.073522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:48.073522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:48.073522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:48.073522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:48.073522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:48.073522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:20:48.073522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:48.075786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 120/227] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:20:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:48.076916 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ada079-cdbd-4ee1-903b-a48584c747de None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:48.094473 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bfa78-6189-4e52-98c0-fbb8e38cee61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:48.095111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bfa78-6189-4e52-98c0-fbb8e38cee61 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:48.095399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bfa78-6189-4e52-98c0-fbb8e38cee61 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:48.095681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bfa78-6189-4e52-98c0-fbb8e38cee61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:48.096630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bfa78-6189-4e52-98c0-fbb8e38cee61 None admin] RBAC: Adding query filter params (role.id=19570429b77848d998cb882f8b16aa76, scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5, user.id=23ecb050b324434182480bee2941149c) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:48.096951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bfa78-6189-4e52-98c0-fbb8e38cee61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:48.098796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bfa78-6189-4e52-98c0-fbb8e38cee61 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:48.106225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 108/228] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:47 2022] GET /identity/v3/role_assignments?user.id=23ecb050b324434182480bee2941149c&scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5&role.id=19570429b77848d998cb882f8b16aa76 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:48.113324 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bfa78-6189-4e52-98c0-fbb8e38cee61 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:48.188537 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:48.194821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:48.204687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ada079-cdbd-4ee1-903b-a48584c747de None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:48.242478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64bf7b-9d5e-4ead-ad8d-2f1874fdfea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:48.244075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64bf7b-9d5e-4ead-ad8d-2f1874fdfea4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:48.244566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64bf7b-9d5e-4ead-ad8d-2f1874fdfea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:48.244982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64bf7b-9d5e-4ead-ad8d-2f1874fdfea4 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:48.246331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64bf7b-9d5e-4ead-ad8d-2f1874fdfea4 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:48.248123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64bf7b-9d5e-4ead-ad8d-2f1874fdfea4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:48.251462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 121/229] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:48 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:48.270569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64bf7b-9d5e-4ead-ad8d-2f1874fdfea4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:48.372299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bfa78-6189-4e52-98c0-fbb8e38cee61 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:48.451518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64bf7b-9d5e-4ead-ad8d-2f1874fdfea4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:48.452598 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b595b87-121b-4a36-bea7-22f65966fb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:48.453489 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b595b87-121b-4a36-bea7-22f65966fb62 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:48.453764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b595b87-121b-4a36-bea7-22f65966fb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:48.454056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b595b87-121b-4a36-bea7-22f65966fb62 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:48.455444 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b595b87-121b-4a36-bea7-22f65966fb62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:48.455444 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b595b87-121b-4a36-bea7-22f65966fb62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:48.456643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b595b87-121b-4a36-bea7-22f65966fb62 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:48.478937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 109/230] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:20:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:48.484447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b595b87-121b-4a36-bea7-22f65966fb62 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:48.490357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65764a4-2ba0-4824-b355-35582eb3bd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:48.491287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65764a4-2ba0-4824-b355-35582eb3bd50 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:48.491807 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65764a4-2ba0-4824-b355-35582eb3bd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:48.492255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65764a4-2ba0-4824-b355-35582eb3bd50 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5/users/1bf5e32994d84c8ba6bfe34723a345e4/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:48.494906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65764a4-2ba0-4824-b355-35582eb3bd50 None admin] RBAC: Authorizing `identity:create_grant(project_id=feb8ee130f7146d1b534f60a9a8a05c5, user_id=1bf5e32994d84c8ba6bfe34723a345e4, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:48.496711 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65764a4-2ba0-4824-b355-35582eb3bd50 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:48.520950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 122/231] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:20:48 2022] PUT /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5/users/1bf5e32994d84c8ba6bfe34723a345e4/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:20:48.663410 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:48.672644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b595b87-121b-4a36-bea7-22f65966fb62 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:48.715963 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72042-951f-458b-8b8d-0eee4c68acce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:48.716544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72042-951f-458b-8b8d-0eee4c68acce None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:48.716834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72042-951f-458b-8b8d-0eee4c68acce None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:48.717178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72042-951f-458b-8b8d-0eee4c68acce None admin] PATH_INFO: `/v3/users/1bf5e32994d84c8ba6bfe34723a345e4` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:48.718339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c72042-951f-458b-8b8d-0eee4c68acce None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e32994d84c8ba6bfe34723a345e4)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:48.719776 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c72042-951f-458b-8b8d-0eee4c68acce None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:48.723729 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 110/232] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:48 2022] GET /identity/v3/users/1bf5e32994d84c8ba6bfe34723a345e4 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:48.728064 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65764a4-2ba0-4824-b355-35582eb3bd50 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:48.759623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:48.843294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65764a4-2ba0-4824-b355-35582eb3bd50 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:48.883125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e576e-8958-471a-9715-4330a00adf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:48.884361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e576e-8958-471a-9715-4330a00adf1d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:48.884696 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e576e-8958-471a-9715-4330a00adf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:48.884887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e576e-8958-471a-9715-4330a00adf1d None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:48.886083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e576e-8958-471a-9715-4330a00adf1d None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:48.887744 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e576e-8958-471a-9715-4330a00adf1d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:48.889757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 123/233] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:48 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:48.895517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72042-951f-458b-8b8d-0eee4c68acce None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:49.016113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72042-951f-458b-8b8d-0eee4c68acce None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:49.052018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48378a4e-6456-4cac-87a4-0198cebb5e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:49.052751 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378a4e-6456-4cac-87a4-0198cebb5e54 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:49.053375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378a4e-6456-4cac-87a4-0198cebb5e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:49.053375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48378a4e-6456-4cac-87a4-0198cebb5e54 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5/users/1bf5e32994d84c8ba6bfe34723a345e4/roles/84e73bacaaef4e4ab018e94824f9d891` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:49.056479 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48378a4e-6456-4cac-87a4-0198cebb5e54 None admin] RBAC: Authorizing `identity:create_grant(project_id=feb8ee130f7146d1b534f60a9a8a05c5, user_id=1bf5e32994d84c8ba6bfe34723a345e4, role_id=84e73bacaaef4e4ab018e94824f9d891)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:49.058070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48378a4e-6456-4cac-87a4-0198cebb5e54 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:49.077745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 111/234] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:20:48 2022] PUT /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5/users/1bf5e32994d84c8ba6bfe34723a345e4/roles/84e73bacaaef4e4ab018e94824f9d891 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:20:49.491834 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc65f14-d671-4bbc-bda4-7d6a6eabea9d None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:49.492236 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc65f14-d671-4bbc-bda4-7d6a6eabea9d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:49.492459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc65f14-d671-4bbc-bda4-7d6a6eabea9d None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:49.494011 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 124/235] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:49.499341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e346d4-4abe-4ddc-a82e-2613b39c1546 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:49.499634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e346d4-4abe-4ddc-a82e-2613b39c1546 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:49.499954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e346d4-4abe-4ddc-a82e-2613b39c1546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:49.528871 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b9e346d4-4abe-4ddc-a82e-2613b39c1546 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:49.530458 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b9e346d4-4abe-4ddc-a82e-2613b39c1546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:49.563021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:49.631350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 112/236] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:49.665402 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc65f14-d671-4bbc-bda4-7d6a6eabea9d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:49.780129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:49.784990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc65f14-d671-4bbc-bda4-7d6a6eabea9d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:49.809611 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e2a5e-1b36-4aff-834a-bc36352b7a65 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:49.809894 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e2a5e-1b36-4aff-834a-bc36352b7a65 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:49.810169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e2a5e-1b36-4aff-834a-bc36352b7a65 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:49.811662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 113/237] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:20:49.825317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3333e-c6f2-45ee-88c3-f0154e62631e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:49.825599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3333e-c6f2-45ee-88c3-f0154e62631e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:49.825876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3333e-c6f2-45ee-88c3-f0154e62631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:49.842362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedbdbd-0633-4932-99b1-d37de6b8f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:49.843023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedbdbd-0633-4932-99b1-d37de6b8f904 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:49.843304 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedbdbd-0633-4932-99b1-d37de6b8f904 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:49.843581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedbdbd-0633-4932-99b1-d37de6b8f904 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:49.855998 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-21b3333e-c6f2-45ee-88c3-f0154e62631e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:49.858799 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-21b3333e-c6f2-45ee-88c3-f0154e62631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:49.865587 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedbdbd-0633-4932-99b1-d37de6b8f904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-2dedbdbd-0633-4932-99b1-d37de6b8f904 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:49.870570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:49.871438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:49.872414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:49.872414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:49.872414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:49.872414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:49.872414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:49.872414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:49.872414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:49.872414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:49.872414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:49.872414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:49.872414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:49.872414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:49.872414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 125/238] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:49.880671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedbdbd-0633-4932-99b1-d37de6b8f904 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:49.960583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 114/239] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:50.004869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3333e-c6f2-45ee-88c3-f0154e62631e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:50.076550 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedbdbd-0633-4932-99b1-d37de6b8f904 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:50.148222 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:50.149088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af635b3-9e2a-45ea-8707-cbb766967d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:50.149518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af635b3-9e2a-45ea-8707-cbb766967d08 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:50.149816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af635b3-9e2a-45ea-8707-cbb766967d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:50.150325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af635b3-9e2a-45ea-8707-cbb766967d08 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:50.150791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af635b3-9e2a-45ea-8707-cbb766967d08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:50.151091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af635b3-9e2a-45ea-8707-cbb766967d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:50.152560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af635b3-9e2a-45ea-8707-cbb766967d08 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:50.172890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 126/240] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:50.181319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3333e-c6f2-45ee-88c3-f0154e62631e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:50.193228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af635b3-9e2a-45ea-8707-cbb766967d08 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:50.229532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:50.231345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92a110-5e17-43ea-9b2b-ac96f37c0446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:50.232025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92a110-5e17-43ea-9b2b-ac96f37c0446 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:50.232308 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92a110-5e17-43ea-9b2b-ac96f37c0446 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:50.232951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92a110-5e17-43ea-9b2b-ac96f37c0446 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:50.234104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92a110-5e17-43ea-9b2b-ac96f37c0446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:50.235683 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92a110-5e17-43ea-9b2b-ac96f37c0446 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:50.237465 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 115/241] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:50.242919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92a110-5e17-43ea-9b2b-ac96f37c0446 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:50.408753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92a110-5e17-43ea-9b2b-ac96f37c0446 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:50.427884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af635b3-9e2a-45ea-8707-cbb766967d08 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:50.444456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea952c-b428-4149-a5fe-814d015126e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:50.445082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea952c-b428-4149-a5fe-814d015126e5 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:50.445390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea952c-b428-4149-a5fe-814d015126e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:50.446220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea952c-b428-4149-a5fe-814d015126e5 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:50.446910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea952c-b428-4149-a5fe-814d015126e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:50.448514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea952c-b428-4149-a5fe-814d015126e5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:50.471598 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 116/242] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:20:50 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:20:50.490257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef0501-0b30-41bb-994f-441264aa5c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:50.490910 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef0501-0b30-41bb-994f-441264aa5c7c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:50.491194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef0501-0b30-41bb-994f-441264aa5c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:50.491561 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef0501-0b30-41bb-994f-441264aa5c7c None admin] PATH_INFO: `/v3/users/b85b9d5a456745b98811ee90a1ebf3bd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:50.509803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef0501-0b30-41bb-994f-441264aa5c7c None admin] RBAC: Authorizing `identity:get_user(user_id=b85b9d5a456745b98811ee90a1ebf3bd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:50.511342 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef0501-0b30-41bb-994f-441264aa5c7c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:50.513704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 127/243] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:50 2022] GET /identity/v3/users/b85b9d5a456745b98811ee90a1ebf3bd => generated 297 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:50.521090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea952c-b428-4149-a5fe-814d015126e5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:50.543196 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:50.654028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea952c-b428-4149-a5fe-814d015126e5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:50.692376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8263b-39ab-451d-add5-71a2136bcae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:50.692936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8263b-39ab-451d-add5-71a2136bcae1 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:50.693274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8263b-39ab-451d-add5-71a2136bcae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:50.693552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8263b-39ab-451d-add5-71a2136bcae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:50.768583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8263b-39ab-451d-add5-71a2136bcae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:50.770183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8263b-39ab-451d-add5-71a2136bcae1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:50.782409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:50.857648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428cbd-bb36-4851-b594-eb955d9d523b None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:50.858043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428cbd-bb36-4851-b594-eb955d9d523b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:50.858371 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428cbd-bb36-4851-b594-eb955d9d523b None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:50.860954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 128/244] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:50.869409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bea67f-437c-47fb-95ed-01e83a99ea34 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:50.869949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bea67f-437c-47fb-95ed-01e83a99ea34 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:50.870418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bea67f-437c-47fb-95ed-01e83a99ea34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:50.889831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 117/245] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:50.891099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8263b-39ab-451d-add5-71a2136bcae1 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:50.892658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-36bea67f-437c-47fb-95ed-01e83a99ea34 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:50.894044 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-36bea67f-437c-47fb-95ed-01e83a99ea34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:50.961442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:50.966904 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 129/246] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:50.990826 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bea67f-437c-47fb-95ed-01e83a99ea34 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:51.000187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8263b-39ab-451d-add5-71a2136bcae1 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:51.013050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:51.041023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a11616-5553-476e-beba-71fe5864ba78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:51.041690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a11616-5553-476e-beba-71fe5864ba78 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:51.041975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a11616-5553-476e-beba-71fe5864ba78 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:51.042249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a11616-5553-476e-beba-71fe5864ba78 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:51.043839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a11616-5553-476e-beba-71fe5864ba78 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:51.045656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a11616-5553-476e-beba-71fe5864ba78 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:51.047666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 118/247] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:50 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:51.053587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a11616-5553-476e-beba-71fe5864ba78 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:51.114690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bea67f-437c-47fb-95ed-01e83a99ea34 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:51.154342 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457400d-bd37-4918-a43d-1cc7c5e956f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:51.155151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457400d-bd37-4918-a43d-1cc7c5e956f6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:51.155446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457400d-bd37-4918-a43d-1cc7c5e956f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:51.155747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457400d-bd37-4918-a43d-1cc7c5e956f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:51.161322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a11616-5553-476e-beba-71fe5864ba78 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:51.173558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457400d-bd37-4918-a43d-1cc7c5e956f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e457400d-bd37-4918-a43d-1cc7c5e956f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:51.180950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:51.182042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:51.183048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:51.183048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:51.183048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:51.183048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:51.183048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:51.183048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:51.183048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:51.183048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:51.183048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:51.183048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:51.183048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:51.183048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:51.185557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 130/248] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:51.187139 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d065442-baf9-44cc-acc5-20b5c4e6f7e8 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:51.187596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d065442-baf9-44cc-acc5-20b5c4e6f7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:51.188156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d065442-baf9-44cc-acc5-20b5c4e6f7e8 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:51.189685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 131/249] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:51.192267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d065442-baf9-44cc-acc5-20b5c4e6f7e8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:51.212355 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693b99d-ee49-4335-8d58-0c1c46b976c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:51.212355 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693b99d-ee49-4335-8d58-0c1c46b976c9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:51.212355 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693b99d-ee49-4335-8d58-0c1c46b976c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:51.212355 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693b99d-ee49-4335-8d58-0c1c46b976c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:51.213184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693b99d-ee49-4335-8d58-0c1c46b976c9 None admin] RBAC: Adding query filter params (role.id=f8835028095e42448f0322ba8f1011e8, scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5, user.id=b85b9d5a456745b98811ee90a1ebf3bd) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:51.213706 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693b99d-ee49-4335-8d58-0c1c46b976c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:51.215149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693b99d-ee49-4335-8d58-0c1c46b976c9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:51.222145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 119/250] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:51 2022] GET /identity/v3/role_assignments?user.id=b85b9d5a456745b98811ee90a1ebf3bd&scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5&role.id=f8835028095e42448f0322ba8f1011e8 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:51.223746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1518b4-cc69-4c2c-9c1e-b0d70c508b8d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:51.224305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1518b4-cc69-4c2c-9c1e-b0d70c508b8d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:51.224592 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1518b4-cc69-4c2c-9c1e-b0d70c508b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:51.248855 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-bd1518b4-cc69-4c2c-9c1e-b0d70c508b8d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:51.250104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bd1518b4-cc69-4c2c-9c1e-b0d70c508b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:51.276583 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:51.300366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:51.340763 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d065442-baf9-44cc-acc5-20b5c4e6f7e8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:51.345996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 120/251] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:51.377062 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1518b4-cc69-4c2c-9c1e-b0d70c508b8d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:51.387826 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08874845-767c-4cc4-808f-abd30a59da0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:51.388510 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08874845-767c-4cc4-808f-abd30a59da0a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:51.388800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08874845-767c-4cc4-808f-abd30a59da0a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:51.389085 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08874845-767c-4cc4-808f-abd30a59da0a None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:51.390021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08874845-767c-4cc4-808f-abd30a59da0a None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:51.390132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08874845-767c-4cc4-808f-abd30a59da0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:51.391563 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08874845-767c-4cc4-808f-abd30a59da0a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:51.401303 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 132/252] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:51.407041 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08874845-767c-4cc4-808f-abd30a59da0a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:51.507475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1518b4-cc69-4c2c-9c1e-b0d70c508b8d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:51.536669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08874845-767c-4cc4-808f-abd30a59da0a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:51.546650 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add67c42-6183-4082-b994-54f99419c394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:51.547665 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add67c42-6183-4082-b994-54f99419c394 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:51.548170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add67c42-6183-4082-b994-54f99419c394 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:51.548625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add67c42-6183-4082-b994-54f99419c394 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:51.560307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add67c42-6183-4082-b994-54f99419c394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:51.565548 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-add67c42-6183-4082-b994-54f99419c394 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:51.566315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:51.567194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:51.570093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:51.570093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:51.570093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:51.570093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:51.570093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:51.570093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:51.570093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:51.570093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:51.570093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:51.570093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:51.570093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:20:51.570093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:51.570093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 121/253] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:20:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:51.578978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add67c42-6183-4082-b994-54f99419c394 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:51.583457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cfa32-d968-4486-ba96-ecd6114e9fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:51.584405 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cfa32-d968-4486-ba96-ecd6114e9fdd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:51.584910 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cfa32-d968-4486-ba96-ecd6114e9fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:51.585437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cfa32-d968-4486-ba96-ecd6114e9fdd None admin] PATH_INFO: `/v3/users/23ecb050b324434182480bee2941149c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:51.587120 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cfa32-d968-4486-ba96-ecd6114e9fdd None admin] RBAC: Authorizing `identity:get_user(user_id=23ecb050b324434182480bee2941149c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:51.588824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cfa32-d968-4486-ba96-ecd6114e9fdd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:51.591035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 133/254] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:51 2022] GET /identity/v3/users/23ecb050b324434182480bee2941149c => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:51.596698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cfa32-d968-4486-ba96-ecd6114e9fdd None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:51.649450 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:51.827616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add67c42-6183-4082-b994-54f99419c394 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:51.857386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cfa32-d968-4486-ba96-ecd6114e9fdd None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:51.873546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fdff8-29e3-4f32-b7f2-e147a43f6c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:51.874515 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fdff8-29e3-4f32-b7f2-e147a43f6c47 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:51.874993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fdff8-29e3-4f32-b7f2-e147a43f6c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:51.875456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fdff8-29e3-4f32-b7f2-e147a43f6c47 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:51.876397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fdff8-29e3-4f32-b7f2-e147a43f6c47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:51.876927 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fdff8-29e3-4f32-b7f2-e147a43f6c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:51.878491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fdff8-29e3-4f32-b7f2-e147a43f6c47 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:51.896479 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 122/255] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:51.903827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855bc2a-d395-4723-8078-a12ce3dc43c1 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:51.903827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855bc2a-d395-4723-8078-a12ce3dc43c1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:51.903827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855bc2a-d395-4723-8078-a12ce3dc43c1 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:51.903827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 123/256] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:51.907616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855bc2a-d395-4723-8078-a12ce3dc43c1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:51.932350 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8741a-801e-4bab-89f8-689a9f386cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:51.933369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8741a-801e-4bab-89f8-689a9f386cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:51.934982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8741a-801e-4bab-89f8-689a9f386cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:51.937053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8741a-801e-4bab-89f8-689a9f386cb6 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:51.938520 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8741a-801e-4bab-89f8-689a9f386cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:51.941138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8741a-801e-4bab-89f8-689a9f386cb6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:51.944727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 134/257] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:51 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:51.948496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dddb9-3a4a-46f3-8b29-6e1a65990c9f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:51.952476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dddb9-3a4a-46f3-8b29-6e1a65990c9f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:51.952968 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dddb9-3a4a-46f3-8b29-6e1a65990c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:51.995412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-eb4dddb9-3a4a-46f3-8b29-6e1a65990c9f None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:51.998180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-eb4dddb9-3a4a-46f3-8b29-6e1a65990c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:52.063656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:52.074347 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855bc2a-d395-4723-8078-a12ce3dc43c1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:52.107304 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:52.129396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 135/258] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:52.130985 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dddb9-3a4a-46f3-8b29-6e1a65990c9f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:52.157960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358baf4-7067-45be-b2e9-2937b7b55e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:52.160342 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358baf4-7067-45be-b2e9-2937b7b55e8a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:52.160828 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358baf4-7067-45be-b2e9-2937b7b55e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:52.162247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358baf4-7067-45be-b2e9-2937b7b55e8a None admin] PATH_INFO: `/v3/users/1bf5e32994d84c8ba6bfe34723a345e4` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:52.166374 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358baf4-7067-45be-b2e9-2937b7b55e8a None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e32994d84c8ba6bfe34723a345e4)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:52.168072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358baf4-7067-45be-b2e9-2937b7b55e8a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:52.180326 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 124/259] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:51 2022] GET /identity/v3/users/1bf5e32994d84c8ba6bfe34723a345e4 => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:52.181442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358baf4-7067-45be-b2e9-2937b7b55e8a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:52.309374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dddb9-3a4a-46f3-8b29-6e1a65990c9f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:52.313344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358baf4-7067-45be-b2e9-2937b7b55e8a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:52.357164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3712152-f7d6-4a08-af8f-73e6356c04c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:52.359062 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3712152-f7d6-4a08-af8f-73e6356c04c4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:52.360457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3712152-f7d6-4a08-af8f-73e6356c04c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:52.361418 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3712152-f7d6-4a08-af8f-73e6356c04c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:52.365213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c618991-8133-44a3-af9e-1f95bca46d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:52.367218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c618991-8133-44a3-af9e-1f95bca46d23 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:52.368556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c618991-8133-44a3-af9e-1f95bca46d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:52.369010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c618991-8133-44a3-af9e-1f95bca46d23 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5/users/23ecb050b324434182480bee2941149c/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:52.373006 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c618991-8133-44a3-af9e-1f95bca46d23 None admin] RBAC: Authorizing `identity:create_grant(project_id=feb8ee130f7146d1b534f60a9a8a05c5, user_id=23ecb050b324434182480bee2941149c, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:52.375278 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c618991-8133-44a3-af9e-1f95bca46d23 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:52.384157 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3712152-f7d6-4a08-af8f-73e6356c04c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-a3712152-f7d6-4a08-af8f-73e6356c04c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:52.390501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:52.391390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:52.392286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:52.392286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:52.392286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:52.392286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:52.392286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:52.392286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:52.392286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:52.392286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:52.392286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:52.392286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:52.392286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:20:52.392286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:52.394671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 125/260] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:20:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:52.395582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3712152-f7d6-4a08-af8f-73e6356c04c4 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:52.419053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 136/261] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:20:52 2022] PUT /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5/users/23ecb050b324434182480bee2941149c/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:20:52.419741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c618991-8133-44a3-af9e-1f95bca46d23 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:52.444014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:52.564593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:52.599109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3712152-f7d6-4a08-af8f-73e6356c04c4 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:52.667085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c85873-69b1-4a99-8920-783866f3fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:52.668111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c85873-69b1-4a99-8920-783866f3fd5a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:52.668592 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c85873-69b1-4a99-8920-783866f3fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:52.669077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c85873-69b1-4a99-8920-783866f3fd5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:52.681195 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c618991-8133-44a3-af9e-1f95bca46d23 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:52.752664 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c85873-69b1-4a99-8920-783866f3fd5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:52.752851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9e291-0a1f-4fa2-abf6-acc336270724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:52.753504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9e291-0a1f-4fa2-abf6-acc336270724 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:52.753791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9e291-0a1f-4fa2-abf6-acc336270724 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:52.754067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9e291-0a1f-4fa2-abf6-acc336270724 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:52.754793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9e291-0a1f-4fa2-abf6-acc336270724 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:52.755154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9e291-0a1f-4fa2-abf6-acc336270724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:52.755605 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c85873-69b1-4a99-8920-783866f3fd5a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:52.756557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9e291-0a1f-4fa2-abf6-acc336270724 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:52.772719 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 137/262] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:20:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:52.779002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9e291-0a1f-4fa2-abf6-acc336270724 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:52.791883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:52.892310 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 126/263] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:52.898088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c85873-69b1-4a99-8920-783866f3fd5a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:52.965499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9e291-0a1f-4fa2-abf6-acc336270724 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:52.992264 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:53.021843 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c85873-69b1-4a99-8920-783866f3fd5a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:53.037179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c9055-eb31-4e59-aba3-e9ac42e199b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:53.037840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c9055-eb31-4e59-aba3-e9ac42e199b2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:53.038183 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c9055-eb31-4e59-aba3-e9ac42e199b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:53.038403 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c9055-eb31-4e59-aba3-e9ac42e199b2 None admin] PATH_INFO: `/v3/users/1bf5e32994d84c8ba6bfe34723a345e4` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:53.044705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c9055-eb31-4e59-aba3-e9ac42e199b2 None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e32994d84c8ba6bfe34723a345e4)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:53.046184 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c9055-eb31-4e59-aba3-e9ac42e199b2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:53.051886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:53.052022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 138/264] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:52 2022] GET /identity/v3/users/1bf5e32994d84c8ba6bfe34723a345e4 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:53.055881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c9055-eb31-4e59-aba3-e9ac42e199b2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:53.076609 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a501329-1fc5-48c3-a293-25018ca5a3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:53.077267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a501329-1fc5-48c3-a293-25018ca5a3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:53.077556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a501329-1fc5-48c3-a293-25018ca5a3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:53.077837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a501329-1fc5-48c3-a293-25018ca5a3a7 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:53.080526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a501329-1fc5-48c3-a293-25018ca5a3a7 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:53.081984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a501329-1fc5-48c3-a293-25018ca5a3a7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:53.083672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 127/265] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:52 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:53.090622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a501329-1fc5-48c3-a293-25018ca5a3a7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:53.291495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c9055-eb31-4e59-aba3-e9ac42e199b2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:53.311935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a501329-1fc5-48c3-a293-25018ca5a3a7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:53.328610 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737d441-524a-49b5-8f60-115565e173a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:53.329240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737d441-524a-49b5-8f60-115565e173a5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:53.329549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737d441-524a-49b5-8f60-115565e173a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:53.330294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737d441-524a-49b5-8f60-115565e173a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:53.371110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b90d8b-71f2-47f3-be39-9c667d4dc5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:53.371741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b90d8b-71f2-47f3-be39-9c667d4dc5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:53.372052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b90d8b-71f2-47f3-be39-9c667d4dc5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:53.372329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b90d8b-71f2-47f3-be39-9c667d4dc5a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:53.373129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b90d8b-71f2-47f3-be39-9c667d4dc5a8 None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5, user.id=1bf5e32994d84c8ba6bfe34723a345e4) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:53.373439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b90d8b-71f2-47f3-be39-9c667d4dc5a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:53.375116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b90d8b-71f2-47f3-be39-9c667d4dc5a8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:53.391325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 128/266] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:53 2022] GET /identity/v3/role_assignments?user.id=1bf5e32994d84c8ba6bfe34723a345e4&scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:53.408282 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:53.436006 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737d441-524a-49b5-8f60-115565e173a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:53.437420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737d441-524a-49b5-8f60-115565e173a5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:53.580077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 139/267] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:53.586422 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b90d8b-71f2-47f3-be39-9c667d4dc5a8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:53.679228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:53.754275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b90d8b-71f2-47f3-be39-9c667d4dc5a8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:53.801818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff892e-5930-4e88-8562-c9374e066405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:53.802837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff892e-5930-4e88-8562-c9374e066405 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:53.803315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff892e-5930-4e88-8562-c9374e066405 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:53.803783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff892e-5930-4e88-8562-c9374e066405 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:53.808585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff892e-5930-4e88-8562-c9374e066405 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:53.810280 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff892e-5930-4e88-8562-c9374e066405 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:53.812568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 129/268] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:53 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:53.818362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737d441-524a-49b5-8f60-115565e173a5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:53.912064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a9873-f9ff-4a18-b102-01e2bd7ee01e None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:53.912558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a9873-f9ff-4a18-b102-01e2bd7ee01e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:53.912988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a9873-f9ff-4a18-b102-01e2bd7ee01e None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:53.914937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 130/269] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:53.921139 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c987a97-7e6b-4225-9fb5-f785adf5c787 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:53.921494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c987a97-7e6b-4225-9fb5-f785adf5c787 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:53.921974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c987a97-7e6b-4225-9fb5-f785adf5c787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:53.931049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:53.954348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737d441-524a-49b5-8f60-115565e173a5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:53.961482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7c987a97-7e6b-4225-9fb5-f785adf5c787 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:53.962990 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7c987a97-7e6b-4225-9fb5-f785adf5c787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:54.011507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87281e47-d00c-4d6d-b890-d320c1da0061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.012456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281e47-d00c-4d6d-b890-d320c1da0061 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.012750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281e47-d00c-4d6d-b890-d320c1da0061 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.013029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281e47-d00c-4d6d-b890-d320c1da0061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.014249 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87281e47-d00c-4d6d-b890-d320c1da0061 None admin] RBAC: Adding query filter params (role.id=84e73bacaaef4e4ab018e94824f9d891, scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5, user.id=1bf5e32994d84c8ba6bfe34723a345e4) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:54.014564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87281e47-d00c-4d6d-b890-d320c1da0061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:54.016400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87281e47-d00c-4d6d-b890-d320c1da0061 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:54.028534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 140/270] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:53 2022] GET /identity/v3/role_assignments?user.id=1bf5e32994d84c8ba6bfe34723a345e4&scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5&role.id=84e73bacaaef4e4ab018e94824f9d891 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:54.030062 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f7db8-6e29-438c-a831-16fe4cb55570 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.030506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f7db8-6e29-438c-a831-16fe4cb55570 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.030912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f7db8-6e29-438c-a831-16fe4cb55570 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.036827 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 141/271] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:54.043593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668a1e-63aa-4429-b0fe-207c8fb8a556 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.043946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668a1e-63aa-4429-b0fe-207c8fb8a556 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.044176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668a1e-63aa-4429-b0fe-207c8fb8a556 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.045732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 142/272] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:20:54.050409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f707dd-0b20-48e0-817d-64c50fbe811f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.051007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f707dd-0b20-48e0-817d-64c50fbe811f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.051515 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f707dd-0b20-48e0-817d-64c50fbe811f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.077508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-35f707dd-0b20-48e0-817d-64c50fbe811f None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:54.078656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-35f707dd-0b20-48e0-817d-64c50fbe811f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:54.085262 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 131/273] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:54.088754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d87650-e776-4e0b-b76c-f31f236e4e22 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.089290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d87650-e776-4e0b-b76c-f31f236e4e22 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.089765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d87650-e776-4e0b-b76c-f31f236e4e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.112653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a9d87650-e776-4e0b-b76c-f31f236e4e22 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:54.113732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a9d87650-e776-4e0b-b76c-f31f236e4e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:54.173130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:54.193237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 143/274] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:54.200200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f707dd-0b20-48e0-817d-64c50fbe811f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.204138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 132/275] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:54.220962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d87650-e776-4e0b-b76c-f31f236e4e22 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.290562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:54.328927 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f707dd-0b20-48e0-817d-64c50fbe811f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:54.356854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d87650-e776-4e0b-b76c-f31f236e4e22 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:54.370070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79cd38-2a44-4437-864b-1d426aa169fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.370713 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79cd38-2a44-4437-864b-1d426aa169fc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.370995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79cd38-2a44-4437-864b-1d426aa169fc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.371265 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79cd38-2a44-4437-864b-1d426aa169fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.382367 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79cd38-2a44-4437-864b-1d426aa169fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-1b79cd38-2a44-4437-864b-1d426aa169fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:54.387810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:54.388729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:54.389530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:54.389530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:54.389530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:54.389530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:54.389530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:54.389530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:54.389530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:54.389530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:54.389530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:54.389530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:54.389530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:54.389530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:54.389530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 144/276] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:54.390189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79cd38-2a44-4437-864b-1d426aa169fc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.398199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f7e88-0903-4899-93e3-b54edb3845cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.398847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f7e88-0903-4899-93e3-b54edb3845cc None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.399123 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f7e88-0903-4899-93e3-b54edb3845cc None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.399394 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f7e88-0903-4899-93e3-b54edb3845cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.400610 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f7e88-0903-4899-93e3-b54edb3845cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:54.402446 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f7e88-0903-4899-93e3-b54edb3845cc None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:54.408875 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 133/277] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:54.408875 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f7e88-0903-4899-93e3-b54edb3845cc None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.462995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:54.497286 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79cd38-2a44-4437-864b-1d426aa169fc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:54.517593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f7e88-0903-4899-93e3-b54edb3845cc None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:54.532018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:54.537942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ad22b-228c-463b-949a-638092cd5c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.539113 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ad22b-228c-463b-949a-638092cd5c49 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.539397 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ad22b-228c-463b-949a-638092cd5c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.539973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ad22b-228c-463b-949a-638092cd5c49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.552261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f3ab9-cfb9-4d3c-8784-61e127d54356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.552695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ad22b-228c-463b-949a-638092cd5c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:54.552878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f3ab9-cfb9-4d3c-8784-61e127d54356 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.553436 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f3ab9-cfb9-4d3c-8784-61e127d54356 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.553714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f3ab9-cfb9-4d3c-8784-61e127d54356 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.554589 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f3ab9-cfb9-4d3c-8784-61e127d54356 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:54.554928 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f3ab9-cfb9-4d3c-8784-61e127d54356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:54.556308 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f3ab9-cfb9-4d3c-8784-61e127d54356 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e13ad22b-228c-463b-949a-638092cd5c49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:54.558732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:54.559598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:54.560731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:54.560731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:54.560731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:54.560731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:54.560731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:54.560731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:54.560731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:54.560731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:54.560731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:54.560731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:54.560731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:54.560731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:54.563994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 145/278] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:54.565018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ad22b-228c-463b-949a-638092cd5c49 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.572427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 134/279] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:54.572427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f3ab9-cfb9-4d3c-8784-61e127d54356 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.676813 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ad22b-228c-463b-949a-638092cd5c49 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:54.683333 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f3ab9-cfb9-4d3c-8784-61e127d54356 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:54.696679 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:54.714805 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d79500-14c0-4c98-9682-ef47cd66bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.715357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d79500-14c0-4c98-9682-ef47cd66bf62 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.715630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d79500-14c0-4c98-9682-ef47cd66bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.715920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d79500-14c0-4c98-9682-ef47cd66bf62 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.716603 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d79500-14c0-4c98-9682-ef47cd66bf62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:54.718043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d79500-14c0-4c98-9682-ef47cd66bf62 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:54.719072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1baf05-a4b2-49f0-9572-976b26bf5212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.719696 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1baf05-a4b2-49f0-9572-976b26bf5212 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.720016 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1baf05-a4b2-49f0-9572-976b26bf5212 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.720300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1baf05-a4b2-49f0-9572-976b26bf5212 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.721016 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1baf05-a4b2-49f0-9572-976b26bf5212 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:54.721328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1baf05-a4b2-49f0-9572-976b26bf5212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:54.722962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1baf05-a4b2-49f0-9572-976b26bf5212 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:54.731638 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 135/280] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:54.732504 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1baf05-a4b2-49f0-9572-976b26bf5212 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.743818 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 146/281] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:20:54 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:20:54.756273 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d79500-14c0-4c98-9682-ef47cd66bf62 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.826191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:54.862997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1baf05-a4b2-49f0-9572-976b26bf5212 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:54.888992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d79500-14c0-4c98-9682-ef47cd66bf62 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:54.901993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdb797-c0f5-4a15-adec-037faed6668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.902862 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdb797-c0f5-4a15-adec-037faed6668f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.902971 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdb797-c0f5-4a15-adec-037faed6668f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.903186 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdb797-c0f5-4a15-adec-037faed6668f None admin] PATH_INFO: `/v3/users/b85b9d5a456745b98811ee90a1ebf3bd` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.904478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdb797-c0f5-4a15-adec-037faed6668f None admin] RBAC: Authorizing `identity:get_user(user_id=b85b9d5a456745b98811ee90a1ebf3bd)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:54.906110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdb797-c0f5-4a15-adec-037faed6668f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:54.907927 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 136/282] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:54 2022] GET /identity/v3/users/b85b9d5a456745b98811ee90a1ebf3bd => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:54.913354 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdb797-c0f5-4a15-adec-037faed6668f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.931356 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a0823-584a-46ae-a4dc-d694c5d71d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:54.932371 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a0823-584a-46ae-a4dc-d694c5d71d03 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:54.932858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a0823-584a-46ae-a4dc-d694c5d71d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:54.933345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a0823-584a-46ae-a4dc-d694c5d71d03 None admin] PATH_INFO: `/v3/users/f210c75dc4ae48c79fd1c46192b368dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:54.949817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a0823-584a-46ae-a4dc-d694c5d71d03 None admin] RBAC: Authorizing `identity:get_user(user_id=f210c75dc4ae48c79fd1c46192b368dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:54.951378 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a0823-584a-46ae-a4dc-d694c5d71d03 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:54.959272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 147/283] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:54 2022] GET /identity/v3/users/f210c75dc4ae48c79fd1c46192b368dd => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:54.959272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a0823-584a-46ae-a4dc-d694c5d71d03 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:54.971242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:55.039070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdb797-c0f5-4a15-adec-037faed6668f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:55.072704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a0823-584a-46ae-a4dc-d694c5d71d03 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:55.080873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8e840-63b6-4462-8169-2d71aa616639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:55.081594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:55.081967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8e840-63b6-4462-8169-2d71aa616639 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:55.082252 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8e840-63b6-4462-8169-2d71aa616639 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:55.082530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8e840-63b6-4462-8169-2d71aa616639 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:55.084111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8e840-63b6-4462-8169-2d71aa616639 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:55.086615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8e840-63b6-4462-8169-2d71aa616639 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:55.088759 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 137/284] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:54 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:55.093102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e3787-ba8c-4967-9b6f-6d37d0235a9d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:55.093456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e3787-ba8c-4967-9b6f-6d37d0235a9d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:55.093889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e3787-ba8c-4967-9b6f-6d37d0235a9d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:55.095230 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 138/285] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:55.096169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e3787-ba8c-4967-9b6f-6d37d0235a9d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:55.126748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f622a-a2a7-4f39-a887-bcc8e50fe78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:55.127374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f622a-a2a7-4f39-a887-bcc8e50fe78c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:55.127653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f622a-a2a7-4f39-a887-bcc8e50fe78c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:55.127970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f622a-a2a7-4f39-a887-bcc8e50fe78c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:55.128816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f622a-a2a7-4f39-a887-bcc8e50fe78c None admin] RBAC: Adding query filter params (role.id=19570429b77848d998cb882f8b16aa76, user.id=f210c75dc4ae48c79fd1c46192b368dd, scope.system=all) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:55.129065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f622a-a2a7-4f39-a887-bcc8e50fe78c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:55.130566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f622a-a2a7-4f39-a887-bcc8e50fe78c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:55.135844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 148/286] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Jul 27 16:20:54 2022] GET /identity/v3/role_assignments?user.id=f210c75dc4ae48c79fd1c46192b368dd&scope.system=all&role.id=19570429b77848d998cb882f8b16aa76 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:55.137088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c903-a16f-4ee5-b648-8e28c58c84e9 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:55.137375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c903-a16f-4ee5-b648-8e28c58c84e9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:55.137649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c903-a16f-4ee5-b648-8e28c58c84e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:55.157796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a783c903-a16f-4ee5-b648-8e28c58c84e9 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:55.158984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a783c903-a16f-4ee5-b648-8e28c58c84e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:55.235238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 149/287] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:55.239378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e3787-ba8c-4967-9b6f-6d37d0235a9d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:55.252207 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:55.259144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783c903-a16f-4ee5-b648-8e28c58c84e9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:55.284241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef51328-c237-406b-8950-0a7c2ebd086a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:55.285568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef51328-c237-406b-8950-0a7c2ebd086a None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:55.286193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef51328-c237-406b-8950-0a7c2ebd086a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:55.286668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef51328-c237-406b-8950-0a7c2ebd086a None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5/users/b85b9d5a456745b98811ee90a1ebf3bd/roles/f8835028095e42448f0322ba8f1011e8` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:55.290932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef51328-c237-406b-8950-0a7c2ebd086a None admin] RBAC: Authorizing `identity:create_grant(project_id=feb8ee130f7146d1b534f60a9a8a05c5, user_id=b85b9d5a456745b98811ee90a1ebf3bd, role_id=f8835028095e42448f0322ba8f1011e8)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:55.293084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef51328-c237-406b-8950-0a7c2ebd086a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:55.329254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 139/288] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:20:55 2022] PUT /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5/users/b85b9d5a456745b98811ee90a1ebf3bd/roles/f8835028095e42448f0322ba8f1011e8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:20:55.385291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:55.389577 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783c903-a16f-4ee5-b648-8e28c58c84e9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:55.431193 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2bff6-d955-4ed5-a9de-f4166bc056db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:55.431884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2bff6-d955-4ed5-a9de-f4166bc056db None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:55.432185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2bff6-d955-4ed5-a9de-f4166bc056db None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:55.432470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2bff6-d955-4ed5-a9de-f4166bc056db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:55.445944 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2bff6-d955-4ed5-a9de-f4166bc056db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-f5a2bff6-d955-4ed5-a9de-f4166bc056db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:55.451623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:55.452661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:55.453474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:55.453474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:55.453474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:55.453474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:55.453474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:55.453474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:55.453474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:55.453474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:55.453474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:55.453474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:55.453474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:55.453474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:55.453474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 150/289] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:20:55.459668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef51328-c237-406b-8950-0a7c2ebd086a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:55.603703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef51328-c237-406b-8950-0a7c2ebd086a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:55.642510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974d80f-f76f-46f4-8fed-109a3ff91432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:55.643603 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d80f-f76f-46f4-8fed-109a3ff91432 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:55.644137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d80f-f76f-46f4-8fed-109a3ff91432 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:55.644618 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974d80f-f76f-46f4-8fed-109a3ff91432 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:55.645549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974d80f-f76f-46f4-8fed-109a3ff91432 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:55.646058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974d80f-f76f-46f4-8fed-109a3ff91432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:55.647651 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974d80f-f76f-46f4-8fed-109a3ff91432 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:55.658313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 140/290] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:55.662784 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2bff6-d955-4ed5-a9de-f4166bc056db None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:55.826117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2bff6-d955-4ed5-a9de-f4166bc056db None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:55.867434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c54a0-c196-4ed6-b352-492a27831cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:55.868034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c54a0-c196-4ed6-b352-492a27831cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:55.868322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c54a0-c196-4ed6-b352-492a27831cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:55.868603 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c54a0-c196-4ed6-b352-492a27831cd0 None admin] PATH_INFO: `/v3/users/23ecb050b324434182480bee2941149c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:55.869809 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c54a0-c196-4ed6-b352-492a27831cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=23ecb050b324434182480bee2941149c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:55.871260 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c54a0-c196-4ed6-b352-492a27831cd0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:55.872912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 151/291] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:55 2022] GET /identity/v3/users/23ecb050b324434182480bee2941149c => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:55.878681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974d80f-f76f-46f4-8fed-109a3ff91432 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:55.912069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:55.984876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974d80f-f76f-46f4-8fed-109a3ff91432 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:56.020205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302df13-a4af-4cd0-b2f8-770b53f69db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:56.020837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302df13-a4af-4cd0-b2f8-770b53f69db9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:56.021121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302df13-a4af-4cd0-b2f8-770b53f69db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:56.021395 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302df13-a4af-4cd0-b2f8-770b53f69db9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:56.091890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302df13-a4af-4cd0-b2f8-770b53f69db9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:56.093476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302df13-a4af-4cd0-b2f8-770b53f69db9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:56.128541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:56.208991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c54a0-c196-4ed6-b352-492a27831cd0 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:56.210028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 141/292] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:56.266522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:56.358903 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c54a0-c196-4ed6-b352-492a27831cd0 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:56.394002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fa661-3c86-48b7-a0fb-f8cb2f560113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:56.394626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fa661-3c86-48b7-a0fb-f8cb2f560113 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:56.394837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fa661-3c86-48b7-a0fb-f8cb2f560113 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:56.395099 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fa661-3c86-48b7-a0fb-f8cb2f560113 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:56.396314 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fa661-3c86-48b7-a0fb-f8cb2f560113 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:56.397803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fa661-3c86-48b7-a0fb-f8cb2f560113 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:56.399570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 152/293] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:56 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:56.405744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302df13-a4af-4cd0-b2f8-770b53f69db9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:56.513649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302df13-a4af-4cd0-b2f8-770b53f69db9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:56.544103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:56.556191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5c843-1a44-4e08-9b16-f179037aeb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:56.557308 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5c843-1a44-4e08-9b16-f179037aeb1d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:56.557987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5c843-1a44-4e08-9b16-f179037aeb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:56.558522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5c843-1a44-4e08-9b16-f179037aeb1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:56.559686 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5c843-1a44-4e08-9b16-f179037aeb1d None admin] RBAC: Adding query filter params (role.id=19570429b77848d998cb882f8b16aa76, scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5, user.id=23ecb050b324434182480bee2941149c) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:56.560035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5c843-1a44-4e08-9b16-f179037aeb1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:56.561465 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5c843-1a44-4e08-9b16-f179037aeb1d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:56.567728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 142/294] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:56 2022] GET /identity/v3/role_assignments?user.id=23ecb050b324434182480bee2941149c&scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5&role.id=19570429b77848d998cb882f8b16aa76 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:57.296261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a1d57-06af-43da-92c9-e9eaef71d543 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:57.296641 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a1d57-06af-43da-92c9-e9eaef71d543 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:57.296856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a1d57-06af-43da-92c9-e9eaef71d543 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:57.298467 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 153/295] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:57.303752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1657-d597-4e08-81f8-361d005309bd None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:57.304115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1657-d597-4e08-81f8-361d005309bd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:57.304396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1657-d597-4e08-81f8-361d005309bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:57.313576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc643729-3516-499d-9733-4e81b3a6e138 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:57.313869 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc643729-3516-499d-9733-4e81b3a6e138 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:57.314150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc643729-3516-499d-9733-4e81b3a6e138 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:57.315742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 154/296] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:20:57.322172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c52a-e799-479d-a665-ba6d5b7de8a0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:57.322454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c52a-e799-479d-a665-ba6d5b7de8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:57.322741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c52a-e799-479d-a665-ba6d5b7de8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:57.329732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-fbfb1657-d597-4e08-81f8-361d005309bd None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:57.331152 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fbfb1657-d597-4e08-81f8-361d005309bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:57.344682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-78d7c52a-e799-479d-a665-ba6d5b7de8a0 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:57.346035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-78d7c52a-e799-479d-a665-ba6d5b7de8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:57.403302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 143/297] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:57.426311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb1657-d597-4e08-81f8-361d005309bd None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:57.427418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 155/298] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:57.451899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7c52a-e799-479d-a665-ba6d5b7de8a0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:57.484311 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:57.534326 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb1657-d597-4e08-81f8-361d005309bd None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:57.558593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7c52a-e799-479d-a665-ba6d5b7de8a0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:57.561922 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:57.571236 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecd5d6-3ffc-4b8b-95f0-dbbe0d6022d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:57.572062 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd5d6-3ffc-4b8b-95f0-dbbe0d6022d1 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:57.572555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd5d6-3ffc-4b8b-95f0-dbbe0d6022d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:57.573011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd5d6-3ffc-4b8b-95f0-dbbe0d6022d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:57.574573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecd5d6-3ffc-4b8b-95f0-dbbe0d6022d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:57.576223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecd5d6-3ffc-4b8b-95f0-dbbe0d6022d1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:57.577976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 144/299] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:57.583979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecd5d6-3ffc-4b8b-95f0-dbbe0d6022d1 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:57.597885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7a7c0-a8d0-4726-a751-afbd4b9be126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:57.598542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7a7c0-a8d0-4726-a751-afbd4b9be126 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:57.598825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7a7c0-a8d0-4726-a751-afbd4b9be126 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:57.599102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7a7c0-a8d0-4726-a751-afbd4b9be126 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:57.610927 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7a7c0-a8d0-4726-a751-afbd4b9be126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-f0d7a7c0-a8d0-4726-a751-afbd4b9be126 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:57.617053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:57.618188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:57.618995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:57.618995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:57.618995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:57.618995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:57.618995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:57.618995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:57.618995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:57.618995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:57.618995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:57.618995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:57.618995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:57.618995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:57.623159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 156/300] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:20:57.624185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7a7c0-a8d0-4726-a751-afbd4b9be126 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:57.690131 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecd5d6-3ffc-4b8b-95f0-dbbe0d6022d1 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:57.719120 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:57.727508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9d474-d592-48b2-9b1c-61abb4283a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:57.728330 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9d474-d592-48b2-9b1c-61abb4283a03 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:57.728621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9d474-d592-48b2-9b1c-61abb4283a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:57.728898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9d474-d592-48b2-9b1c-61abb4283a03 None admin] PATH_INFO: `/v3/groups` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:57.729569 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9d474-d592-48b2-9b1c-61abb4283a03 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:57.731256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9d474-d592-48b2-9b1c-61abb4283a03 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:57.736003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7a7c0-a8d0-4726-a751-afbd4b9be126 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:57.752013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 145/301] 10.222.0.67 () {60 vars in 1134 bytes} [Wed Jul 27 16:20:57 2022] POST /identity/v3/groups => generated 229 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:20:57.753358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f711aa-e388-42a6-b76c-6182ba4bf6f4 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:57.753647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f711aa-e388-42a6-b76c-6182ba4bf6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:57.753934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f711aa-e388-42a6-b76c-6182ba4bf6f4 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:57.755504 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 146/302] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:57.762234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15ecd-79c8-4949-8be8-690c11095742 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:57.762879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15ecd-79c8-4949-8be8-690c11095742 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:57.763364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15ecd-79c8-4949-8be8-690c11095742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:57.781224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c86074-2afb-4ef3-8c7b-76b58bf2ede6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:57.781871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c86074-2afb-4ef3-8c7b-76b58bf2ede6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:57.782209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c86074-2afb-4ef3-8c7b-76b58bf2ede6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:57.782540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c86074-2afb-4ef3-8c7b-76b58bf2ede6 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:57.783288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c86074-2afb-4ef3-8c7b-76b58bf2ede6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:57.783597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c86074-2afb-4ef3-8c7b-76b58bf2ede6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:57.785140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c86074-2afb-4ef3-8c7b-76b58bf2ede6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:57.786856 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-50e15ecd-79c8-4949-8be8-690c11095742 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:57.788536 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-50e15ecd-79c8-4949-8be8-690c11095742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:57.799753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 157/303] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:57.800768 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c86074-2afb-4ef3-8c7b-76b58bf2ede6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:57.854458 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:57.880407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 147/304] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:20:57.904811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e15ecd-79c8-4949-8be8-690c11095742 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:57.933608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c86074-2afb-4ef3-8c7b-76b58bf2ede6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:57.976074 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea47eb-6dab-47b4-8bd1-49af5fe69b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:57.976866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea47eb-6dab-47b4-8bd1-49af5fe69b33 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:57.977160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea47eb-6dab-47b4-8bd1-49af5fe69b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:57.977440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea47eb-6dab-47b4-8bd1-49af5fe69b33 None admin] PATH_INFO: `/v3/users/c5bd337b3ace49fa97ffd898fb50dd30` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:57.992968 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea47eb-6dab-47b4-8bd1-49af5fe69b33 None admin] RBAC: Authorizing `identity:get_user(user_id=c5bd337b3ace49fa97ffd898fb50dd30)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:57.994448 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea47eb-6dab-47b4-8bd1-49af5fe69b33 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:57.996513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 158/305] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:57 2022] GET /identity/v3/users/c5bd337b3ace49fa97ffd898fb50dd30 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:58.000483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9399b77-4f38-45a0-9e6e-5d14b394f185 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:58.000483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9399b77-4f38-45a0-9e6e-5d14b394f185 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:58.000483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9399b77-4f38-45a0-9e6e-5d14b394f185 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:58.000483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 159/306] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:58.003993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9399b77-4f38-45a0-9e6e-5d14b394f185 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:58.014986 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:58.024008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e15ecd-79c8-4949-8be8-690c11095742 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:58.059623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacbbad-459a-4392-9676-6bcb041dc9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:58.060299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacbbad-459a-4392-9676-6bcb041dc9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:58.060585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacbbad-459a-4392-9676-6bcb041dc9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:58.060865 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacbbad-459a-4392-9676-6bcb041dc9f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:58.072974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacbbad-459a-4392-9676-6bcb041dc9f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-fcacbbad-459a-4392-9676-6bcb041dc9f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:58.077939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:58.078854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:58.079658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:58.079658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:58.079658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:58.079658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:58.079658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:58.079658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:58.079658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:58.079658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:58.079658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:58.079658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:58.079658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:20:58.079658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:20:58.079658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 148/307] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:20:58.081002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449bb2a-c651-47af-8d38-1f9823537ed0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:58.081069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449bb2a-c651-47af-8d38-1f9823537ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:58.081318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449bb2a-c651-47af-8d38-1f9823537ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:58.100416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c449bb2a-c651-47af-8d38-1f9823537ed0 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:58.101727 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c449bb2a-c651-47af-8d38-1f9823537ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:58.132567 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9399b77-4f38-45a0-9e6e-5d14b394f185 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:58.143681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:58.169504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5bacc-bd4b-4c44-97ec-156baf6356f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:58.170123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5bacc-bd4b-4c44-97ec-156baf6356f1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:58.170406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5bacc-bd4b-4c44-97ec-156baf6356f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:58.170682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5bacc-bd4b-4c44-97ec-156baf6356f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:58.171462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5bacc-bd4b-4c44-97ec-156baf6356f1 None admin] RBAC: Adding query filter params (role.id=f8835028095e42448f0322ba8f1011e8, user.id=c5bd337b3ace49fa97ffd898fb50dd30, scope.system=all) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:58.171773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5bacc-bd4b-4c44-97ec-156baf6356f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:58.176062 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 149/308] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:58.176062 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449bb2a-c651-47af-8d38-1f9823537ed0 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:58.176255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5bacc-bd4b-4c44-97ec-156baf6356f1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:58.179909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 160/309] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Jul 27 16:20:58 2022] GET /identity/v3/role_assignments?user.id=c5bd337b3ace49fa97ffd898fb50dd30&scope.system=all&role.id=f8835028095e42448f0322ba8f1011e8 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:58.197687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5bacc-bd4b-4c44-97ec-156baf6356f1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:58.305626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:58.317707 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449bb2a-c651-47af-8d38-1f9823537ed0 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:58.344997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5bacc-bd4b-4c44-97ec-156baf6356f1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:58.369026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfacc4d-c389-4ffe-87aa-bb7cd622a5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:58.369666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfacc4d-c389-4ffe-87aa-bb7cd622a5aa None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:58.369953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfacc4d-c389-4ffe-87aa-bb7cd622a5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:58.370233 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfacc4d-c389-4ffe-87aa-bb7cd622a5aa None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:58.370960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfacc4d-c389-4ffe-87aa-bb7cd622a5aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:58.371269 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfacc4d-c389-4ffe-87aa-bb7cd622a5aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:58.373199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfacc4d-c389-4ffe-87aa-bb7cd622a5aa None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:58.385559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 150/310] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:58.390424 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eed6a6-0ca6-478e-8f44-61f4e66a1e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:58.390705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed6a6-0ca6-478e-8f44-61f4e66a1e11 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:58.390994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed6a6-0ca6-478e-8f44-61f4e66a1e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:58.391269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed6a6-0ca6-478e-8f44-61f4e66a1e11 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:58.392586 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfacc4d-c389-4ffe-87aa-bb7cd622a5aa None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:58.406695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eed6a6-0ca6-478e-8f44-61f4e66a1e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-34eed6a6-0ca6-478e-8f44-61f4e66a1e11 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:20:58.414082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:20:58.415002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:20:58.415800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:20:58.415800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:20:58.415800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:20:58.415800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:20:58.415800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:20:58.415800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:20:58.415800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:20:58.415800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:20:58.415800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:20:58.415800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:20:58.415800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:20:58.415800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:20:58.419951 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 161/311] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:20:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:20:58.422387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eed6a6-0ca6-478e-8f44-61f4e66a1e11 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:58.442193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:58.518759 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfacc4d-c389-4ffe-87aa-bb7cd622a5aa None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:58.554769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eed6a6-0ca6-478e-8f44-61f4e66a1e11 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:58.557010 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e06517-9d43-43dc-abac-e4a0a0522c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:58.558254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e06517-9d43-43dc-abac-e4a0a0522c18 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:58.558740 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e06517-9d43-43dc-abac-e4a0a0522c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:58.559256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e06517-9d43-43dc-abac-e4a0a0522c18 None admin] PATH_INFO: `/v3/users/f210c75dc4ae48c79fd1c46192b368dd` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:58.560808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e06517-9d43-43dc-abac-e4a0a0522c18 None admin] RBAC: Authorizing `identity:get_user(user_id=f210c75dc4ae48c79fd1c46192b368dd)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:58.562440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e06517-9d43-43dc-abac-e4a0a0522c18 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:58.569267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 151/312] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:58 2022] GET /identity/v3/users/f210c75dc4ae48c79fd1c46192b368dd => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:58.570631 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e06517-9d43-43dc-abac-e4a0a0522c18 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:58.589810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:58.598817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1a24-90d4-4d71-abbf-549971640439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:58.599475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1a24-90d4-4d71-abbf-549971640439 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:58.599997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1a24-90d4-4d71-abbf-549971640439 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:58.601924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1a24-90d4-4d71-abbf-549971640439 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:58.602863 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b1a24-90d4-4d71-abbf-549971640439 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:58.603392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b1a24-90d4-4d71-abbf-549971640439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:58.605061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b1a24-90d4-4d71-abbf-549971640439 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:58.614489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 162/313] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:20:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:58.620272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1a24-90d4-4d71-abbf-549971640439 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:58.704239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e06517-9d43-43dc-abac-e4a0a0522c18 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:58.707054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:58.733205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1a24-90d4-4d71-abbf-549971640439 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:58.752050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f5a3-bbd5-4f4c-9031-655aa32fa3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:58.753022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f5a3-bbd5-4f4c-9031-655aa32fa3c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:58.753548 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f5a3-bbd5-4f4c-9031-655aa32fa3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:58.754045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f5a3-bbd5-4f4c-9031-655aa32fa3c1 None admin] PATH_INFO: `/v3/system/users/f210c75dc4ae48c79fd1c46192b368dd/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:58.756032 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8f5a3-bbd5-4f4c-9031-655aa32fa3c1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f210c75dc4ae48c79fd1c46192b368dd, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:58.757890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8f5a3-bbd5-4f4c-9031-655aa32fa3c1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:58.775951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 152/314] 10.222.0.67 () {58 vars in 1334 bytes} [Wed Jul 27 16:20:58 2022] PUT /identity/v3/system/users/f210c75dc4ae48c79fd1c46192b368dd/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:20:58.781326 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e91528-3b08-4f54-afba-e3839df0fc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:58.782040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e91528-3b08-4f54-afba-e3839df0fc93 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:58.782331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e91528-3b08-4f54-afba-e3839df0fc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:58.782608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e91528-3b08-4f54-afba-e3839df0fc93 None admin] PATH_INFO: `/v3/users/b85b9d5a456745b98811ee90a1ebf3bd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:58.783848 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e91528-3b08-4f54-afba-e3839df0fc93 None admin] RBAC: Authorizing `identity:get_user(user_id=b85b9d5a456745b98811ee90a1ebf3bd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:58.785409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e91528-3b08-4f54-afba-e3839df0fc93 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:58.787515 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 163/315] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:20:58 2022] GET /identity/v3/users/b85b9d5a456745b98811ee90a1ebf3bd => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:20:58.793511 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f5a3-bbd5-4f4c-9031-655aa32fa3c1 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:58.913869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f5a3-bbd5-4f4c-9031-655aa32fa3c1 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:58.952714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0b602-75a6-4a54-b62e-c0969bd2b65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:58.953340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0b602-75a6-4a54-b62e-c0969bd2b65d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:58.953625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0b602-75a6-4a54-b62e-c0969bd2b65d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:58.953931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0b602-75a6-4a54-b62e-c0969bd2b65d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:58.990532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:59.027319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0b602-75a6-4a54-b62e-c0969bd2b65d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:59.028827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0b602-75a6-4a54-b62e-c0969bd2b65d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:59.133212 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 153/316] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:20:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:20:59.138589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e91528-3b08-4f54-afba-e3839df0fc93 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:59.202362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:59.250787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e91528-3b08-4f54-afba-e3839df0fc93 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:59.287933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e27ff3-619d-4add-b0bc-c84f3797b653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:59.289113 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e27ff3-619d-4add-b0bc-c84f3797b653 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:59.289606 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e27ff3-619d-4add-b0bc-c84f3797b653 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:59.290112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e27ff3-619d-4add-b0bc-c84f3797b653 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:59.291503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e27ff3-619d-4add-b0bc-c84f3797b653 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:59.293216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e27ff3-619d-4add-b0bc-c84f3797b653 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:59.295423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 164/317] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:20:59 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:59.305262 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0b602-75a6-4a54-b62e-c0969bd2b65d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:20:59.380300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:20:59.417856 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0b602-75a6-4a54-b62e-c0969bd2b65d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:20:59.454298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c047a-c433-4b1b-9cb1-1a35b29bec95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:20:59.455348 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c047a-c433-4b1b-9cb1-1a35b29bec95 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:59.455838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c047a-c433-4b1b-9cb1-1a35b29bec95 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:59.456339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c047a-c433-4b1b-9cb1-1a35b29bec95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:59.457345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c047a-c433-4b1b-9cb1-1a35b29bec95 None admin] RBAC: Adding query filter params (role.id=f8835028095e42448f0322ba8f1011e8, scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5, user.id=b85b9d5a456745b98811ee90a1ebf3bd) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:20:59.457858 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c047a-c433-4b1b-9cb1-1a35b29bec95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:20:59.459473 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c047a-c433-4b1b-9cb1-1a35b29bec95 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:20:59.466365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 154/318] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:20:59 2022] GET /identity/v3/role_assignments?user.id=b85b9d5a456745b98811ee90a1ebf3bd&scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5&role.id=f8835028095e42448f0322ba8f1011e8 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:20:59.831730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781d02-9a4e-41c1-9ed5-28fbbc2ac0d9 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:59.832284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781d02-9a4e-41c1-9ed5-28fbbc2ac0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:59.832284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781d02-9a4e-41c1-9ed5-28fbbc2ac0d9 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:59.833688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 165/319] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:20:59.838798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba21f36-1e2c-4fc0-a5ba-959048c5bc74 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:20:59.839206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba21f36-1e2c-4fc0-a5ba-959048c5bc74 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:20:59.839367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba21f36-1e2c-4fc0-a5ba-959048c5bc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:20:59.858458 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0ba21f36-1e2c-4fc0-a5ba-959048c5bc74 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:20:59.859626 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0ba21f36-1e2c-4fc0-a5ba-959048c5bc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:20:59.928406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 155/320] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:20:59.950741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8781d02-9a4e-41c1-9ed5-28fbbc2ac0d9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:00.057134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8781d02-9a4e-41c1-9ed5-28fbbc2ac0d9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:00.082484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:00.092547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0c720-3961-455f-a3c5-866b57231bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:00.093270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0c720-3961-455f-a3c5-866b57231bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:00.093617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0c720-3961-455f-a3c5-866b57231bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:00.093954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0c720-3961-455f-a3c5-866b57231bb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:00.095148 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0c720-3961-455f-a3c5-866b57231bb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:00.096671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0c720-3961-455f-a3c5-866b57231bb7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:00.098791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 166/321] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:20:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:00.104789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba21f36-1e2c-4fc0-a5ba-959048c5bc74 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:00.164706 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:00.204180 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba21f36-1e2c-4fc0-a5ba-959048c5bc74 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:00.236253 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c1ae-f1bd-4bf5-8de5-6828fe1c1e67 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:00.236674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c1ae-f1bd-4bf5-8de5-6828fe1c1e67 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:00.237022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c1ae-f1bd-4bf5-8de5-6828fe1c1e67 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:00.238052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf0f5f-c6fa-4b99-9c01-de91f0c94293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:00.238546 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 167/322] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:00.238770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf0f5f-c6fa-4b99-9c01-de91f0c94293 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:00.239028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf0f5f-c6fa-4b99-9c01-de91f0c94293 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:00.239303 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf0f5f-c6fa-4b99-9c01-de91f0c94293 None admin] PATH_INFO: `/v3/groups` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:00.240002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf0f5f-c6fa-4b99-9c01-de91f0c94293 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:00.241988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf0f5f-c6fa-4b99-9c01-de91f0c94293 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:00.244819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f1ee1-4d75-4b83-908e-59bf78ce50e7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:00.245205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f1ee1-4d75-4b83-908e-59bf78ce50e7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:00.245588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f1ee1-4d75-4b83-908e-59bf78ce50e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:00.258560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 156/323] 10.222.0.67 () {60 vars in 1134 bytes} [Wed Jul 27 16:21:00 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:21:00.267331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5d1f1ee1-4d75-4b83-908e-59bf78ce50e7 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:00.268765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5d1f1ee1-4d75-4b83-908e-59bf78ce50e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:00.348028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 168/324] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:21:00.368608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf0f5f-c6fa-4b99-9c01-de91f0c94293 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:00.477441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf0f5f-c6fa-4b99-9c01-de91f0c94293 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:00.504624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:00.518476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5f6fe-e6d2-4233-a5b0-fb051c46adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:00.519130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5f6fe-e6d2-4233-a5b0-fb051c46adfe None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:00.519421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5f6fe-e6d2-4233-a5b0-fb051c46adfe None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:00.519703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5f6fe-e6d2-4233-a5b0-fb051c46adfe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:00.530246 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5f6fe-e6d2-4233-a5b0-fb051c46adfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-9bf5f6fe-e6d2-4233-a5b0-fb051c46adfe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:00.535788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:00.536722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:00.538700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:00.538700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:00.538700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:00.538700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:00.538700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:00.538700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:00.538700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:00.538700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:00.538700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:00.538700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:00.538700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:21:00.538700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:00.538700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 157/325] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:00.543718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f1ee1-4d75-4b83-908e-59bf78ce50e7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:00.653611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f1ee1-4d75-4b83-908e-59bf78ce50e7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:00.680984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:00.692086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e30651-32b6-480c-b197-1c6281d1fef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:00.692719 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e30651-32b6-480c-b197-1c6281d1fef7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:00.693009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e30651-32b6-480c-b197-1c6281d1fef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:00.693296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e30651-32b6-480c-b197-1c6281d1fef7 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:00.694679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e30651-32b6-480c-b197-1c6281d1fef7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:00.695035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e30651-32b6-480c-b197-1c6281d1fef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:00.696679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e30651-32b6-480c-b197-1c6281d1fef7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:00.705949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 169/326] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:21:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:00.711797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5f6fe-e6d2-4233-a5b0-fb051c46adfe None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:00.827965 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5f6fe-e6d2-4233-a5b0-fb051c46adfe None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:00.864234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010760e-ebbd-4a5d-b4cd-113176c49898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:00.865672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010760e-ebbd-4a5d-b4cd-113176c49898 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:00.866735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010760e-ebbd-4a5d-b4cd-113176c49898 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:00.867223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010760e-ebbd-4a5d-b4cd-113176c49898 None admin] PATH_INFO: `/v3/users/c5bd337b3ace49fa97ffd898fb50dd30` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:00.868641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010760e-ebbd-4a5d-b4cd-113176c49898 None admin] RBAC: Authorizing `identity:get_user(user_id=c5bd337b3ace49fa97ffd898fb50dd30)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:00.870271 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010760e-ebbd-4a5d-b4cd-113176c49898 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:00.872400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 158/327] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:21:00 2022] GET /identity/v3/users/c5bd337b3ace49fa97ffd898fb50dd30 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:00.878825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e30651-32b6-480c-b197-1c6281d1fef7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:00.961081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7410-a9cd-4fd3-8c56-93720e61008f None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:00.961686 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7410-a9cd-4fd3-8c56-93720e61008f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:00.962725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7410-a9cd-4fd3-8c56-93720e61008f None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:00.964333 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 159/328] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:21:00.969476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c15d97-e47a-43e5-9311-3bd83bfce8ae None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:00.970031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c15d97-e47a-43e5-9311-3bd83bfce8ae None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:00.970574 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c15d97-e47a-43e5-9311-3bd83bfce8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:00.996887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a9c15d97-e47a-43e5-9311-3bd83bfce8ae None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:00.998567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a9c15d97-e47a-43e5-9311-3bd83bfce8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:01.003388 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e30651-32b6-480c-b197-1c6281d1fef7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:01.049541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5957657-d7f8-4e12-bded-ec63aa9b5574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:01.050228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5957657-d7f8-4e12-bded-ec63aa9b5574 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:01.050514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5957657-d7f8-4e12-bded-ec63aa9b5574 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:01.050798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5957657-d7f8-4e12-bded-ec63aa9b5574 None admin] PATH_INFO: `/v3/system/users/c5bd337b3ace49fa97ffd898fb50dd30/roles/f8835028095e42448f0322ba8f1011e8` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:01.052639 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5957657-d7f8-4e12-bded-ec63aa9b5574 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c5bd337b3ace49fa97ffd898fb50dd30, role_id=f8835028095e42448f0322ba8f1011e8)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:01.054616 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5957657-d7f8-4e12-bded-ec63aa9b5574 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:01.071621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 170/329] 10.222.0.67 () {58 vars in 1334 bytes} [Wed Jul 27 16:21:00 2022] PUT /identity/v3/system/users/c5bd337b3ace49fa97ffd898fb50dd30/roles/f8835028095e42448f0322ba8f1011e8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:01.078363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:01.107460 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 160/330] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:21:01.131604 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5957657-d7f8-4e12-bded-ec63aa9b5574 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:01.196224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:01.246926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5957657-d7f8-4e12-bded-ec63aa9b5574 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:01.283816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c3c1d-cfd4-411a-b027-73ef85911cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:01.284508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c3c1d-cfd4-411a-b027-73ef85911cbc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:01.284850 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c3c1d-cfd4-411a-b027-73ef85911cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:01.285134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c3c1d-cfd4-411a-b027-73ef85911cbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:01.296642 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c3c1d-cfd4-411a-b027-73ef85911cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-670c3c1d-cfd4-411a-b027-73ef85911cbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:01.302119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:01.303003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:01.303912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:01.303912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:01.303912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:01.303912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:01.303912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:01.303912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:01.303912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:01.303912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:01.303912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:01.303912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:01.303912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:01.303912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:01.303912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 171/331] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:01.309708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c15d97-e47a-43e5-9311-3bd83bfce8ae None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:01.433815 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c15d97-e47a-43e5-9311-3bd83bfce8ae None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:01.479034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6d39-31fe-46b1-ba12-bafa60f33375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:01.479673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6d39-31fe-46b1-ba12-bafa60f33375 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:01.479998 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6d39-31fe-46b1-ba12-bafa60f33375 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:01.480267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6d39-31fe-46b1-ba12-bafa60f33375 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:01.480995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da6d39-31fe-46b1-ba12-bafa60f33375 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:01.481302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da6d39-31fe-46b1-ba12-bafa60f33375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:01.482694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da6d39-31fe-46b1-ba12-bafa60f33375 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:01.496839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 161/332] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:21:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:01.502287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c3c1d-cfd4-411a-b027-73ef85911cbc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:01.691033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c3c1d-cfd4-411a-b027-73ef85911cbc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:01.706743 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:01.736802 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd5e35-895f-490b-bbc7-56ac0e20c0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:01.737467 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5e35-895f-490b-bbc7-56ac0e20c0eb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:01.737756 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5e35-895f-490b-bbc7-56ac0e20c0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:01.738040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5e35-895f-490b-bbc7-56ac0e20c0eb None admin] PATH_INFO: `/v3/users/f210c75dc4ae48c79fd1c46192b368dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:01.744621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd5e35-895f-490b-bbc7-56ac0e20c0eb None admin] RBAC: Authorizing `identity:get_user(user_id=f210c75dc4ae48c79fd1c46192b368dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:01.746108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd5e35-895f-490b-bbc7-56ac0e20c0eb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:01.747794 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 172/333] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:21:01 2022] GET /identity/v3/users/f210c75dc4ae48c79fd1c46192b368dd => generated 293 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:01.753740 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6d39-31fe-46b1-ba12-bafa60f33375 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:01.828276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:01.894520 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6d39-31fe-46b1-ba12-bafa60f33375 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:01.950529 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb64c0-ac13-4e0c-8b9b-2f0469821fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:01.951175 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb64c0-ac13-4e0c-8b9b-2f0469821fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:01.951459 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb64c0-ac13-4e0c-8b9b-2f0469821fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:01.951734 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb64c0-ac13-4e0c-8b9b-2f0469821fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:01.952557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb64c0-ac13-4e0c-8b9b-2f0469821fc4 None admin] RBAC: Adding query filter params (role.id=19570429b77848d998cb882f8b16aa76, user.id=f210c75dc4ae48c79fd1c46192b368dd, scope.system=all) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:01.952868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb64c0-ac13-4e0c-8b9b-2f0469821fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:01.954307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb64c0-ac13-4e0c-8b9b-2f0469821fc4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:01.977488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 162/334] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Jul 27 16:21:01 2022] GET /identity/v3/role_assignments?user.id=f210c75dc4ae48c79fd1c46192b368dd&scope.system=all&role.id=19570429b77848d998cb882f8b16aa76 => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:03.170623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe70ed-1828-4e8c-8fe5-ba568a4297b4 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:03.171144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe70ed-1828-4e8c-8fe5-ba568a4297b4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:03.171218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe70ed-1828-4e8c-8fe5-ba568a4297b4 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:03.173020 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 173/335] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:03.178846 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014552c-10b4-4f05-a4fd-e0a9e61372d5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:03.179289 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014552c-10b4-4f05-a4fd-e0a9e61372d5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:03.179492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014552c-10b4-4f05-a4fd-e0a9e61372d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:03.208896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2014552c-10b4-4f05-a4fd-e0a9e61372d5 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:03.210662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2014552c-10b4-4f05-a4fd-e0a9e61372d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:03.298542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 163/336] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:03.337407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe70ed-1828-4e8c-8fe5-ba568a4297b4 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:03.461170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe70ed-1828-4e8c-8fe5-ba568a4297b4 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:03.474690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2338f-8f08-4553-a8e8-6fc3b249a442 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:03.475534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2338f-8f08-4553-a8e8-6fc3b249a442 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:03.475808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2338f-8f08-4553-a8e8-6fc3b249a442 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:03.477473 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 164/337] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:03.482816 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd67ff9-4eff-438a-a6a8-fe8c56ff4e5b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:03.483108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd67ff9-4eff-438a-a6a8-fe8c56ff4e5b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:03.483385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd67ff9-4eff-438a-a6a8-fe8c56ff4e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:03.516878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7bd67ff9-4eff-438a-a6a8-fe8c56ff4e5b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:03.517449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46390ce1-a954-41ae-901f-e748f6b21401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:03.518101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7bd67ff9-4eff-438a-a6a8-fe8c56ff4e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:03.518212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46390ce1-a954-41ae-901f-e748f6b21401 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:03.518393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46390ce1-a954-41ae-901f-e748f6b21401 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:03.518650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46390ce1-a954-41ae-901f-e748f6b21401 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:03.543071 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46390ce1-a954-41ae-901f-e748f6b21401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-46390ce1-a954-41ae-901f-e748f6b21401 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:03.548629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:03.549537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:03.550336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:03.550336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:03.550336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:03.550336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:03.550336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:03.550336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:03.550336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:03.550336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:03.550336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:03.550336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:03.550336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:03.550336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:03.550336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 174/338] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:03.556233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46390ce1-a954-41ae-901f-e748f6b21401 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:03.575724 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:03.613928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:03.683840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46390ce1-a954-41ae-901f-e748f6b21401 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:03.710153 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 165/339] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:21:03.723523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092eee6-9d80-43ed-9cf8-0ac02517fbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:03.724171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092eee6-9d80-43ed-9cf8-0ac02517fbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:03.724453 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092eee6-9d80-43ed-9cf8-0ac02517fbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:03.724727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092eee6-9d80-43ed-9cf8-0ac02517fbe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:03.726322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092eee6-9d80-43ed-9cf8-0ac02517fbe0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:03.726633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092eee6-9d80-43ed-9cf8-0ac02517fbe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:03.728038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092eee6-9d80-43ed-9cf8-0ac02517fbe0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:03.741437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 175/340] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:21:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:03.747302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd67ff9-4eff-438a-a6a8-fe8c56ff4e5b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:03.758788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092eee6-9d80-43ed-9cf8-0ac02517fbe0 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:03.883527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092eee6-9d80-43ed-9cf8-0ac02517fbe0 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:03.885130 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:03.929157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38650259-de97-477c-bd1c-58a33cfb5934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:03.929815 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38650259-de97-477c-bd1c-58a33cfb5934 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:03.930266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38650259-de97-477c-bd1c-58a33cfb5934 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:03.930547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38650259-de97-477c-bd1c-58a33cfb5934 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:03.948177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38650259-de97-477c-bd1c-58a33cfb5934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-38650259-de97-477c-bd1c-58a33cfb5934 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:03.953778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:03.954682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:03.955499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:03.955499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:03.955499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:03.955499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:03.955499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:03.955499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:03.955499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:03.955499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:03.955499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:03.955499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:03.955499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:03.955499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:03.955499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 176/341] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:21:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:03.963403 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38650259-de97-477c-bd1c-58a33cfb5934 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:04.042192 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd67ff9-4eff-438a-a6a8-fe8c56ff4e5b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:04.116152 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933473a-fbc0-4400-bc7b-0d5576cf5007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:04.116799 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933473a-fbc0-4400-bc7b-0d5576cf5007 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:04.117085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933473a-fbc0-4400-bc7b-0d5576cf5007 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:04.120180 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933473a-fbc0-4400-bc7b-0d5576cf5007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:04.153581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38650259-de97-477c-bd1c-58a33cfb5934 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:04.179842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:04.227565 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc62ec1-8260-4156-b44c-8938f6191e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:04.228251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc62ec1-8260-4156-b44c-8938f6191e0e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:04.228493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc62ec1-8260-4156-b44c-8938f6191e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:04.228769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc62ec1-8260-4156-b44c-8938f6191e0e None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:04.229493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc62ec1-8260-4156-b44c-8938f6191e0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:04.229800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc62ec1-8260-4156-b44c-8938f6191e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:04.231192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc62ec1-8260-4156-b44c-8938f6191e0e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:04.250403 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 177/342] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:04.251690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab921460-f437-494c-b48c-ddeb332e4939 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:04.252007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab921460-f437-494c-b48c-ddeb332e4939 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:04.252290 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab921460-f437-494c-b48c-ddeb332e4939 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:04.253671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 178/343] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:04.262126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab921460-f437-494c-b48c-ddeb332e4939 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:04.267831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933473a-fbc0-4400-bc7b-0d5576cf5007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:04.269322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933473a-fbc0-4400-bc7b-0d5576cf5007 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:04.316094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:04.439979 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab921460-f437-494c-b48c-ddeb332e4939 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:04.450230 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 166/344] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:04.451330 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e767-9d22-4463-b2b2-660dd0142327 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:04.451620 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e767-9d22-4463-b2b2-660dd0142327 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:04.451938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e767-9d22-4463-b2b2-660dd0142327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:04.473936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c915e767-9d22-4463-b2b2-660dd0142327 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:04.475676 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c915e767-9d22-4463-b2b2-660dd0142327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:04.482860 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cb02c-b227-4a8d-8ad8-aae74775f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:04.483498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cb02c-b227-4a8d-8ad8-aae74775f367 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:04.483784 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cb02c-b227-4a8d-8ad8-aae74775f367 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:04.484207 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cb02c-b227-4a8d-8ad8-aae74775f367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:04.547410 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:04.562656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 167/345] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:04.563755 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ae660-ac8f-45c8-b7f7-fe7a4b1aabab None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:04.564113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ae660-ac8f-45c8-b7f7-fe7a4b1aabab None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:04.564392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ae660-ac8f-45c8-b7f7-fe7a4b1aabab None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:04.565786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 168/346] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:04.568455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ae660-ac8f-45c8-b7f7-fe7a4b1aabab None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:04.569190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cb02c-b227-4a8d-8ad8-aae74775f367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:04.570945 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cb02c-b227-4a8d-8ad8-aae74775f367 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:04.598937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:04.695492 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 179/347] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:04.697205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b068d9-87b1-4b2f-96dd-e6eead4a6fa7 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:04.697495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b068d9-87b1-4b2f-96dd-e6eead4a6fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:04.697771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b068d9-87b1-4b2f-96dd-e6eead4a6fa7 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:04.700345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 180/348] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:04.701700 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f267a-2607-41d4-89a7-221c05011915 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:04.701995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f267a-2607-41d4-89a7-221c05011915 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:04.702269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f267a-2607-41d4-89a7-221c05011915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:04.714257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ae660-ac8f-45c8-b7f7-fe7a4b1aabab None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:04.722694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6a5f267a-2607-41d4-89a7-221c05011915 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:04.724621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6a5f267a-2607-41d4-89a7-221c05011915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:04.756721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c693a-0dba-477a-b9e4-4315ca4012ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:04.757470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c693a-0dba-477a-b9e4-4315ca4012ab None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:04.757823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c693a-0dba-477a-b9e4-4315ca4012ab None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:04.758194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c693a-0dba-477a-b9e4-4315ca4012ab None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:04.759457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c693a-0dba-477a-b9e4-4315ca4012ab None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:04.761069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c693a-0dba-477a-b9e4-4315ca4012ab None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:04.763001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 169/349] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:04 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:04.763646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c693a-0dba-477a-b9e4-4315ca4012ab None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:04.825927 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 181/350] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:04.826795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f267a-2607-41d4-89a7-221c05011915 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:04.845101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:04.889331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:04.896518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c693a-0dba-477a-b9e4-4315ca4012ab None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:04.943103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01361a65-7ef7-4915-911a-a094d1337b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:04.944351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01361a65-7ef7-4915-911a-a094d1337b57 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:04.944778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01361a65-7ef7-4915-911a-a094d1337b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:04.945147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01361a65-7ef7-4915-911a-a094d1337b57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:04.950372 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f267a-2607-41d4-89a7-221c05011915 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:04.964080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01361a65-7ef7-4915-911a-a094d1337b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-01361a65-7ef7-4915-911a-a094d1337b57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:04.973629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:04.974573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 170/351] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:04.975573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23d2d-4c5e-4b98-8bdd-2618d59f710b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:04.976353 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23d2d-4c5e-4b98-8bdd-2618d59f710b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:04.976353 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23d2d-4c5e-4b98-8bdd-2618d59f710b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:04.997260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-12a23d2d-4c5e-4b98-8bdd-2618d59f710b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:04.998459 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-12a23d2d-4c5e-4b98-8bdd-2618d59f710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:04.999415 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcadf9b-3aa3-43e2-a263-35fbefe68dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:05.000434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcadf9b-3aa3-43e2-a263-35fbefe68dbe None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:05.000888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcadf9b-3aa3-43e2-a263-35fbefe68dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:05.001309 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcadf9b-3aa3-43e2-a263-35fbefe68dbe None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:05.002669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcadf9b-3aa3-43e2-a263-35fbefe68dbe None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:05.004307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcadf9b-3aa3-43e2-a263-35fbefe68dbe None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:05.007238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 182/352] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:04 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:05.012299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcadf9b-3aa3-43e2-a263-35fbefe68dbe None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:05.083487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 171/353] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:05.083487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a23d2d-4c5e-4b98-8bdd-2618d59f710b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:05.137801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcadf9b-3aa3-43e2-a263-35fbefe68dbe None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:05.147722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:05.166431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:05.183048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26056243-3f8e-4e43-9e84-c7c2bf69f3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:05.183704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26056243-3f8e-4e43-9e84-c7c2bf69f3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:05.184340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26056243-3f8e-4e43-9e84-c7c2bf69f3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:05.184340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26056243-3f8e-4e43-9e84-c7c2bf69f3e7 None admin] PATH_INFO: `/v3/groups/0aa58b745d4c492884d92dbc93201d8e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:05.191400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26056243-3f8e-4e43-9e84-c7c2bf69f3e7 None admin] RBAC: Authorizing `identity:get_group(group_id=0aa58b745d4c492884d92dbc93201d8e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:05.192966 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26056243-3f8e-4e43-9e84-c7c2bf69f3e7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:05.195142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 183/354] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:05 2022] GET /identity/v3/groups/0aa58b745d4c492884d92dbc93201d8e => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:05.196037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26056243-3f8e-4e43-9e84-c7c2bf69f3e7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:05.206278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a23d2d-4c5e-4b98-8bdd-2618d59f710b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:05.247336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d181cb-752d-4c67-9e07-039fff67404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:05.248020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d181cb-752d-4c67-9e07-039fff67404b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:05.248302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d181cb-752d-4c67-9e07-039fff67404b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:05.248572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d181cb-752d-4c67-9e07-039fff67404b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:05.260369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d181cb-752d-4c67-9e07-039fff67404b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-75d181cb-752d-4c67-9e07-039fff67404b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:05.266335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:05.267492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 172/355] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:21:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:05.268797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d181cb-752d-4c67-9e07-039fff67404b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:05.331292 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26056243-3f8e-4e43-9e84-c7c2bf69f3e7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:05.376483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca787e21-d310-4159-9070-c87897aec6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:05.377834 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca787e21-d310-4159-9070-c87897aec6cb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:05.378339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca787e21-d310-4159-9070-c87897aec6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:05.378744 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca787e21-d310-4159-9070-c87897aec6cb None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:05.379603 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca787e21-d310-4159-9070-c87897aec6cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:05.380112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca787e21-d310-4159-9070-c87897aec6cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:05.381647 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca787e21-d310-4159-9070-c87897aec6cb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:05.391008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 184/356] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:21:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:05.394485 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d181cb-752d-4c67-9e07-039fff67404b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:05.397229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2103-b45c-4dc6-ac5a-d6ebb69b0165 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:05.398291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2103-b45c-4dc6-ac5a-d6ebb69b0165 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:05.398291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2103-b45c-4dc6-ac5a-d6ebb69b0165 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:05.399191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 185/357] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:05.400001 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd2103-b45c-4dc6-ac5a-d6ebb69b0165 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:05.406284 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:05.437884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5849-3477-42a0-b95b-0c4afb3cca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:05.438535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5849-3477-42a0-b95b-0c4afb3cca0f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:05.438822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5849-3477-42a0-b95b-0c4afb3cca0f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:05.439101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5849-3477-42a0-b95b-0c4afb3cca0f None admin] PATH_INFO: `/v3/groups/0aa58b745d4c492884d92dbc93201d8e` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:05.440725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f5849-3477-42a0-b95b-0c4afb3cca0f None admin] RBAC: Authorizing `identity:get_group(group_id=0aa58b745d4c492884d92dbc93201d8e)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:05.442550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f5849-3477-42a0-b95b-0c4afb3cca0f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:05.447920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 173/358] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:05 2022] GET /identity/v3/groups/0aa58b745d4c492884d92dbc93201d8e => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:05.447920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5849-3477-42a0-b95b-0c4afb3cca0f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:05.460554 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:05.529045 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd2103-b45c-4dc6-ac5a-d6ebb69b0165 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:05.571049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4768f-3caf-46d4-9db1-6d749e7b1005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:05.571699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4768f-3caf-46d4-9db1-6d749e7b1005 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:05.572064 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4768f-3caf-46d4-9db1-6d749e7b1005 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:05.572345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4768f-3caf-46d4-9db1-6d749e7b1005 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:05.582357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5849-3477-42a0-b95b-0c4afb3cca0f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:05.584738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4768f-3caf-46d4-9db1-6d749e7b1005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-67a4768f-3caf-46d4-9db1-6d749e7b1005 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:05.590674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:05.591765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:05.592915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:05.592915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:05.592915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:05.592915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:05.592915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:05.592915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:05.592915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:05.592915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:05.592915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:05.592915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:05.592915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 16:21:05.592915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:05.592915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 186/359] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:05.593680 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4768f-3caf-46d4-9db1-6d749e7b1005 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:05.629110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dfe14-63dc-4e19-8d35-3ae072f63377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:05.630401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dfe14-63dc-4e19-8d35-3ae072f63377 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:05.630695 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dfe14-63dc-4e19-8d35-3ae072f63377 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:05.631215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dfe14-63dc-4e19-8d35-3ae072f63377 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:05.632049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dfe14-63dc-4e19-8d35-3ae072f63377 None admin] RBAC: Adding query filter params (group.id=0aa58b745d4c492884d92dbc93201d8e, role.id=19570429b77848d998cb882f8b16aa76, scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:05.632421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dfe14-63dc-4e19-8d35-3ae072f63377 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:05.633922 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dfe14-63dc-4e19-8d35-3ae072f63377 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:05.640189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 174/360] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 16:21:05 2022] GET /identity/v3/role_assignments?group.id=0aa58b745d4c492884d92dbc93201d8e&scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd&role.id=19570429b77848d998cb882f8b16aa76 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:05.640928 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dfe14-63dc-4e19-8d35-3ae072f63377 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:05.700072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:05.746556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4768f-3caf-46d4-9db1-6d749e7b1005 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:05.763150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:05.779046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dfe14-63dc-4e19-8d35-3ae072f63377 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:05.793410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd463f-5367-4cf5-b522-2931bc0f957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:05.794089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd463f-5367-4cf5-b522-2931bc0f957e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:05.794359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd463f-5367-4cf5-b522-2931bc0f957e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:05.794637 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd463f-5367-4cf5-b522-2931bc0f957e None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:05.795374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd463f-5367-4cf5-b522-2931bc0f957e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:05.795685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd463f-5367-4cf5-b522-2931bc0f957e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:05.797153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd463f-5367-4cf5-b522-2931bc0f957e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:05.810132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 187/361] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:05.811406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99aa1ca-31e7-4438-bd34-ba9a2f297ade None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:05.811608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99aa1ca-31e7-4438-bd34-ba9a2f297ade None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:05.813563 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99aa1ca-31e7-4438-bd34-ba9a2f297ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:05.825061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be55d3-c738-4d49-b797-c1ad4c8f9ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:05.825690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be55d3-c738-4d49-b797-c1ad4c8f9ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:05.825974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be55d3-c738-4d49-b797-c1ad4c8f9ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:05.826246 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be55d3-c738-4d49-b797-c1ad4c8f9ac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:05.834823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f99aa1ca-31e7-4438-bd34-ba9a2f297ade None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:05.836211 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f99aa1ca-31e7-4438-bd34-ba9a2f297ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:05.915987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be55d3-c738-4d49-b797-c1ad4c8f9ac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:05.918012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be55d3-c738-4d49-b797-c1ad4c8f9ac4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:05.926297 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 188/362] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:05.926963 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99aa1ca-31e7-4438-bd34-ba9a2f297ade None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:05.971034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:06.046965 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 175/363] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:06.050352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:06.052571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be55d3-c738-4d49-b797-c1ad4c8f9ac4 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:06.054832 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99aa1ca-31e7-4438-bd34-ba9a2f297ade None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:06.104461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4e086-7260-4a8c-8d2d-4567c01744ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:06.106289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4e086-7260-4a8c-8d2d-4567c01744ff None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:06.106782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4e086-7260-4a8c-8d2d-4567c01744ff None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:06.107589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4e086-7260-4a8c-8d2d-4567c01744ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:06.108852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4e086-7260-4a8c-8d2d-4567c01744ff None admin] RBAC: Adding query filter params (group.id=0aa58b745d4c492884d92dbc93201d8e, role.id=84e73bacaaef4e4ab018e94824f9d891, scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:06.109172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4e086-7260-4a8c-8d2d-4567c01744ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:06.110827 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4e086-7260-4a8c-8d2d-4567c01744ff None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:06.119622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 189/364] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 16:21:05 2022] GET /identity/v3/role_assignments?group.id=0aa58b745d4c492884d92dbc93201d8e&scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd&role.id=84e73bacaaef4e4ab018e94824f9d891 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:06.120512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4e086-7260-4a8c-8d2d-4567c01744ff None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:06.190055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be55d3-c738-4d49-b797-c1ad4c8f9ac4 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:06.241967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530d8c1-0507-44b6-a633-e8b429c1b579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:06.242760 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530d8c1-0507-44b6-a633-e8b429c1b579 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:06.242946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530d8c1-0507-44b6-a633-e8b429c1b579 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:06.243187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530d8c1-0507-44b6-a633-e8b429c1b579 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:06.243958 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530d8c1-0507-44b6-a633-e8b429c1b579 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:06.244558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530d8c1-0507-44b6-a633-e8b429c1b579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:06.245979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530d8c1-0507-44b6-a633-e8b429c1b579 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:06.262561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 176/365] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:21:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:06.262561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530d8c1-0507-44b6-a633-e8b429c1b579 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:06.266574 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:06.281389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4e086-7260-4a8c-8d2d-4567c01744ff None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:06.329432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed13393-b32f-4d49-94f8-b4f30bbcc8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:06.330233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed13393-b32f-4d49-94f8-b4f30bbcc8fc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:06.330802 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed13393-b32f-4d49-94f8-b4f30bbcc8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:06.331099 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed13393-b32f-4d49-94f8-b4f30bbcc8fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:06.388287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:06.390126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530d8c1-0507-44b6-a633-e8b429c1b579 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:06.430069 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed13393-b32f-4d49-94f8-b4f30bbcc8fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:06.431586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed13393-b32f-4d49-94f8-b4f30bbcc8fc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:06.436412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e135e-3bd3-408d-8d7f-9cbd9f020066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:06.437082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e135e-3bd3-408d-8d7f-9cbd9f020066 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:06.437369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e135e-3bd3-408d-8d7f-9cbd9f020066 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:06.437646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e135e-3bd3-408d-8d7f-9cbd9f020066 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:06.450060 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e135e-3bd3-408d-8d7f-9cbd9f020066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-1c4e135e-3bd3-408d-8d7f-9cbd9f020066 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:06.455744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:06.456640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 177/366] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:06.457852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e135e-3bd3-408d-8d7f-9cbd9f020066 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:06.529143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:06.549024 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 190/367] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:06.549902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed13393-b32f-4d49-94f8-b4f30bbcc8fc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:06.576469 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e135e-3bd3-408d-8d7f-9cbd9f020066 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:06.613902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1d3d8-1e9c-4276-98c8-940f72dafdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:06.614536 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d3d8-1e9c-4276-98c8-940f72dafdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:06.614822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d3d8-1e9c-4276-98c8-940f72dafdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:06.615103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d3d8-1e9c-4276-98c8-940f72dafdf6 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:06.616584 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1d3d8-1e9c-4276-98c8-940f72dafdf6 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:06.617962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1d3d8-1e9c-4276-98c8-940f72dafdf6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:06.620101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 178/368] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:06 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:06.621141 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1d3d8-1e9c-4276-98c8-940f72dafdf6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:06.632517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:06.668318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed13393-b32f-4d49-94f8-b4f30bbcc8fc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:06.704166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba9b72-2c20-4653-b456-e0f6aa913956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:06.704740 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba9b72-2c20-4653-b456-e0f6aa913956 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:06.705028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba9b72-2c20-4653-b456-e0f6aa913956 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:06.705311 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba9b72-2c20-4653-b456-e0f6aa913956 None admin] PATH_INFO: `/v3/users/c5bd337b3ace49fa97ffd898fb50dd30` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:06.706521 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba9b72-2c20-4653-b456-e0f6aa913956 None admin] RBAC: Authorizing `identity:get_user(user_id=c5bd337b3ace49fa97ffd898fb50dd30)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:06.707995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba9b72-2c20-4653-b456-e0f6aa913956 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:06.710525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 191/369] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:21:06 2022] GET /identity/v3/users/c5bd337b3ace49fa97ffd898fb50dd30 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:06.711117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba9b72-2c20-4653-b456-e0f6aa913956 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:06.735454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1d3d8-1e9c-4276-98c8-940f72dafdf6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:06.766226 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:06.774349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5801c63-e72b-4b50-9e85-a3c392a4e9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:06.774979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5801c63-e72b-4b50-9e85-a3c392a4e9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:06.775268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5801c63-e72b-4b50-9e85-a3c392a4e9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:06.775550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5801c63-e72b-4b50-9e85-a3c392a4e9f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:06.776364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5801c63-e72b-4b50-9e85-a3c392a4e9f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:06.776674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5801c63-e72b-4b50-9e85-a3c392a4e9f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:06.778107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5801c63-e72b-4b50-9e85-a3c392a4e9f2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:06.787258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 179/370] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:06.788136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5801c63-e72b-4b50-9e85-a3c392a4e9f2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:06.813653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba9b72-2c20-4653-b456-e0f6aa913956 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:06.852328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:06.855534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ea4f1-1da3-48af-b6b7-3b09138e8ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:06.856503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ea4f1-1da3-48af-b6b7-3b09138e8ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:06.857014 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ea4f1-1da3-48af-b6b7-3b09138e8ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:06.857489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ea4f1-1da3-48af-b6b7-3b09138e8ba4 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:06.859577 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ea4f1-1da3-48af-b6b7-3b09138e8ba4 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:06.861585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ea4f1-1da3-48af-b6b7-3b09138e8ba4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:06.864542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 192/371] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:06 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:06.866283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ea4f1-1da3-48af-b6b7-3b09138e8ba4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:06.898274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5801c63-e72b-4b50-9e85-a3c392a4e9f2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:06.934871 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a05e4c-7448-4427-863b-e107ff094ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:06.935579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a05e4c-7448-4427-863b-e107ff094ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:06.935885 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a05e4c-7448-4427-863b-e107ff094ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:06.936171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a05e4c-7448-4427-863b-e107ff094ed7 None admin] PATH_INFO: `/v3/groups/0aa58b745d4c492884d92dbc93201d8e` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:06.937600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a05e4c-7448-4427-863b-e107ff094ed7 None admin] RBAC: Authorizing `identity:get_group(group_id=0aa58b745d4c492884d92dbc93201d8e)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:06.939041 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a05e4c-7448-4427-863b-e107ff094ed7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:06.940974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 180/372] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:06 2022] GET /identity/v3/groups/0aa58b745d4c492884d92dbc93201d8e => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:06.941753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a05e4c-7448-4427-863b-e107ff094ed7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:07.000126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ea4f1-1da3-48af-b6b7-3b09138e8ba4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:07.008208 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:07.038624 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aed789-5e93-4fb1-ab39-e20b4c52ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:07.039644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aed789-5e93-4fb1-ab39-e20b4c52ff0e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:07.040177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aed789-5e93-4fb1-ab39-e20b4c52ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:07.040667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aed789-5e93-4fb1-ab39-e20b4c52ff0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:07.041834 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aed789-5e93-4fb1-ab39-e20b4c52ff0e None admin] RBAC: Adding query filter params (role.id=f8835028095e42448f0322ba8f1011e8, user.id=c5bd337b3ace49fa97ffd898fb50dd30, scope.system=all) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:07.042357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aed789-5e93-4fb1-ab39-e20b4c52ff0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:07.044149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aed789-5e93-4fb1-ab39-e20b4c52ff0e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:07.047625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a05e4c-7448-4427-863b-e107ff094ed7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:07.058106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 193/373] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Jul 27 16:21:06 2022] GET /identity/v3/role_assignments?user.id=c5bd337b3ace49fa97ffd898fb50dd30&scope.system=all&role.id=f8835028095e42448f0322ba8f1011e8 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:07.059279 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aed789-5e93-4fb1-ab39-e20b4c52ff0e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:07.084869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a34f2-5854-445f-9312-81a993a20852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:07.085899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a34f2-5854-445f-9312-81a993a20852 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:07.085899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a34f2-5854-445f-9312-81a993a20852 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:07.086091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a34f2-5854-445f-9312-81a993a20852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:07.136605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:07.185535 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aed789-5e93-4fb1-ab39-e20b4c52ff0e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:07.194895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a34f2-5854-445f-9312-81a993a20852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:07.196432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a34f2-5854-445f-9312-81a993a20852 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:07.226867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7a9ba-c8fb-45bb-bf02-e3bec8cb75c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:07.227975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7a9ba-c8fb-45bb-bf02-e3bec8cb75c5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:07.228496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7a9ba-c8fb-45bb-bf02-e3bec8cb75c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:07.229058 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7a9ba-c8fb-45bb-bf02-e3bec8cb75c5 None admin] PATH_INFO: `/v3/groups/0aa58b745d4c492884d92dbc93201d8e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:07.230673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7a9ba-c8fb-45bb-bf02-e3bec8cb75c5 None admin] RBAC: Authorizing `identity:get_group(group_id=0aa58b745d4c492884d92dbc93201d8e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:07.232399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7a9ba-c8fb-45bb-bf02-e3bec8cb75c5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:07.234433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 194/374] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:07 2022] GET /identity/v3/groups/0aa58b745d4c492884d92dbc93201d8e => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:07.235408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7a9ba-c8fb-45bb-bf02-e3bec8cb75c5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:07.260749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:07.332744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 181/375] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:07.333606 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a34f2-5854-445f-9312-81a993a20852 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:07.359036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7a9ba-c8fb-45bb-bf02-e3bec8cb75c5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:07.389280 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:07.401231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf6421-1f44-4aea-8cf6-a8e9df3668fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:07.402191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6421-1f44-4aea-8cf6-a8e9df3668fe None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:07.402680 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6421-1f44-4aea-8cf6-a8e9df3668fe None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:07.403241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6421-1f44-4aea-8cf6-a8e9df3668fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:07.404456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf6421-1f44-4aea-8cf6-a8e9df3668fe None admin] RBAC: Adding query filter params (group.id=0aa58b745d4c492884d92dbc93201d8e, role.id=19570429b77848d998cb882f8b16aa76, scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:07.404975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf6421-1f44-4aea-8cf6-a8e9df3668fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:07.406609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf6421-1f44-4aea-8cf6-a8e9df3668fe None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:07.413536 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 195/376] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 16:21:07 2022] GET /identity/v3/role_assignments?group.id=0aa58b745d4c492884d92dbc93201d8e&scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5&role.id=19570429b77848d998cb882f8b16aa76 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:07.414668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf6421-1f44-4aea-8cf6-a8e9df3668fe None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:07.448776 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a34f2-5854-445f-9312-81a993a20852 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:07.492926 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55495a-7766-4e6f-a147-ecc151eb711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:07.493549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55495a-7766-4e6f-a147-ecc151eb711d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:07.493841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55495a-7766-4e6f-a147-ecc151eb711d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:07.494126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55495a-7766-4e6f-a147-ecc151eb711d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:07.494939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55495a-7766-4e6f-a147-ecc151eb711d None admin] RBAC: Adding query filter params (group.id=0aa58b745d4c492884d92dbc93201d8e, role.id=84e73bacaaef4e4ab018e94824f9d891, scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:07.495250 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55495a-7766-4e6f-a147-ecc151eb711d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:07.496901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55495a-7766-4e6f-a147-ecc151eb711d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:07.503418 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 182/377] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 16:21:07 2022] GET /identity/v3/role_assignments?group.id=0aa58b745d4c492884d92dbc93201d8e&scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5&role.id=84e73bacaaef4e4ab018e94824f9d891 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:07.538452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf6421-1f44-4aea-8cf6-a8e9df3668fe None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:07.578643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1d8c5-2475-4359-89a0-1e370b11660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:07.579708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1d8c5-2475-4359-89a0-1e370b11660d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:07.580243 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1d8c5-2475-4359-89a0-1e370b11660d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:07.580736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1d8c5-2475-4359-89a0-1e370b11660d None admin] PATH_INFO: `/v3/projects/8fe6d635a22f4f83acd22dcb2e804bfc` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:07.582209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1d8c5-2475-4359-89a0-1e370b11660d None admin] RBAC: Authorizing `identity:get_project(project_id=8fe6d635a22f4f83acd22dcb2e804bfc)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:07.584001 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1d8c5-2475-4359-89a0-1e370b11660d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:07.586174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 196/378] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:07 2022] GET /identity/v3/projects/8fe6d635a22f4f83acd22dcb2e804bfc => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:07.591974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55495a-7766-4e6f-a147-ecc151eb711d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:07.637431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:07.727573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55495a-7766-4e6f-a147-ecc151eb711d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:07.764327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461b6a2-76cc-427f-bc31-a2594b660b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:07.765428 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461b6a2-76cc-427f-bc31-a2594b660b5d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:07.765715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461b6a2-76cc-427f-bc31-a2594b660b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:07.765990 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461b6a2-76cc-427f-bc31-a2594b660b5d None admin] PATH_INFO: `/v3/groups/2b82ee8645284245bc74aea9c44f85a5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:07.772699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461b6a2-76cc-427f-bc31-a2594b660b5d None admin] RBAC: Authorizing `identity:get_group(group_id=2b82ee8645284245bc74aea9c44f85a5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:07.774162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461b6a2-76cc-427f-bc31-a2594b660b5d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:07.775851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 183/379] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:07 2022] GET /identity/v3/groups/2b82ee8645284245bc74aea9c44f85a5 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:07.781728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1d8c5-2475-4359-89a0-1e370b11660d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:07.863513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:07.918855 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1d8c5-2475-4359-89a0-1e370b11660d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:07.959388 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76852227-ae68-4f4d-8b5f-c407500ebf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:07.960420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852227-ae68-4f4d-8b5f-c407500ebf0b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:07.960923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852227-ae68-4f4d-8b5f-c407500ebf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:07.961404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852227-ae68-4f4d-8b5f-c407500ebf0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:07.962413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76852227-ae68-4f4d-8b5f-c407500ebf0b None admin] RBAC: Adding query filter params (group.id=2b82ee8645284245bc74aea9c44f85a5, role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=8fe6d635a22f4f83acd22dcb2e804bfc) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:07.962935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76852227-ae68-4f4d-8b5f-c407500ebf0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:07.964593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76852227-ae68-4f4d-8b5f-c407500ebf0b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:07.971147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 197/380] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 16:21:07 2022] GET /identity/v3/role_assignments?group.id=2b82ee8645284245bc74aea9c44f85a5&scope.project.id=8fe6d635a22f4f83acd22dcb2e804bfc&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:08.141830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15c848-385e-4708-a8ff-c3a47ab05369 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:08.142016 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15c848-385e-4708-a8ff-c3a47ab05369 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:08.142295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15c848-385e-4708-a8ff-c3a47ab05369 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:08.144069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 184/381] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:08.150315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df6e5b-4145-4b32-a4e4-c5537acf6d3d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:08.150612 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df6e5b-4145-4b32-a4e4-c5537acf6d3d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:08.150900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df6e5b-4145-4b32-a4e4-c5537acf6d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:08.176192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-92df6e5b-4145-4b32-a4e4-c5537acf6d3d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:08.177476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-92df6e5b-4145-4b32-a4e4-c5537acf6d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:08.255375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 198/382] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:08.281074 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15c848-385e-4708-a8ff-c3a47ab05369 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:08.389230 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:08.411634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15c848-385e-4708-a8ff-c3a47ab05369 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:08.459491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434399a-432b-41ae-8e7d-9d84cd211f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:08.460182 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434399a-432b-41ae-8e7d-9d84cd211f1a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:08.460464 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434399a-432b-41ae-8e7d-9d84cd211f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:08.460737 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434399a-432b-41ae-8e7d-9d84cd211f1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:08.477904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434399a-432b-41ae-8e7d-9d84cd211f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d434399a-432b-41ae-8e7d-9d84cd211f1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:08.482953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:08.483939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:08.484802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:08.484802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:08.484802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:08.484802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:08.484802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:08.484802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:08.484802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:08.484802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:08.484802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:08.484802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:08.484802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:08.484802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:08.484802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 185/383] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:08.490170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df6e5b-4145-4b32-a4e4-c5537acf6d3d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:08.561341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:08.571754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fab6c-8082-4e44-ba20-9e3423755594 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:08.572065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fab6c-8082-4e44-ba20-9e3423755594 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:08.572334 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fab6c-8082-4e44-ba20-9e3423755594 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:08.573817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 186/384] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:21:08.579895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dece3f-2337-43f3-9e05-e587b51d7d58 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:08.579895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dece3f-2337-43f3-9e05-e587b51d7d58 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:08.579895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dece3f-2337-43f3-9e05-e587b51d7d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:08.609137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-21dece3f-2337-43f3-9e05-e587b51d7d58 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:08.610168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-21dece3f-2337-43f3-9e05-e587b51d7d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:08.635822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df6e5b-4145-4b32-a4e4-c5537acf6d3d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:08.703415 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5792dc4-eb8b-430d-8277-33db5cbdba4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:08.703990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5792dc4-eb8b-430d-8277-33db5cbdba4e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:08.704273 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5792dc4-eb8b-430d-8277-33db5cbdba4e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:08.704547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5792dc4-eb8b-430d-8277-33db5cbdba4e None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:08.705263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5792dc4-eb8b-430d-8277-33db5cbdba4e None admin] RBAC: Adding query filter params (name=member) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:08.705564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5792dc4-eb8b-430d-8277-33db5cbdba4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:08.706933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5792dc4-eb8b-430d-8277-33db5cbdba4e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:08.727184 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 199/385] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:21:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:08.744225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5792dc4-eb8b-430d-8277-33db5cbdba4e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:08.752287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 187/386] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:21:08.776951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dece3f-2337-43f3-9e05-e587b51d7d58 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:08.868044 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5792dc4-eb8b-430d-8277-33db5cbdba4e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:08.883440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:08.920924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:08.932779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a4f61-e64a-422f-80cb-d660f9617fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:08.933438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a4f61-e64a-422f-80cb-d660f9617fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:08.933727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a4f61-e64a-422f-80cb-d660f9617fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:08.934008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a4f61-e64a-422f-80cb-d660f9617fe7 None admin] PATH_INFO: `/v3/groups/0aa58b745d4c492884d92dbc93201d8e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:08.937307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a4f61-e64a-422f-80cb-d660f9617fe7 None admin] RBAC: Authorizing `identity:get_group(group_id=0aa58b745d4c492884d92dbc93201d8e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:08.938762 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a4f61-e64a-422f-80cb-d660f9617fe7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:08.940426 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 200/387] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:08 2022] GET /identity/v3/groups/0aa58b745d4c492884d92dbc93201d8e => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:08.947316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a4f61-e64a-422f-80cb-d660f9617fe7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:08.968678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dece3f-2337-43f3-9e05-e587b51d7d58 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:09.034105 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a14faf-3639-455a-b390-aa4699fbe8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:09.034768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14faf-3639-455a-b390-aa4699fbe8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:09.035058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14faf-3639-455a-b390-aa4699fbe8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:09.035338 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14faf-3639-455a-b390-aa4699fbe8a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:09.058288 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a14faf-3639-455a-b390-aa4699fbe8a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-34a14faf-3639-455a-b390-aa4699fbe8a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:09.063535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:09.064549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:09.065368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:09.065368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:09.065368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:09.065368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:09.065368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:09.065368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:09.065368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:09.065368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:09.065368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:09.065368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:09.065368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:09.065368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:09.065368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 188/388] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:21:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:09.074604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a14faf-3639-455a-b390-aa4699fbe8a3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:09.121436 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a4f61-e64a-422f-80cb-d660f9617fe7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:09.190489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735f50c-090a-4eff-b93c-aaf80037b47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:09.191142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735f50c-090a-4eff-b93c-aaf80037b47d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:09.191433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735f50c-090a-4eff-b93c-aaf80037b47d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:09.191717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735f50c-090a-4eff-b93c-aaf80037b47d None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:09.194737 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735f50c-090a-4eff-b93c-aaf80037b47d None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:09.196215 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735f50c-090a-4eff-b93c-aaf80037b47d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:09.198977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 201/389] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:08 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:09.203776 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735f50c-090a-4eff-b93c-aaf80037b47d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:09.267924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a14faf-3639-455a-b390-aa4699fbe8a3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:09.294716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:09.337147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345158d8-ad6c-4b4a-b496-75466d1af6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:09.338479 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345158d8-ad6c-4b4a-b496-75466d1af6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:09.338910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345158d8-ad6c-4b4a-b496-75466d1af6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:09.339331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345158d8-ad6c-4b4a-b496-75466d1af6a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:09.340299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345158d8-ad6c-4b4a-b496-75466d1af6a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:09.340749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345158d8-ad6c-4b4a-b496-75466d1af6a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:09.342277 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345158d8-ad6c-4b4a-b496-75466d1af6a7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:09.350424 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735f50c-090a-4eff-b93c-aaf80037b47d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:09.353749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:09.363416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 189/390] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:09.368856 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345158d8-ad6c-4b4a-b496-75466d1af6a7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:09.388525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd532d3e-66c6-4be3-b53e-40d3555ee6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:09.389683 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd532d3e-66c6-4be3-b53e-40d3555ee6c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:09.390173 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd532d3e-66c6-4be3-b53e-40d3555ee6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:09.390651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd532d3e-66c6-4be3-b53e-40d3555ee6c9 None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd/groups/0aa58b745d4c492884d92dbc93201d8e/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:09.393102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd532d3e-66c6-4be3-b53e-40d3555ee6c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5026856c5ec49ea9b8ef8af75a466dd, group_id=0aa58b745d4c492884d92dbc93201d8e, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:09.394779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd532d3e-66c6-4be3-b53e-40d3555ee6c9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:09.418421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 202/391] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 27 16:21:09 2022] PUT /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd/groups/0aa58b745d4c492884d92dbc93201d8e/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:09.492360 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345158d8-ad6c-4b4a-b496-75466d1af6a7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:09.535754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836598f8-4634-44ab-a74d-1bd31ab2822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:09.536370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836598f8-4634-44ab-a74d-1bd31ab2822c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:09.536654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836598f8-4634-44ab-a74d-1bd31ab2822c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:09.536967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836598f8-4634-44ab-a74d-1bd31ab2822c None admin] PATH_INFO: `/v3/groups/0aa58b745d4c492884d92dbc93201d8e` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:09.540058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836598f8-4634-44ab-a74d-1bd31ab2822c None admin] RBAC: Authorizing `identity:get_group(group_id=0aa58b745d4c492884d92dbc93201d8e)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:09.541557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836598f8-4634-44ab-a74d-1bd31ab2822c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:09.543663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 190/392] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:09 2022] GET /identity/v3/groups/0aa58b745d4c492884d92dbc93201d8e => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:09.549346 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd532d3e-66c6-4be3-b53e-40d3555ee6c9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:09.706992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd532d3e-66c6-4be3-b53e-40d3555ee6c9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:09.726251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:09.760751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d47807-66f0-458b-afc7-88a5acb2428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:09.761662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d47807-66f0-458b-afc7-88a5acb2428c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:09.761951 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d47807-66f0-458b-afc7-88a5acb2428c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:09.762229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d47807-66f0-458b-afc7-88a5acb2428c None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:09.763389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d47807-66f0-458b-afc7-88a5acb2428c None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:09.764876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d47807-66f0-458b-afc7-88a5acb2428c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:09.770972 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 203/393] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:09 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:09.772817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836598f8-4634-44ab-a74d-1bd31ab2822c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:09.879949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:09.924414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836598f8-4634-44ab-a74d-1bd31ab2822c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:09.949586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20ba55-3e98-4e4d-a293-cb33b1df76b2 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:09.949959 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20ba55-3e98-4e4d-a293-cb33b1df76b2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:09.950215 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20ba55-3e98-4e4d-a293-cb33b1df76b2 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:09.951733 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 204/394] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:09.956673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318998-140f-442c-89e6-6be4e23e9863 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:09.956967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318998-140f-442c-89e6-6be4e23e9863 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:09.957350 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7318998-140f-442c-89e6-6be4e23e9863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:09.968295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d65db9-dd52-4a67-a526-d6e6e0fe4e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:09.968978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d65db9-dd52-4a67-a526-d6e6e0fe4e36 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:09.969261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d65db9-dd52-4a67-a526-d6e6e0fe4e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:09.969539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d65db9-dd52-4a67-a526-d6e6e0fe4e36 None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd/groups/0aa58b745d4c492884d92dbc93201d8e/roles/84e73bacaaef4e4ab018e94824f9d891` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:09.977881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d65db9-dd52-4a67-a526-d6e6e0fe4e36 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5026856c5ec49ea9b8ef8af75a466dd, group_id=0aa58b745d4c492884d92dbc93201d8e, role_id=84e73bacaaef4e4ab018e94824f9d891)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:09.979315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d65db9-dd52-4a67-a526-d6e6e0fe4e36 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:09.987774 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b7318998-140f-442c-89e6-6be4e23e9863 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:09.988980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b7318998-140f-442c-89e6-6be4e23e9863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:10.009457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 191/395] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 27 16:21:09 2022] PUT /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd/groups/0aa58b745d4c492884d92dbc93201d8e/roles/84e73bacaaef4e4ab018e94824f9d891 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:10.082376 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 205/396] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:21:10.092286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16791995-d65f-4069-aaa3-7a7fc5c0fcee None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:10.092599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16791995-d65f-4069-aaa3-7a7fc5c0fcee None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:10.092984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16791995-d65f-4069-aaa3-7a7fc5c0fcee None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:10.094421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 192/397] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:10.101267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07e7b-329d-41fc-98d3-174bba356918 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:10.101588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07e7b-329d-41fc-98d3-174bba356918 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:10.101832 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07e7b-329d-41fc-98d3-174bba356918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:10.115364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16791995-d65f-4069-aaa3-7a7fc5c0fcee None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:10.125446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-25f07e7b-329d-41fc-98d3-174bba356918 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:10.126664 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-25f07e7b-329d-41fc-98d3-174bba356918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:10.217439 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 206/398] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:10.239034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07e7b-329d-41fc-98d3-174bba356918 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:10.267319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16791995-d65f-4069-aaa3-7a7fc5c0fcee None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:10.295888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:10.298210 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:10.308225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f4d37-816e-4672-9f39-5ce9d542b847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:10.309239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f4d37-816e-4672-9f39-5ce9d542b847 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:10.309781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f4d37-816e-4672-9f39-5ce9d542b847 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:10.310240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f4d37-816e-4672-9f39-5ce9d542b847 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:10.322617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f4d37-816e-4672-9f39-5ce9d542b847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-2e3f4d37-816e-4672-9f39-5ce9d542b847 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:10.328055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:10.328925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:10.329753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:10.329753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:10.329753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:10.329753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:10.329753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:10.329753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:10.329753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:10.329753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:10.329753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:10.329753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:10.329753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:10.329753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:10.332150 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 193/399] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:10.340957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f4d37-816e-4672-9f39-5ce9d542b847 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:10.396462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07e7b-329d-41fc-98d3-174bba356918 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:10.437858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967d066-4e9c-4f44-9ee7-df37a350baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:10.439005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967d066-4e9c-4f44-9ee7-df37a350baba None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:10.439475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967d066-4e9c-4f44-9ee7-df37a350baba None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:10.439965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967d066-4e9c-4f44-9ee7-df37a350baba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:10.451743 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967d066-4e9c-4f44-9ee7-df37a350baba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-0967d066-4e9c-4f44-9ee7-df37a350baba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:10.458023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:10.458993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:10.459820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:10.459820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:10.459820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:10.459820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:10.459820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:10.459820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:10.459820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:10.459820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:10.459820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:10.459820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:10.459820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:10.459820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:10.462872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 207/400] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:21:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:10.469246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967d066-4e9c-4f44-9ee7-df37a350baba None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:10.560060 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f4d37-816e-4672-9f39-5ce9d542b847 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:10.622924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967d066-4e9c-4f44-9ee7-df37a350baba None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:10.624473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:10.643326 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85ad25-e17b-4fdf-9890-f01f7f3deca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:10.643995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85ad25-e17b-4fdf-9890-f01f7f3deca4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:10.644281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85ad25-e17b-4fdf-9890-f01f7f3deca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:10.644554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85ad25-e17b-4fdf-9890-f01f7f3deca4 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:10.645279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85ad25-e17b-4fdf-9890-f01f7f3deca4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:10.645584 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85ad25-e17b-4fdf-9890-f01f7f3deca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:10.647099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85ad25-e17b-4fdf-9890-f01f7f3deca4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:10.667322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 194/401] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:21:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:10.672719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85ad25-e17b-4fdf-9890-f01f7f3deca4 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:10.706773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903fe78-b6fa-4a19-bb8a-aee5c86cdf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:10.707403 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903fe78-b6fa-4a19-bb8a-aee5c86cdf9b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:10.707691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903fe78-b6fa-4a19-bb8a-aee5c86cdf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:10.707992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903fe78-b6fa-4a19-bb8a-aee5c86cdf9b None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:10.708898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903fe78-b6fa-4a19-bb8a-aee5c86cdf9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:10.709212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903fe78-b6fa-4a19-bb8a-aee5c86cdf9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:10.710597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903fe78-b6fa-4a19-bb8a-aee5c86cdf9b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:10.727931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 208/402] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:10.733353 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903fe78-b6fa-4a19-bb8a-aee5c86cdf9b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:10.780552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:10.836884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85ad25-e17b-4fdf-9890-f01f7f3deca4 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:10.858526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903fe78-b6fa-4a19-bb8a-aee5c86cdf9b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:10.877927 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dea2e-0d05-4e67-9ce3-fa4263f7971c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:10.878575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dea2e-0d05-4e67-9ce3-fa4263f7971c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:10.878858 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dea2e-0d05-4e67-9ce3-fa4263f7971c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:10.879136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dea2e-0d05-4e67-9ce3-fa4263f7971c None admin] PATH_INFO: `/v3/groups/0aa58b745d4c492884d92dbc93201d8e` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:10.880975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052dea2e-0d05-4e67-9ce3-fa4263f7971c None admin] RBAC: Authorizing `identity:get_group(group_id=0aa58b745d4c492884d92dbc93201d8e)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:10.882421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052dea2e-0d05-4e67-9ce3-fa4263f7971c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:10.884564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 195/403] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:10 2022] GET /identity/v3/groups/0aa58b745d4c492884d92dbc93201d8e => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:10.885720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa87a-f168-4f11-9f32-5be5d5c39839 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:10.886004 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa87a-f168-4f11-9f32-5be5d5c39839 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:10.886282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa87a-f168-4f11-9f32-5be5d5c39839 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:10.887714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 196/404] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:10.890642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fa87a-f168-4f11-9f32-5be5d5c39839 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:10.903885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec993678-d8fd-40ec-a86f-93a96529c7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:10.904599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec993678-d8fd-40ec-a86f-93a96529c7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:10.904894 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec993678-d8fd-40ec-a86f-93a96529c7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:10.905183 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec993678-d8fd-40ec-a86f-93a96529c7b2 None admin] PATH_INFO: `/v3/groups/0aa58b745d4c492884d92dbc93201d8e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:10.906374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec993678-d8fd-40ec-a86f-93a96529c7b2 None admin] RBAC: Authorizing `identity:get_group(group_id=0aa58b745d4c492884d92dbc93201d8e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:10.907817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec993678-d8fd-40ec-a86f-93a96529c7b2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:10.909789 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 209/405] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:10 2022] GET /identity/v3/groups/0aa58b745d4c492884d92dbc93201d8e => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:10.910986 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5efdb-b6c7-430d-8d3b-e19f5d5972a3 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:10.911285 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5efdb-b6c7-430d-8d3b-e19f5d5972a3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:10.912127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5efdb-b6c7-430d-8d3b-e19f5d5972a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:10.930963 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-44d5efdb-b6c7-430d-8d3b-e19f5d5972a3 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:10.932244 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-44d5efdb-b6c7-430d-8d3b-e19f5d5972a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:10.955884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:11.001814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fa87a-f168-4f11-9f32-5be5d5c39839 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:11.008180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 210/406] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:11.009139 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5efdb-b6c7-430d-8d3b-e19f5d5972a3 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:11.021778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:11.043488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da284291-5dd6-4033-a838-a49d018c505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:11.044167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da284291-5dd6-4033-a838-a49d018c505b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:11.044701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da284291-5dd6-4033-a838-a49d018c505b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:11.044984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da284291-5dd6-4033-a838-a49d018c505b None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:11.046579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da284291-5dd6-4033-a838-a49d018c505b None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:11.048037 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da284291-5dd6-4033-a838-a49d018c505b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:11.050852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 197/407] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:10 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:11.051823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da284291-5dd6-4033-a838-a49d018c505b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:11.151557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5efdb-b6c7-430d-8d3b-e19f5d5972a3 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:11.166668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da284291-5dd6-4033-a838-a49d018c505b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:11.200712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a2f37-d903-472c-b6ca-82740b951a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:11.201622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a2f37-d903-472c-b6ca-82740b951a66 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:11.202321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a2f37-d903-472c-b6ca-82740b951a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:11.202610 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a2f37-d903-472c-b6ca-82740b951a66 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:11.204170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a2f37-d903-472c-b6ca-82740b951a66 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:11.205655 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a2f37-d903-472c-b6ca-82740b951a66 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:11.206989 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f867146-1db4-46ca-8349-b7ea49d29041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:11.207632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 211/408] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:11 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:11.208106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f867146-1db4-46ca-8349-b7ea49d29041 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:11.208417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a2f37-d903-472c-b6ca-82740b951a66 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:11.209365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f867146-1db4-46ca-8349-b7ea49d29041 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:11.209819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f867146-1db4-46ca-8349-b7ea49d29041 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:11.221641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f867146-1db4-46ca-8349-b7ea49d29041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5f867146-1db4-46ca-8349-b7ea49d29041 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:11.227447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:11.228528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:11.229385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:11.229385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:11.229385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:11.229385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:11.229385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:11.229385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:11.229385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:11.229385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:11.229385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:11.229385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:11.229385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:11.229385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:11.236580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 198/409] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:11.237622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f867146-1db4-46ca-8349-b7ea49d29041 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:11.239621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:11.304220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:11.329097 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a2f37-d903-472c-b6ca-82740b951a66 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:11.371266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5ace8-fa4b-4171-8859-f1780870b183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:11.372291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5ace8-fa4b-4171-8859-f1780870b183 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:11.372834 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5ace8-fa4b-4171-8859-f1780870b183 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:11.373396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5ace8-fa4b-4171-8859-f1780870b183 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5/groups/0aa58b745d4c492884d92dbc93201d8e/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:11.375664 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5ace8-fa4b-4171-8859-f1780870b183 None admin] RBAC: Authorizing `identity:create_grant(project_id=feb8ee130f7146d1b534f60a9a8a05c5, group_id=0aa58b745d4c492884d92dbc93201d8e, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:11.377419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5ace8-fa4b-4171-8859-f1780870b183 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:11.379126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f867146-1db4-46ca-8349-b7ea49d29041 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:11.403292 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 212/410] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 27 16:21:11 2022] PUT /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5/groups/0aa58b745d4c492884d92dbc93201d8e/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:11.404779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5ace8-fa4b-4171-8859-f1780870b183 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:11.423939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661988bc-55f6-4255-86b6-8e335b07aa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:11.423939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661988bc-55f6-4255-86b6-8e335b07aa65 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:11.423939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661988bc-55f6-4255-86b6-8e335b07aa65 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:11.423939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661988bc-55f6-4255-86b6-8e335b07aa65 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5/groups/0aa58b745d4c492884d92dbc93201d8e/roles/84e73bacaaef4e4ab018e94824f9d891` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:11.424367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661988bc-55f6-4255-86b6-8e335b07aa65 None admin] RBAC: Authorizing `identity:create_grant(project_id=feb8ee130f7146d1b534f60a9a8a05c5, group_id=0aa58b745d4c492884d92dbc93201d8e, role_id=84e73bacaaef4e4ab018e94824f9d891)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:11.424367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661988bc-55f6-4255-86b6-8e335b07aa65 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:11.439954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 199/411] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 27 16:21:11 2022] PUT /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5/groups/0aa58b745d4c492884d92dbc93201d8e/roles/84e73bacaaef4e4ab018e94824f9d891 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:11.553348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:11.560047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5ace8-fa4b-4171-8859-f1780870b183 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:11.619318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d55b35-e0ab-4aaa-aa29-01811ddaedac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:11.620282 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d55b35-e0ab-4aaa-aa29-01811ddaedac None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:11.620720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d55b35-e0ab-4aaa-aa29-01811ddaedac None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:11.621165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d55b35-e0ab-4aaa-aa29-01811ddaedac None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:11.622105 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d55b35-e0ab-4aaa-aa29-01811ddaedac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:11.622574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d55b35-e0ab-4aaa-aa29-01811ddaedac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:11.624209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d55b35-e0ab-4aaa-aa29-01811ddaedac None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:11.635359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 213/412] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:11.641453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661988bc-55f6-4255-86b6-8e335b07aa65 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:11.763573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661988bc-55f6-4255-86b6-8e335b07aa65 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:11.771841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:11.806994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca59b19-9155-49f5-8cfe-888b1c1bc387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:11.807656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca59b19-9155-49f5-8cfe-888b1c1bc387 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:11.807960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca59b19-9155-49f5-8cfe-888b1c1bc387 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:11.808239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca59b19-9155-49f5-8cfe-888b1c1bc387 None admin] PATH_INFO: `/v3/groups/2b82ee8645284245bc74aea9c44f85a5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:11.812660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca59b19-9155-49f5-8cfe-888b1c1bc387 None admin] RBAC: Authorizing `identity:get_group(group_id=2b82ee8645284245bc74aea9c44f85a5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:11.814073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca59b19-9155-49f5-8cfe-888b1c1bc387 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:11.816067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 200/413] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:11 2022] GET /identity/v3/groups/2b82ee8645284245bc74aea9c44f85a5 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:11.821232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d55b35-e0ab-4aaa-aa29-01811ddaedac None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:11.840667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c045-b1f0-46b7-b69b-4e18d144af9c None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:11.840966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c045-b1f0-46b7-b69b-4e18d144af9c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:11.841228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c045-b1f0-46b7-b69b-4e18d144af9c None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:11.842816 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 201/414] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:21:11.848639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087212d-d2d8-41bf-8776-b8c936187dde None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:11.848926 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087212d-d2d8-41bf-8776-b8c936187dde None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:11.849877 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087212d-d2d8-41bf-8776-b8c936187dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:11.883152 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-8087212d-d2d8-41bf-8776-b8c936187dde None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:11.884363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8087212d-d2d8-41bf-8776-b8c936187dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:12.010951 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d55b35-e0ab-4aaa-aa29-01811ddaedac None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:12.011571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 202/415] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:12.047924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087212d-d2d8-41bf-8776-b8c936187dde None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:12.051674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e0d65-cc94-4068-89aa-28f7baa34999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:12.057902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e0d65-cc94-4068-89aa-28f7baa34999 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:12.059903 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e0d65-cc94-4068-89aa-28f7baa34999 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:12.060608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e0d65-cc94-4068-89aa-28f7baa34999 None admin] PATH_INFO: `/v3/projects/8fe6d635a22f4f83acd22dcb2e804bfc` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:12.064115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e0d65-cc94-4068-89aa-28f7baa34999 None admin] RBAC: Authorizing `identity:get_project(project_id=8fe6d635a22f4f83acd22dcb2e804bfc)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:12.066106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e0d65-cc94-4068-89aa-28f7baa34999 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:12.070500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 214/416] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:11 2022] GET /identity/v3/projects/8fe6d635a22f4f83acd22dcb2e804bfc => generated 344 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:12.076806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e0d65-cc94-4068-89aa-28f7baa34999 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:12.111298 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:12.227726 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087212d-d2d8-41bf-8776-b8c936187dde None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:12.236853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:12.254085 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e0d65-cc94-4068-89aa-28f7baa34999 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:12.274656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02808cb2-4db3-4b38-aecb-c24e458dea44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:12.275667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02808cb2-4db3-4b38-aecb-c24e458dea44 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:12.276199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02808cb2-4db3-4b38-aecb-c24e458dea44 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:12.276678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02808cb2-4db3-4b38-aecb-c24e458dea44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:12.289098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02808cb2-4db3-4b38-aecb-c24e458dea44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-02808cb2-4db3-4b38-aecb-c24e458dea44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:12.295249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:12.296187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:12.296991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:12.296991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:12.296991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:12.296991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:12.296991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:12.296991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:12.296991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:12.296991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:12.296991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:12.296991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:12.296991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:12.296991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:12.300070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 203/417] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:12.305658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02808cb2-4db3-4b38-aecb-c24e458dea44 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:12.332954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af64488-20b2-4bd4-8ccf-ab60dea37ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:12.334224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af64488-20b2-4bd4-8ccf-ab60dea37ba2 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:12.334733 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af64488-20b2-4bd4-8ccf-ab60dea37ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:12.335285 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af64488-20b2-4bd4-8ccf-ab60dea37ba2 None admin] PATH_INFO: `/v3/projects/8fe6d635a22f4f83acd22dcb2e804bfc/groups/2b82ee8645284245bc74aea9c44f85a5/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:12.337519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af64488-20b2-4bd4-8ccf-ab60dea37ba2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8fe6d635a22f4f83acd22dcb2e804bfc, group_id=2b82ee8645284245bc74aea9c44f85a5, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:12.339358 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af64488-20b2-4bd4-8ccf-ab60dea37ba2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:12.357442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 215/418] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 27 16:21:12 2022] PUT /identity/v3/projects/8fe6d635a22f4f83acd22dcb2e804bfc/groups/2b82ee8645284245bc74aea9c44f85a5/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:12.359285 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd3632-d681-40be-a9aa-0bd5cf209802 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:12.359788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd3632-d681-40be-a9aa-0bd5cf209802 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:12.360337 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd3632-d681-40be-a9aa-0bd5cf209802 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:12.362356 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 216/419] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:12.375904 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801d3f5-5096-4b80-94bd-5b95b6175cfc None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:12.376607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801d3f5-5096-4b80-94bd-5b95b6175cfc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:12.377097 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801d3f5-5096-4b80-94bd-5b95b6175cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:12.422399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a801d3f5-5096-4b80-94bd-5b95b6175cfc None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:12.425723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a801d3f5-5096-4b80-94bd-5b95b6175cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:12.501359 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02808cb2-4db3-4b38-aecb-c24e458dea44 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:12.547844 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44b59c-5d94-4116-9915-cc7cac8d0fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:12.549466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44b59c-5d94-4116-9915-cc7cac8d0fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:12.550015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44b59c-5d94-4116-9915-cc7cac8d0fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:12.550692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44b59c-5d94-4116-9915-cc7cac8d0fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:12.552630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44b59c-5d94-4116-9915-cc7cac8d0fd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:12.553257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44b59c-5d94-4116-9915-cc7cac8d0fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:12.554855 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44b59c-5d94-4116-9915-cc7cac8d0fd7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:12.556682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 217/420] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:12.564256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 204/421] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:21:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:12.570446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801d3f5-5096-4b80-94bd-5b95b6175cfc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:12.579939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:12.586599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44b59c-5d94-4116-9915-cc7cac8d0fd7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:12.628422 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:12.736368 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801d3f5-5096-4b80-94bd-5b95b6175cfc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:12.778951 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc80f-dbcd-4d07-a2a3-804fa9d0cd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:12.779729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc80f-dbcd-4d07-a2a3-804fa9d0cd10 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:12.780039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc80f-dbcd-4d07-a2a3-804fa9d0cd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:12.780316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc80f-dbcd-4d07-a2a3-804fa9d0cd10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:12.790080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44b59c-5d94-4116-9915-cc7cac8d0fd7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:12.863933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc80f-dbcd-4d07-a2a3-804fa9d0cd10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:12.866697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc80f-dbcd-4d07-a2a3-804fa9d0cd10 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:12.875900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:12.904570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04326a6-7fb8-40b8-a44b-56e7a9b16b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:12.905225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04326a6-7fb8-40b8-a44b-56e7a9b16b04 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:12.905507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04326a6-7fb8-40b8-a44b-56e7a9b16b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:12.905779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04326a6-7fb8-40b8-a44b-56e7a9b16b04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:12.944108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04326a6-7fb8-40b8-a44b-56e7a9b16b04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-b04326a6-7fb8-40b8-a44b-56e7a9b16b04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:12.949559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:12.950468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:12.951276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:12.951276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:12.951276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:12.951276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:12.951276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:12.951276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:12.951276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:12.951276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:12.951276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:12.951276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:12.951276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:12.951276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:12.960334 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 205/422] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:21:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:12.968250 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04326a6-7fb8-40b8-a44b-56e7a9b16b04 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:12.980553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 218/423] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 16:21:12.986291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc80f-dbcd-4d07-a2a3-804fa9d0cd10 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:13.139804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:13.164302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc80f-dbcd-4d07-a2a3-804fa9d0cd10 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:13.167659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04326a6-7fb8-40b8-a44b-56e7a9b16b04 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:13.176286 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:13.230865 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a88e4f-d247-4b54-94b6-647b54c1d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:13.231514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a88e4f-d247-4b54-94b6-647b54c1d73a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:13.231797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a88e4f-d247-4b54-94b6-647b54c1d73a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:13.232096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a88e4f-d247-4b54-94b6-647b54c1d73a None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:13.234959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac506e9-74cb-40f9-8181-fcb2fba5c09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:13.235585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac506e9-74cb-40f9-8181-fcb2fba5c09b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:13.235896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac506e9-74cb-40f9-8181-fcb2fba5c09b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:13.236150 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac506e9-74cb-40f9-8181-fcb2fba5c09b None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:13.237203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a88e4f-d247-4b54-94b6-647b54c1d73a None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:13.238658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a88e4f-d247-4b54-94b6-647b54c1d73a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:13.241123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 219/424] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:12 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:13.241375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac506e9-74cb-40f9-8181-fcb2fba5c09b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:13.241689 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac506e9-74cb-40f9-8181-fcb2fba5c09b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:13.243039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac506e9-74cb-40f9-8181-fcb2fba5c09b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:13.249820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a88e4f-d247-4b54-94b6-647b54c1d73a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:13.258347 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 206/425] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:13.263850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac506e9-74cb-40f9-8181-fcb2fba5c09b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:13.417761 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac506e9-74cb-40f9-8181-fcb2fba5c09b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:13.446669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a88e4f-d247-4b54-94b6-647b54c1d73a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:13.481616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a629778-225c-4998-a5cd-38102351e652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:13.482243 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a629778-225c-4998-a5cd-38102351e652 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:13.482522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a629778-225c-4998-a5cd-38102351e652 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:13.482795 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a629778-225c-4998-a5cd-38102351e652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:13.509880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82948ef7-bceb-4764-8a11-fe32cddba06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:13.510537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82948ef7-bceb-4764-8a11-fe32cddba06f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:13.510820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82948ef7-bceb-4764-8a11-fe32cddba06f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:13.511097 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82948ef7-bceb-4764-8a11-fe32cddba06f None admin] PATH_INFO: `/v3/groups/0aa58b745d4c492884d92dbc93201d8e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:13.513128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82948ef7-bceb-4764-8a11-fe32cddba06f None admin] RBAC: Authorizing `identity:get_group(group_id=0aa58b745d4c492884d92dbc93201d8e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:13.514580 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82948ef7-bceb-4764-8a11-fe32cddba06f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:13.517496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 220/426] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:13 2022] GET /identity/v3/groups/0aa58b745d4c492884d92dbc93201d8e => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:13.523177 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:13.528912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82948ef7-bceb-4764-8a11-fe32cddba06f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:13.605546 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:13.613312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a629778-225c-4998-a5cd-38102351e652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:13.615406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a629778-225c-4998-a5cd-38102351e652 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:13.691365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82948ef7-bceb-4764-8a11-fe32cddba06f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:13.728284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985588e-7cba-4731-8edb-ff63a3e99e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:13.728904 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985588e-7cba-4731-8edb-ff63a3e99e80 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:13.729185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985588e-7cba-4731-8edb-ff63a3e99e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:13.729460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985588e-7cba-4731-8edb-ff63a3e99e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:13.730245 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985588e-7cba-4731-8edb-ff63a3e99e80 None admin] RBAC: Adding query filter params (group.id=0aa58b745d4c492884d92dbc93201d8e, role.id=19570429b77848d998cb882f8b16aa76, scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:13.730555 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985588e-7cba-4731-8edb-ff63a3e99e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:13.732010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985588e-7cba-4731-8edb-ff63a3e99e80 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:13.743203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 221/427] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 16:21:13 2022] GET /identity/v3/role_assignments?group.id=0aa58b745d4c492884d92dbc93201d8e&scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd&role.id=19570429b77848d998cb882f8b16aa76 => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:13.747180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699ba69-0128-4b53-8eb5-db1498694a97 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:13.747471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699ba69-0128-4b53-8eb5-db1498694a97 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:13.747749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699ba69-0128-4b53-8eb5-db1498694a97 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:13.749563 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 222/428] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:13.757459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012626f-de33-4cf0-afa7-8a80686c99df None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:13.757767 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012626f-de33-4cf0-afa7-8a80686c99df None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:13.758019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012626f-de33-4cf0-afa7-8a80686c99df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:13.795886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 207/429] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 16:21:13.796074 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b012626f-de33-4cf0-afa7-8a80686c99df None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:13.796074 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b012626f-de33-4cf0-afa7-8a80686c99df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:13.805005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a629778-225c-4998-a5cd-38102351e652 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:13.905384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 223/430] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:13.921050 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6640ac-94fe-475f-89fc-c654f7a2549f None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:13.921357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6640ac-94fe-475f-89fc-c654f7a2549f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:13.923007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:13.924021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6640ac-94fe-475f-89fc-c654f7a2549f None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:13.930890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 224/431] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:13.931972 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6640ac-94fe-475f-89fc-c654f7a2549f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:13.983778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:13.996537 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a629778-225c-4998-a5cd-38102351e652 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:14.036175 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480d53b-fe22-4df6-bb28-2db7945cd6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:14.037626 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d53b-fe22-4df6-bb28-2db7945cd6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:14.038069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d53b-fe22-4df6-bb28-2db7945cd6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:14.038507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d53b-fe22-4df6-bb28-2db7945cd6a6 None admin] PATH_INFO: `/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:14.039700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480d53b-fe22-4df6-bb28-2db7945cd6a6 None admin] RBAC: Authorizing `identity:get_project(project_id=a5026856c5ec49ea9b8ef8af75a466dd)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:14.041184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480d53b-fe22-4df6-bb28-2db7945cd6a6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:14.043025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 208/432] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:13 2022] GET /identity/v3/projects/a5026856c5ec49ea9b8ef8af75a466dd => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:14.044007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418336c-dab4-4578-aa75-90b5d5ecc877 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:14.044300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418336c-dab4-4578-aa75-90b5d5ecc877 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:14.044742 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418336c-dab4-4578-aa75-90b5d5ecc877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:14.065670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6640ac-94fe-475f-89fc-c654f7a2549f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:14.070281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b418336c-dab4-4578-aa75-90b5d5ecc877 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:14.071471 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b418336c-dab4-4578-aa75-90b5d5ecc877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:14.124302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e279a-b950-4fed-9ec8-2e15692f0747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:14.124961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e279a-b950-4fed-9ec8-2e15692f0747 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:14.125246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e279a-b950-4fed-9ec8-2e15692f0747 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:14.125522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e279a-b950-4fed-9ec8-2e15692f0747 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:14.139355 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e279a-b950-4fed-9ec8-2e15692f0747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-811e279a-b950-4fed-9ec8-2e15692f0747 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:14.147134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:14.148250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:14.149051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:14.149051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:14.149051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:14.149051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:14.149051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:14.149051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:14.149051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:14.149051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:14.149051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:14.149051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:14.149051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 16:21:14.149051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:14.149051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 225/433] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:14.149730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e279a-b950-4fed-9ec8-2e15692f0747 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:14.164958 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 209/434] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:14.165834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418336c-dab4-4578-aa75-90b5d5ecc877 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:14.232249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:14.285982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:14.293037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e279a-b950-4fed-9ec8-2e15692f0747 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:14.301559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418336c-dab4-4578-aa75-90b5d5ecc877 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:14.334094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce9e83-7940-4fe0-9a20-cef7f2084065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:14.334736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce9e83-7940-4fe0-9a20-cef7f2084065 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:14.335021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce9e83-7940-4fe0-9a20-cef7f2084065 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:14.335289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce9e83-7940-4fe0-9a20-cef7f2084065 None admin] PATH_INFO: `/v3/groups/0aa58b745d4c492884d92dbc93201d8e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:14.336502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce9e83-7940-4fe0-9a20-cef7f2084065 None admin] RBAC: Authorizing `identity:get_group(group_id=0aa58b745d4c492884d92dbc93201d8e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:14.337133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e0888-7241-4702-8a04-3b87d65d69cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:14.337760 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0888-7241-4702-8a04-3b87d65d69cd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:14.337925 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce9e83-7940-4fe0-9a20-cef7f2084065 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:14.338076 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0888-7241-4702-8a04-3b87d65d69cd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:14.338318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0888-7241-4702-8a04-3b87d65d69cd None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:14.339036 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e0888-7241-4702-8a04-3b87d65d69cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:14.339345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e0888-7241-4702-8a04-3b87d65d69cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:14.339495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 226/435] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:14 2022] GET /identity/v3/groups/0aa58b745d4c492884d92dbc93201d8e => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:14.340721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e0888-7241-4702-8a04-3b87d65d69cd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:14.344963 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce9e83-7940-4fe0-9a20-cef7f2084065 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:14.356091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 210/436] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:21:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:14.356091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e0888-7241-4702-8a04-3b87d65d69cd None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:14.452878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce9e83-7940-4fe0-9a20-cef7f2084065 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:14.463376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e0888-7241-4702-8a04-3b87d65d69cd None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:14.473570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:14.499183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cf521-cfc8-4433-b644-9f3ca021bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:14.499477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbe426-a55c-4616-b4b7-33c5862d5864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:14.499808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cf521-cfc8-4433-b644-9f3ca021bdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:14.500128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cf521-cfc8-4433-b644-9f3ca021bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:14.500324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbe426-a55c-4616-b4b7-33c5862d5864 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:14.500428 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cf521-cfc8-4433-b644-9f3ca021bdf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:14.500615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbe426-a55c-4616-b4b7-33c5862d5864 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:14.500882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbe426-a55c-4616-b4b7-33c5862d5864 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:14.501175 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cf521-cfc8-4433-b644-9f3ca021bdf7 None admin] RBAC: Adding query filter params (group.id=0aa58b745d4c492884d92dbc93201d8e, role.id=84e73bacaaef4e4ab018e94824f9d891, scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:14.501487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cf521-cfc8-4433-b644-9f3ca021bdf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:14.502923 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cf521-cfc8-4433-b644-9f3ca021bdf7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:14.520128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 211/437] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 16:21:14 2022] GET /identity/v3/role_assignments?group.id=0aa58b745d4c492884d92dbc93201d8e&scope.project.id=a5026856c5ec49ea9b8ef8af75a466dd&role.id=84e73bacaaef4e4ab018e94824f9d891 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:14.520128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cf521-cfc8-4433-b644-9f3ca021bdf7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:14.520393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbe426-a55c-4616-b4b7-33c5862d5864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:14.520393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-01fbe426-a55c-4616-b4b7-33c5862d5864 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:14.520393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:14.520393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:14.520393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:14.520393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:14.520393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:14.520393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:14.520393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:14.520393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:14.520393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:14.520393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:14.520393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:14.521657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:14.522516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 227/438] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:21:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:14.526000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbe426-a55c-4616-b4b7-33c5862d5864 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:14.557551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:14.656758 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cf521-cfc8-4433-b644-9f3ca021bdf7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:14.678041 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbe426-a55c-4616-b4b7-33c5862d5864 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:14.706103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5a112-79ef-4bb2-b562-a1968fce9ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:14.706740 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5a112-79ef-4bb2-b562-a1968fce9ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:14.707025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5a112-79ef-4bb2-b562-a1968fce9ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:14.707299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5a112-79ef-4bb2-b562-a1968fce9ae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:14.721637 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae304b7-c229-42b2-bc21-712843ebc2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:14.722268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae304b7-c229-42b2-bc21-712843ebc2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:14.722551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae304b7-c229-42b2-bc21-712843ebc2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:14.722825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae304b7-c229-42b2-bc21-712843ebc2a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:14.723554 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae304b7-c229-42b2-bc21-712843ebc2a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:14.724443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae304b7-c229-42b2-bc21-712843ebc2a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:14.726383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae304b7-c229-42b2-bc21-712843ebc2a7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:14.737133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 228/439] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:14.742738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae304b7-c229-42b2-bc21-712843ebc2a7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:14.764876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:14.802688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5a112-79ef-4bb2-b562-a1968fce9ae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:14.804406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5a112-79ef-4bb2-b562-a1968fce9ae8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:14.850889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:14.872615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae304b7-c229-42b2-bc21-712843ebc2a7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:14.916764 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97421f5-1482-4d97-b1ee-3312baa02ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:14.918084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97421f5-1482-4d97-b1ee-3312baa02ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:14.918239 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97421f5-1482-4d97-b1ee-3312baa02ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:14.918521 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97421f5-1482-4d97-b1ee-3312baa02ce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:14.923327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 212/440] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:14.924804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d38f21-514c-4b98-bd9d-e10f04c7d7e4 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:14.925101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d38f21-514c-4b98-bd9d-e10f04c7d7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:14.925380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d38f21-514c-4b98-bd9d-e10f04c7d7e4 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:14.926771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 213/441] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:14.929561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d38f21-514c-4b98-bd9d-e10f04c7d7e4 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:14.987042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97421f5-1482-4d97-b1ee-3312baa02ce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:14.988540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97421f5-1482-4d97-b1ee-3312baa02ce6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:15.002781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:15.034847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d38f21-514c-4b98-bd9d-e10f04c7d7e4 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:15.067352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e7ad2-8c73-4e79-9c7f-aa79649d5cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:15.068176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e7ad2-8c73-4e79-9c7f-aa79649d5cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:15.068459 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e7ad2-8c73-4e79-9c7f-aa79649d5cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:15.068733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e7ad2-8c73-4e79-9c7f-aa79649d5cf2 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:15.069902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e7ad2-8c73-4e79-9c7f-aa79649d5cf2 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:15.071316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e7ad2-8c73-4e79-9c7f-aa79649d5cf2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:15.072284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:15.073070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 214/442] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:14 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:15.074387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b7833-d975-4aba-aa78-918801332e6e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:15.074647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b7833-d975-4aba-aa78-918801332e6e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:15.074922 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b7833-d975-4aba-aa78-918801332e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:15.093161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 229/443] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 16:21:15.093161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97421f5-1482-4d97-b1ee-3312baa02ce6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:15.093424 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c84b7833-d975-4aba-aa78-918801332e6e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:15.093803 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c84b7833-d975-4aba-aa78-918801332e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:15.158981 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 215/444] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:15.159739 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b7833-d975-4aba-aa78-918801332e6e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:15.194014 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97421f5-1482-4d97-b1ee-3312baa02ce6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:15.228152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97e17d-ac98-4a2e-94bc-561e985c1764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:15.228500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:15.228785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97e17d-ac98-4a2e-94bc-561e985c1764 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:15.229073 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97e17d-ac98-4a2e-94bc-561e985c1764 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:15.229347 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97e17d-ac98-4a2e-94bc-561e985c1764 None admin] PATH_INFO: `/v3/groups/0aa58b745d4c492884d92dbc93201d8e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:15.230658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97e17d-ac98-4a2e-94bc-561e985c1764 None admin] RBAC: Authorizing `identity:get_group(group_id=0aa58b745d4c492884d92dbc93201d8e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:15.232161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97e17d-ac98-4a2e-94bc-561e985c1764 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:15.233761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 230/445] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:15 2022] GET /identity/v3/groups/0aa58b745d4c492884d92dbc93201d8e => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:15.234528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97e17d-ac98-4a2e-94bc-561e985c1764 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:15.259744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b7833-d975-4aba-aa78-918801332e6e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:15.292496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d73d46-a6f4-482b-aa18-8cbad6c0eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:15.292674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:15.293146 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d73d46-a6f4-482b-aa18-8cbad6c0eec9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:15.293432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d73d46-a6f4-482b-aa18-8cbad6c0eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:15.293710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d73d46-a6f4-482b-aa18-8cbad6c0eec9 None admin] PATH_INFO: `/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:15.294941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d73d46-a6f4-482b-aa18-8cbad6c0eec9 None admin] RBAC: Authorizing `identity:get_project(project_id=feb8ee130f7146d1b534f60a9a8a05c5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:15.296419 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d73d46-a6f4-482b-aa18-8cbad6c0eec9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:15.298086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 216/446] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:15 2022] GET /identity/v3/projects/feb8ee130f7146d1b534f60a9a8a05c5 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:15.298846 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d73d46-a6f4-482b-aa18-8cbad6c0eec9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:15.337616 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97e17d-ac98-4a2e-94bc-561e985c1764 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:15.372032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393265c-5174-4a0f-bcc9-e2ae112da17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:15.372660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393265c-5174-4a0f-bcc9-e2ae112da17a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:15.372941 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393265c-5174-4a0f-bcc9-e2ae112da17a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:15.373211 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393265c-5174-4a0f-bcc9-e2ae112da17a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:15.383039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393265c-5174-4a0f-bcc9-e2ae112da17a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-5393265c-5174-4a0f-bcc9-e2ae112da17a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:15.388052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:15.389114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:15.390150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:15.390150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:15.390150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:15.390150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:15.390150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:15.390150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:15.390150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:15.390150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:15.390150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:15.390150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:15.390150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:15.390150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:15.394238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 231/447] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:15.394919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393265c-5174-4a0f-bcc9-e2ae112da17a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:15.409301 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d73d46-a6f4-482b-aa18-8cbad6c0eec9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:15.443237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5fe64-53f4-4d9c-8d08-82de21073b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:15.443848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5fe64-53f4-4d9c-8d08-82de21073b26 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:15.444155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5fe64-53f4-4d9c-8d08-82de21073b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:15.444428 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5fe64-53f4-4d9c-8d08-82de21073b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:15.445203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5fe64-53f4-4d9c-8d08-82de21073b26 None admin] RBAC: Adding query filter params (group.id=0aa58b745d4c492884d92dbc93201d8e, role.id=19570429b77848d998cb882f8b16aa76, scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:15.445515 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5fe64-53f4-4d9c-8d08-82de21073b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:15.446925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5fe64-53f4-4d9c-8d08-82de21073b26 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:15.452492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 217/448] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 16:21:15 2022] GET /identity/v3/role_assignments?group.id=0aa58b745d4c492884d92dbc93201d8e&scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5&role.id=19570429b77848d998cb882f8b16aa76 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:15.453260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5fe64-53f4-4d9c-8d08-82de21073b26 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:15.455684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:15.501575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393265c-5174-4a0f-bcc9-e2ae112da17a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:15.519276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:15.543004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e4763-f3e9-45eb-9423-f86624b4b110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:15.543670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e4763-f3e9-45eb-9423-f86624b4b110 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:15.543986 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e4763-f3e9-45eb-9423-f86624b4b110 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:15.544282 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e4763-f3e9-45eb-9423-f86624b4b110 None admin] PATH_INFO: `/v3/groups/0aa58b745d4c492884d92dbc93201d8e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:15.545924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e4763-f3e9-45eb-9423-f86624b4b110 None admin] RBAC: Authorizing `identity:get_group(group_id=0aa58b745d4c492884d92dbc93201d8e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:15.547386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e4763-f3e9-45eb-9423-f86624b4b110 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:15.549261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 232/449] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:15 2022] GET /identity/v3/groups/0aa58b745d4c492884d92dbc93201d8e => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:15.555315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e4763-f3e9-45eb-9423-f86624b4b110 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:15.593902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5fe64-53f4-4d9c-8d08-82de21073b26 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:15.639888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28949f-44aa-41e2-9c4f-bac4c2f188b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:15.640545 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28949f-44aa-41e2-9c4f-bac4c2f188b5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:15.640835 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28949f-44aa-41e2-9c4f-bac4c2f188b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:15.641110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28949f-44aa-41e2-9c4f-bac4c2f188b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:15.641969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28949f-44aa-41e2-9c4f-bac4c2f188b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:15.642161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28949f-44aa-41e2-9c4f-bac4c2f188b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:15.643487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28949f-44aa-41e2-9c4f-bac4c2f188b5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:15.656059 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 218/450] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:15.661958 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28949f-44aa-41e2-9c4f-bac4c2f188b5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:15.688356 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e4763-f3e9-45eb-9423-f86624b4b110 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:15.729456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770496c-7538-42b4-8e05-36cd449649ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:15.730082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770496c-7538-42b4-8e05-36cd449649ce None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:15.730365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770496c-7538-42b4-8e05-36cd449649ce None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:15.731907 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770496c-7538-42b4-8e05-36cd449649ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:15.731907 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770496c-7538-42b4-8e05-36cd449649ce None admin] RBAC: Adding query filter params (group.id=0aa58b745d4c492884d92dbc93201d8e, role.id=84e73bacaaef4e4ab018e94824f9d891, scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:15.731907 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770496c-7538-42b4-8e05-36cd449649ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:15.734287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770496c-7538-42b4-8e05-36cd449649ce None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:15.737158 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:15.743912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 233/451] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 16:21:15 2022] GET /identity/v3/role_assignments?group.id=0aa58b745d4c492884d92dbc93201d8e&scope.project.id=feb8ee130f7146d1b534f60a9a8a05c5&role.id=84e73bacaaef4e4ab018e94824f9d891 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:15.789951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28949f-44aa-41e2-9c4f-bac4c2f188b5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:15.829263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc465c-1916-44cf-9e90-6174edc5f437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:15.829913 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc465c-1916-44cf-9e90-6174edc5f437 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:15.830197 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc465c-1916-44cf-9e90-6174edc5f437 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:15.830478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc465c-1916-44cf-9e90-6174edc5f437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:15.905837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc465c-1916-44cf-9e90-6174edc5f437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:15.907279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc465c-1916-44cf-9e90-6174edc5f437 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:15.968130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:16.007583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 219/452] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 16:21:16.013081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770496c-7538-42b4-8e05-36cd449649ce None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:16.060989 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:16.114751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770496c-7538-42b4-8e05-36cd449649ce None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:16.147797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6854535-4716-4468-b221-fddb1e6ec8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:16.148465 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6854535-4716-4468-b221-fddb1e6ec8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:16.148752 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6854535-4716-4468-b221-fddb1e6ec8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:16.149029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6854535-4716-4468-b221-fddb1e6ec8c6 None admin] PATH_INFO: `/v3/projects/8fe6d635a22f4f83acd22dcb2e804bfc` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:16.150181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6854535-4716-4468-b221-fddb1e6ec8c6 None admin] RBAC: Authorizing `identity:get_project(project_id=8fe6d635a22f4f83acd22dcb2e804bfc)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:16.151608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6854535-4716-4468-b221-fddb1e6ec8c6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:16.153298 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 234/453] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:21:16 2022] GET /identity/v3/projects/8fe6d635a22f4f83acd22dcb2e804bfc => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:16.158931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc465c-1916-44cf-9e90-6174edc5f437 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:16.254367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc465c-1916-44cf-9e90-6174edc5f437 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:16.286881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640f791-8a42-4728-8211-a7bcaf6291e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:16.287502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f791-8a42-4728-8211-a7bcaf6291e7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:16.287781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f791-8a42-4728-8211-a7bcaf6291e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:16.288078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f791-8a42-4728-8211-a7bcaf6291e7 None admin] PATH_INFO: `/v3/groups/2b82ee8645284245bc74aea9c44f85a5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:16.289209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640f791-8a42-4728-8211-a7bcaf6291e7 None admin] RBAC: Authorizing `identity:get_group(group_id=2b82ee8645284245bc74aea9c44f85a5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:16.290619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640f791-8a42-4728-8211-a7bcaf6291e7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:16.292202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 220/454] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 16:21:16 2022] GET /identity/v3/groups/2b82ee8645284245bc74aea9c44f85a5 => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:16.297837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6854535-4716-4468-b221-fddb1e6ec8c6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:16.395490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6854535-4716-4468-b221-fddb1e6ec8c6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:16.409059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:16.429875 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5c743-553f-46f8-b242-d778193bbc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:16.430476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5c743-553f-46f8-b242-d778193bbc9d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:16.430761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5c743-553f-46f8-b242-d778193bbc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:16.431038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5c743-553f-46f8-b242-d778193bbc9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:16.431817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5c743-553f-46f8-b242-d778193bbc9d None admin] RBAC: Adding query filter params (group.id=2b82ee8645284245bc74aea9c44f85a5, role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=8fe6d635a22f4f83acd22dcb2e804bfc) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:16.432165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5c743-553f-46f8-b242-d778193bbc9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:16.433586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5c743-553f-46f8-b242-d778193bbc9d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:16.439216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 235/455] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 16:21:16 2022] GET /identity/v3/role_assignments?group.id=2b82ee8645284245bc74aea9c44f85a5&scope.project.id=8fe6d635a22f4f83acd22dcb2e804bfc&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:19.045084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9a0e3-d946-46ad-9ba9-fb22fedbc7e7 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:19.045610 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9a0e3-d946-46ad-9ba9-fb22fedbc7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:19.045610 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9a0e3-d946-46ad-9ba9-fb22fedbc7e7 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:19.047274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 221/456] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:19.053054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509b8b-d722-4ca7-9734-55d7511ef6b7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:19.053524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509b8b-d722-4ca7-9734-55d7511ef6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:19.053602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509b8b-d722-4ca7-9734-55d7511ef6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:19.080901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-86509b8b-d722-4ca7-9734-55d7511ef6b7 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:19.082111 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-86509b8b-d722-4ca7-9734-55d7511ef6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:19.173243 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 236/457] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:19.203639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57817f72-17fc-4a26-bb6f-dd625843b568 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:19.203963 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57817f72-17fc-4a26-bb6f-dd625843b568 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:19.204238 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57817f72-17fc-4a26-bb6f-dd625843b568 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:19.205860 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 222/458] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:19.209693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86509b8b-d722-4ca7-9734-55d7511ef6b7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:19.215150 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75015-dffb-4b75-a2ea-71f04d7809f4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:19.215711 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75015-dffb-4b75-a2ea-71f04d7809f4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:19.216225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75015-dffb-4b75-a2ea-71f04d7809f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:19.250467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f0c75015-dffb-4b75-a2ea-71f04d7809f4 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:19.252845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f0c75015-dffb-4b75-a2ea-71f04d7809f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:19.281130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:19.329241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 223/459] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:19.330448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b4e42-0c02-4d69-8129-8dd5302efb46 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:19.330905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b4e42-0c02-4d69-8129-8dd5302efb46 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:19.331352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b4e42-0c02-4d69-8129-8dd5302efb46 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:19.333012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 224/460] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:19.338355 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5e6fd-d7ae-4c2d-a23c-ea4669cb2bfb None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:19.338827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5e6fd-d7ae-4c2d-a23c-ea4669cb2bfb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:19.340157 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5e6fd-d7ae-4c2d-a23c-ea4669cb2bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:19.346361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86509b8b-d722-4ca7-9734-55d7511ef6b7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:19.361892 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:19.370116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-bed5e6fd-d7ae-4c2d-a23c-ea4669cb2bfb None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:19.371292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bed5e6fd-d7ae-4c2d-a23c-ea4669cb2bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:19.396666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059713c-523f-45ee-b9ab-a7536b6243da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:19.397801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059713c-523f-45ee-b9ab-a7536b6243da None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:19.398386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059713c-523f-45ee-b9ab-a7536b6243da None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:19.398828 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059713c-523f-45ee-b9ab-a7536b6243da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:19.412284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059713c-523f-45ee-b9ab-a7536b6243da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:19.414340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059713c-523f-45ee-b9ab-a7536b6243da None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-a059713c-523f-45ee-b9ab-a7536b6243da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:19.434785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:19.435742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:19.436645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:19.436645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:19.436645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:19.436645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:19.436645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 237/461] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:19.436928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059713c-523f-45ee-b9ab-a7536b6243da None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:19.460115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 225/462] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:19.461171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5e6fd-d7ae-4c2d-a23c-ea4669cb2bfb None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:19.564981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059713c-523f-45ee-b9ab-a7536b6243da None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:19.575950 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:19.587373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5e6fd-d7ae-4c2d-a23c-ea4669cb2bfb None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:19.605823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee6895-c047-454f-8bab-08716766f5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:19.606473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee6895-c047-454f-8bab-08716766f5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:19.606759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee6895-c047-454f-8bab-08716766f5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:19.607036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee6895-c047-454f-8bab-08716766f5f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:19.620257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee6895-c047-454f-8bab-08716766f5f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:19.621951 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee6895-c047-454f-8bab-08716766f5f1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:19.623012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ecf5c-dbbf-4534-a2ea-16eb2868584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:19.623651 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ecf5c-dbbf-4534-a2ea-16eb2868584f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:19.624030 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ecf5c-dbbf-4534-a2ea-16eb2868584f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:19.624312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ecf5c-dbbf-4534-a2ea-16eb2868584f None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:19.625014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ecf5c-dbbf-4534-a2ea-16eb2868584f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:19.625323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ecf5c-dbbf-4534-a2ea-16eb2868584f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:19.626682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ecf5c-dbbf-4534-a2ea-16eb2868584f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:19.638777 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 226/463] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:19.639619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ecf5c-dbbf-4534-a2ea-16eb2868584f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-1eee6895-c047-454f-8bab-08716766f5f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:19.641997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:19.642862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:19.643719 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:19.643719 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:19.643719 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:19.643719 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:19.644207 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 238/464] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:19.646174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ae899-4e8c-471b-be1b-00e12a6990e6 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:19.646568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ae899-4e8c-471b-be1b-00e12a6990e6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:19.646953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ae899-4e8c-471b-be1b-00e12a6990e6 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:19.649459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 239/465] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:19.649459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ae899-4e8c-471b-be1b-00e12a6990e6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:19.667407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:19.758442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ecf5c-dbbf-4534-a2ea-16eb2868584f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:19.761420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ae899-4e8c-471b-be1b-00e12a6990e6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:19.795993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df1931-3f53-4659-b633-fc98c66b20e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:19.796954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df1931-3f53-4659-b633-fc98c66b20e9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:19.797431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df1931-3f53-4659-b633-fc98c66b20e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:19.797782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df1931-3f53-4659-b633-fc98c66b20e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:19.798889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3f937-41fb-4dde-bea3-596545313937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:19.799553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3f937-41fb-4dde-bea3-596545313937 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:19.799898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3f937-41fb-4dde-bea3-596545313937 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:19.800224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3f937-41fb-4dde-bea3-596545313937 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:19.800943 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3f937-41fb-4dde-bea3-596545313937 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:19.802642 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3f937-41fb-4dde-bea3-596545313937 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:19.809740 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df1931-3f53-4659-b633-fc98c66b20e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:19.811405 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df1931-3f53-4659-b633-fc98c66b20e9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:19.825231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 240/466] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:21:19 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:21:19.826115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3f937-41fb-4dde-bea3-596545313937 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-25df1931-3f53-4659-b633-fc98c66b20e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:19.829149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:19.830065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:19.830952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:19.830952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:19.830952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:19.830952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:19.830952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 227/467] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:19.831596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f697a-2940-4182-b4de-ff79450478e6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:19.831895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f697a-2940-4182-b4de-ff79450478e6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:19.832175 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f697a-2940-4182-b4de-ff79450478e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:19.843150 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:19.856283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-441f697a-2940-4182-b4de-ff79450478e6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:19.858260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-441f697a-2940-4182-b4de-ff79450478e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:19.924495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:19.963886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 228/468] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:19.963886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f697a-2940-4182-b4de-ff79450478e6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:19.969112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3f937-41fb-4dde-bea3-596545313937 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:20.027002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffbc08-3176-4a45-a966-87e395f4f757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:20.027717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffbc08-3176-4a45-a966-87e395f4f757 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:20.028074 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffbc08-3176-4a45-a966-87e395f4f757 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:20.028440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffbc08-3176-4a45-a966-87e395f4f757 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:20.029181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffbc08-3176-4a45-a966-87e395f4f757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:20.029530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffbc08-3176-4a45-a966-87e395f4f757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:20.030953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffbc08-3176-4a45-a966-87e395f4f757 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:20.047522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 241/469] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:20.051919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffbc08-3176-4a45-a966-87e395f4f757 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:20.091899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f697a-2940-4182-b4de-ff79450478e6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:20.131005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f65a58-f889-4c8f-b6ab-686c3750af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:20.131553 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f65a58-f889-4c8f-b6ab-686c3750af4c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:20.131837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f65a58-f889-4c8f-b6ab-686c3750af4c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:20.132135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f65a58-f889-4c8f-b6ab-686c3750af4c None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:20.132831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f65a58-f889-4c8f-b6ab-686c3750af4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:20.133138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f65a58-f889-4c8f-b6ab-686c3750af4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:20.134498 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f65a58-f889-4c8f-b6ab-686c3750af4c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:20.135980 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:20.147503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 229/470] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:20.152207 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f65a58-f889-4c8f-b6ab-686c3750af4c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:20.177780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffbc08-3176-4a45-a966-87e395f4f757 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:20.209982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:20.219741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412943c-d30a-4ae5-8ae9-65e18abc8f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:20.220995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412943c-d30a-4ae5-8ae9-65e18abc8f1c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:20.221317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412943c-d30a-4ae5-8ae9-65e18abc8f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:20.221631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412943c-d30a-4ae5-8ae9-65e18abc8f1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:20.234530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412943c-d30a-4ae5-8ae9-65e18abc8f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:20.236629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412943c-d30a-4ae5-8ae9-65e18abc8f1c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-b412943c-d30a-4ae5-8ae9-65e18abc8f1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:20.253856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:20.254798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:20.255673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:20.255673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:20.255673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:20.255673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:20.255673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 242/471] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:20.256894 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212324c6-e99b-4bf6-af39-672e1dddf5e6 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:20.257179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212324c6-e99b-4bf6-af39-672e1dddf5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:20.257455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212324c6-e99b-4bf6-af39-672e1dddf5e6 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:20.263022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 243/472] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:20.263022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212324c6-e99b-4bf6-af39-672e1dddf5e6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:20.265703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f65a58-f889-4c8f-b6ab-686c3750af4c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:20.299362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b99c-67a5-4924-889b-e89ec066ef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:20.300019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b99c-67a5-4924-889b-e89ec066ef60 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:20.300305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b99c-67a5-4924-889b-e89ec066ef60 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:20.300581 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b99c-67a5-4924-889b-e89ec066ef60 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:20.301796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4b99c-67a5-4924-889b-e89ec066ef60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:20.303243 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4b99c-67a5-4924-889b-e89ec066ef60 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:20.324223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 230/473] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:21:20 2022] POST /identity/v3/users => generated 248 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:21:20.325332 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b99c-67a5-4924-889b-e89ec066ef60 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:20.395544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:20.413210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212324c6-e99b-4bf6-af39-672e1dddf5e6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:20.457229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b99c-67a5-4924-889b-e89ec066ef60 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:20.468147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ea695-82f6-417d-96f1-c7f19b4a6a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:20.468801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ea695-82f6-417d-96f1-c7f19b4a6a19 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:20.469588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ea695-82f6-417d-96f1-c7f19b4a6a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:20.469878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ea695-82f6-417d-96f1-c7f19b4a6a19 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:20.470860 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ea695-82f6-417d-96f1-c7f19b4a6a19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:20.473484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ea695-82f6-417d-96f1-c7f19b4a6a19 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:20.507542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33e1ec-b381-4968-8f10-d92c41a3e63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:20.508231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 244/474] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:21:20 2022] POST /identity/v3/users => generated 248 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:21:20.508367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33e1ec-b381-4968-8f10-d92c41a3e63c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:20.508589 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33e1ec-b381-4968-8f10-d92c41a3e63c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:20.508873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33e1ec-b381-4968-8f10-d92c41a3e63c None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:20.509517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c7ebe-4bf6-4984-9c02-95b77ad41140 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:20.509621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33e1ec-b381-4968-8f10-d92c41a3e63c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:20.509812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c7ebe-4bf6-4984-9c02-95b77ad41140 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:20.509904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33e1ec-b381-4968-8f10-d92c41a3e63c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:20.510091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c7ebe-4bf6-4984-9c02-95b77ad41140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:20.511242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33e1ec-b381-4968-8f10-d92c41a3e63c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:20.526245 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 231/475] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:20.533042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33e1ec-b381-4968-8f10-d92c41a3e63c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:20.539097 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-164c7ebe-4bf6-4984-9c02-95b77ad41140 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:20.540823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-164c7ebe-4bf6-4984-9c02-95b77ad41140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:20.593169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:20.657383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 245/476] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:20.666906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33e1ec-b381-4968-8f10-d92c41a3e63c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:20.678301 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:20.681638 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c7ebe-4bf6-4984-9c02-95b77ad41140 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:20.711733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d0168-b36e-407a-9efc-e5983ca4b143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:20.712817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d0168-b36e-407a-9efc-e5983ca4b143 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:20.713321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d0168-b36e-407a-9efc-e5983ca4b143 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:20.713799 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d0168-b36e-407a-9efc-e5983ca4b143 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:20.714681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d0168-b36e-407a-9efc-e5983ca4b143 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:20.716338 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d0168-b36e-407a-9efc-e5983ca4b143 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:20.745998 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 232/477] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:21:20 2022] POST /identity/v3/users => generated 249 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:21:20.811556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c7ebe-4bf6-4984-9c02-95b77ad41140 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:20.852569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0b5b3-5340-45e0-a7fb-7e347cc181e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:20.853562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0b5b3-5340-45e0-a7fb-7e347cc181e0 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:20.854041 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0b5b3-5340-45e0-a7fb-7e347cc181e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:20.854567 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0b5b3-5340-45e0-a7fb-7e347cc181e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:20.855612 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0b5b3-5340-45e0-a7fb-7e347cc181e0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:20.857317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0b5b3-5340-45e0-a7fb-7e347cc181e0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:20.866526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.sql.core [None req-7cb0b5b3-5340-45e0-a7fb-7e347cc181e0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 16:21:20.866526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 16:21:20.866526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [parameters: {'id': 'fe9dd5e0804349838e2ab06da46ee537', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 16:21:20.866526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80205) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-7cb0b5b3-5340-45e0-a7fb-7e347cc181e0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application conn.query(q) Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result.read() Jul 27 16:21:20.884652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return ref.to_dict() Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 16:21:20.885622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application next(self.gen) Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application yield resource Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application next(self.gen) Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise self.value Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application session.commit() Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 16:21:20.886560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.session.flush() Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application compat.raise_( Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 16:21:20.887416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 16:21:20.888341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application conn.query(q) Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application result.read() Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 16:21:20.890691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [parameters: {'id': 'fe9dd5e0804349838e2ab06da46ee537', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:20.892687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 16:21:20.894766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:20.898957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 246/478] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 27 16:21:20 2022] POST /identity/v3/roles => generated 144 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:20.905118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d0168-b36e-407a-9efc-e5983ca4b143 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:21.023092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d0168-b36e-407a-9efc-e5983ca4b143 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:21.059441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c69f06-3a60-41e8-a865-e0762b4f0282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:21.060152 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c69f06-3a60-41e8-a865-e0762b4f0282 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:21.060435 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c69f06-3a60-41e8-a865-e0762b4f0282 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:21.060716 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c69f06-3a60-41e8-a865-e0762b4f0282 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:21.071977 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c69f06-3a60-41e8-a865-e0762b4f0282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-a8c69f06-3a60-41e8-a865-e0762b4f0282 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:21.077607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:21.078518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:21.079320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:21.079320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:21.079320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:21.079320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:21.079320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:21.079320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:21.079320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:21.079320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:21.079320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:21.079320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:21.079320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 16:21:21.079320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:21.079320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 233/479] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:21:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:21.086323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0b5b3-5340-45e0-a7fb-7e347cc181e0 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:21.138715 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:21.222071 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0b5b3-5340-45e0-a7fb-7e347cc181e0 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:21.258594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b17de7-a32e-4972-b6aa-7704438b1a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:21.259561 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b17de7-a32e-4972-b6aa-7704438b1a11 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:21.260103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b17de7-a32e-4972-b6aa-7704438b1a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:21.260582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b17de7-a32e-4972-b6aa-7704438b1a11 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:21.261512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b17de7-a32e-4972-b6aa-7704438b1a11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:21.262049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b17de7-a32e-4972-b6aa-7704438b1a11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:21.263608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b17de7-a32e-4972-b6aa-7704438b1a11 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:21.272741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 247/480] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:22.194571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d50e5-b7f2-4764-9dd9-d500b9b19265 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:22.195119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d50e5-b7f2-4764-9dd9-d500b9b19265 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:22.195119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d50e5-b7f2-4764-9dd9-d500b9b19265 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:22.196729 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 234/481] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:22.202090 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0117b-56f4-4278-b8b2-93ef7dcbb0c0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:22.202381 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0117b-56f4-4278-b8b2-93ef7dcbb0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:22.202661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0117b-56f4-4278-b8b2-93ef7dcbb0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:22.232963 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-66f0117b-56f4-4278-b8b2-93ef7dcbb0c0 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:22.234192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-66f0117b-56f4-4278-b8b2-93ef7dcbb0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:22.334255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 248/482] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:21:22.367871 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d50e5-b7f2-4764-9dd9-d500b9b19265 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:22.417794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:22.525121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d50e5-b7f2-4764-9dd9-d500b9b19265 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:22.571383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af47508-fd01-45af-b497-069220d33538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:22.572074 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af47508-fd01-45af-b497-069220d33538 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:22.572362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af47508-fd01-45af-b497-069220d33538 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:22.572638 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af47508-fd01-45af-b497-069220d33538 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:22.586991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af47508-fd01-45af-b497-069220d33538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5af47508-fd01-45af-b497-069220d33538 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:22.591993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:22.592879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:22.593694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:22.593694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:22.593694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:22.593694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:22.593694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:22.593694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:22.593694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:22.593694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:22.593694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:22.593694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:22.593694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:22.593694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:22.593694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 235/483] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:22.599363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0117b-56f4-4278-b8b2-93ef7dcbb0c0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:22.650341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:22.771369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0117b-56f4-4278-b8b2-93ef7dcbb0c0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:22.823016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3bfc4-0cf6-40a6-a3b4-ab4174005284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:22.823570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3bfc4-0cf6-40a6-a3b4-ab4174005284 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:22.823870 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3bfc4-0cf6-40a6-a3b4-ab4174005284 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:22.824155 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3bfc4-0cf6-40a6-a3b4-ab4174005284 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:22.824886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3bfc4-0cf6-40a6-a3b4-ab4174005284 None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:22.825198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3bfc4-0cf6-40a6-a3b4-ab4174005284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:22.826588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3bfc4-0cf6-40a6-a3b4-ab4174005284 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:22.840127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 249/484] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:22.845180 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af47508-fd01-45af-b497-069220d33538 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:22.937584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa73174-ca45-4e92-8ed3-960e451d70b8 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:22.937904 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa73174-ca45-4e92-8ed3-960e451d70b8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:22.938156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa73174-ca45-4e92-8ed3-960e451d70b8 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:22.940496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 250/485] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:21:22.949148 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa2939-1cce-44e5-a20f-6c429f743eec None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:22.949444 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa2939-1cce-44e5-a20f-6c429f743eec None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:22.949731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa2939-1cce-44e5-a20f-6c429f743eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:22.975916 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af47508-fd01-45af-b497-069220d33538 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:22.979170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:22.983771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0ffa2939-1cce-44e5-a20f-6c429f743eec None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:22.985915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0ffa2939-1cce-44e5-a20f-6c429f743eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:23.039005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698ccd2-ab27-447a-b995-ee72e255000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:23.039657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698ccd2-ab27-447a-b995-ee72e255000a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:23.039989 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698ccd2-ab27-447a-b995-ee72e255000a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:23.040268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698ccd2-ab27-447a-b995-ee72e255000a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:23.053727 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698ccd2-ab27-447a-b995-ee72e255000a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:23.055181 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698ccd2-ab27-447a-b995-ee72e255000a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-4698ccd2-ab27-447a-b995-ee72e255000a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:23.082935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:23.083827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:23.084720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:23.084720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:23.084720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:23.084720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:23.087051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 236/486] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:23.097133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698ccd2-ab27-447a-b995-ee72e255000a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:23.120060 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 251/487] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:23.143230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa2939-1cce-44e5-a20f-6c429f743eec None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:23.159578 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:23.267431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa2939-1cce-44e5-a20f-6c429f743eec None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:23.293023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698ccd2-ab27-447a-b995-ee72e255000a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:23.309651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7e4a0-a2b6-430b-89da-fd3f667b9d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:23.310637 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7e4a0-a2b6-430b-89da-fd3f667b9d9a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:23.311082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7e4a0-a2b6-430b-89da-fd3f667b9d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:23.311759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7e4a0-a2b6-430b-89da-fd3f667b9d9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:23.326775 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7e4a0-a2b6-430b-89da-fd3f667b9d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:23.329910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfad9e-323a-421e-a202-8ebcfdc81787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:23.330642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfad9e-323a-421e-a202-8ebcfdc81787 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:23.331029 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfad9e-323a-421e-a202-8ebcfdc81787 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:23.331427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfad9e-323a-421e-a202-8ebcfdc81787 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:23.332885 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfad9e-323a-421e-a202-8ebcfdc81787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:23.333513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfad9e-323a-421e-a202-8ebcfdc81787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-ffa7e4a0-a2b6-430b-89da-fd3f667b9d9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:23.334015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:23.335138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:23.336180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:23.336180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:23.336180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:23.336180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:23.336180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:23.336180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:23.336180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:23.336180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:23.336180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:23.336180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:23.336180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:23.336180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:23.337529 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfad9e-323a-421e-a202-8ebcfdc81787 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:23.338664 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 252/488] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:23.340993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2de060-0d9f-4f77-97e0-bb3cecd0fc15 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:23.341430 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2de060-0d9f-4f77-97e0-bb3cecd0fc15 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:23.341869 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2de060-0d9f-4f77-97e0-bb3cecd0fc15 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:23.343395 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 253/489] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:23.348840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:23.349607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2de060-0d9f-4f77-97e0-bb3cecd0fc15 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:23.354640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 237/490] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:23.356153 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6509de-45c7-4dba-bcb4-497996d8ed0e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:23.356548 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6509de-45c7-4dba-bcb4-497996d8ed0e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:23.356967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6509de-45c7-4dba-bcb4-497996d8ed0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:23.378788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ec6509de-45c7-4dba-bcb4-497996d8ed0e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:23.380981 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ec6509de-45c7-4dba-bcb4-497996d8ed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:23.433961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:23.459882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 238/491] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:23.459882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cd763-5be3-4846-a863-b80da01b29bb None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:23.459882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cd763-5be3-4846-a863-b80da01b29bb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:23.459882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cd763-5be3-4846-a863-b80da01b29bb None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:23.459882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 239/492] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:23.459882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cd763-5be3-4846-a863-b80da01b29bb None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:23.478513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2de060-0d9f-4f77-97e0-bb3cecd0fc15 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:23.514712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a333292-3a52-4135-8575-885eefe87c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:23.515375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333292-3a52-4135-8575-885eefe87c3b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:23.515668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333292-3a52-4135-8575-885eefe87c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:23.515974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333292-3a52-4135-8575-885eefe87c3b None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:23.516751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a333292-3a52-4135-8575-885eefe87c3b None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:23.517060 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a333292-3a52-4135-8575-885eefe87c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:23.518505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a333292-3a52-4135-8575-885eefe87c3b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:23.532976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 254/493] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:23.534313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf201e-177e-4dde-b32d-c9f53b85a2c8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:23.534608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf201e-177e-4dde-b32d-c9f53b85a2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:23.534884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf201e-177e-4dde-b32d-c9f53b85a2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:23.554967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d3cf201e-177e-4dde-b32d-c9f53b85a2c8 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:23.556182 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d3cf201e-177e-4dde-b32d-c9f53b85a2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:23.585348 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cd763-5be3-4846-a863-b80da01b29bb None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:23.617349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:23.635891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 255/494] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:23.636075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00d4bf-d8eb-4b5e-a2b2-a0e4d14056a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:23.636209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf201e-177e-4dde-b32d-c9f53b85a2c8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:23.636296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d4bf-d8eb-4b5e-a2b2-a0e4d14056a4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:23.636296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d4bf-d8eb-4b5e-a2b2-a0e4d14056a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:23.636296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d4bf-d8eb-4b5e-a2b2-a0e4d14056a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:23.645031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00d4bf-d8eb-4b5e-a2b2-a0e4d14056a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:23.646439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00d4bf-d8eb-4b5e-a2b2-a0e4d14056a4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-be00d4bf-d8eb-4b5e-a2b2-a0e4d14056a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:23.665866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:23.666822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:23.667775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:23.667775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:23.667775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:23.667775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:23.667775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:23.667775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:23.667775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:23.667775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:23.667775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:21:23.667775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:23.667775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 240/495] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 16:21:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:23.668626 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00d4bf-d8eb-4b5e-a2b2-a0e4d14056a4 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:23.709272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:23.744613 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf201e-177e-4dde-b32d-c9f53b85a2c8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:23.778605 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00d4bf-d8eb-4b5e-a2b2-a0e4d14056a4 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:23.782594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c7ac4-4786-4b92-b767-b35171955afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:23.783237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c7ac4-4786-4b92-b767-b35171955afe None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:23.783522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c7ac4-4786-4b92-b767-b35171955afe None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:23.783801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c7ac4-4786-4b92-b767-b35171955afe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:23.795458 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c7ac4-4786-4b92-b767-b35171955afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-a89c7ac4-4786-4b92-b767-b35171955afe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:23.800471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:23.802504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 256/496] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:23.804210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c7ac4-4786-4b92-b767-b35171955afe None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:23.819627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c9884-e9c6-440d-854a-f7b1a4ebc7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:23.820438 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c9884-e9c6-440d-854a-f7b1a4ebc7ee None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:23.820819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c9884-e9c6-440d-854a-f7b1a4ebc7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:23.821193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c9884-e9c6-440d-854a-f7b1a4ebc7ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:23.832365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c9884-e9c6-440d-854a-f7b1a4ebc7ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:23.833822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c9884-e9c6-440d-854a-f7b1a4ebc7ee None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-ed8c9884-e9c6-440d-854a-f7b1a4ebc7ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:23.849513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:23.850535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:23.856201 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:23.856201 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:23.856201 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:23.856201 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:23.856201 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 241/497] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:23.856201 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c9884-e9c6-440d-854a-f7b1a4ebc7ee None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:23.896495 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:23.923613 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c7ac4-4786-4b92-b767-b35171955afe None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:23.951199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:23.961932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c9884-e9c6-440d-854a-f7b1a4ebc7ee None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:23.963592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba26439-ddec-4f55-9d1b-7364e7be0240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:23.965242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba26439-ddec-4f55-9d1b-7364e7be0240 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:23.965612 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba26439-ddec-4f55-9d1b-7364e7be0240 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:23.965970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba26439-ddec-4f55-9d1b-7364e7be0240 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:23.979175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba26439-ddec-4f55-9d1b-7364e7be0240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-8ba26439-ddec-4f55-9d1b-7364e7be0240 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:23.985592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:23.986667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:23.987673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:23.987673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:23.987673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:23.987673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:23.987673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:23.987673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:23.987673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:23.987673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:23.987673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:23.987673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:23.987673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:23.987673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:23.988362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 257/498] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:23.989941 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba26439-ddec-4f55-9d1b-7364e7be0240 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:24.005867 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb090700-5a1e-4db5-9df5-4848fa67cec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:24.006528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb090700-5a1e-4db5-9df5-4848fa67cec9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:24.006775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb090700-5a1e-4db5-9df5-4848fa67cec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:24.007054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb090700-5a1e-4db5-9df5-4848fa67cec9 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:24.007889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb090700-5a1e-4db5-9df5-4848fa67cec9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:24.008191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb090700-5a1e-4db5-9df5-4848fa67cec9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:24.009608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb090700-5a1e-4db5-9df5-4848fa67cec9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:24.047575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 242/499] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 16:21:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:24.048673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb090700-5a1e-4db5-9df5-4848fa67cec9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:24.093782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba26439-ddec-4f55-9d1b-7364e7be0240 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:24.127181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59453e-aec6-456f-b4d5-e53b0b901a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:24.127725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59453e-aec6-456f-b4d5-e53b0b901a9d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:24.128038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59453e-aec6-456f-b4d5-e53b0b901a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:24.128314 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59453e-aec6-456f-b4d5-e53b0b901a9d None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:24.129064 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59453e-aec6-456f-b4d5-e53b0b901a9d None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:24.129371 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59453e-aec6-456f-b4d5-e53b0b901a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:24.130851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59453e-aec6-456f-b4d5-e53b0b901a9d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:24.138871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 258/500] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:24.139652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59453e-aec6-456f-b4d5-e53b0b901a9d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:24.148377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:24.152183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb090700-5a1e-4db5-9df5-4848fa67cec9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:24.186922 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a578849-8f30-460c-b182-8e10f57e4f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:24.187619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a578849-8f30-460c-b182-8e10f57e4f71 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:24.187950 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a578849-8f30-460c-b182-8e10f57e4f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:24.188234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a578849-8f30-460c-b182-8e10f57e4f71 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:24.188581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:24.188925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a578849-8f30-460c-b182-8e10f57e4f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:24.189578 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a578849-8f30-460c-b182-8e10f57e4f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:24.190964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a578849-8f30-460c-b182-8e10f57e4f71 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:24.202448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 243/501] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:24.203743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841746c7-b61d-49d8-89e1-c75c44e88a93 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:24.204159 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841746c7-b61d-49d8-89e1-c75c44e88a93 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:24.204541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841746c7-b61d-49d8-89e1-c75c44e88a93 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:24.210378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 244/502] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:24.211152 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841746c7-b61d-49d8-89e1-c75c44e88a93 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:24.241952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59453e-aec6-456f-b4d5-e53b0b901a9d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:24.275513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81333b-9a7f-45f5-8f53-baaee22201fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:24.276165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81333b-9a7f-45f5-8f53-baaee22201fb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:24.276436 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81333b-9a7f-45f5-8f53-baaee22201fb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:24.276715 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81333b-9a7f-45f5-8f53-baaee22201fb None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:24.277441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81333b-9a7f-45f5-8f53-baaee22201fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:24.277754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81333b-9a7f-45f5-8f53-baaee22201fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:24.279128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81333b-9a7f-45f5-8f53-baaee22201fb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:24.287535 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 259/503] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:24.288362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81333b-9a7f-45f5-8f53-baaee22201fb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:24.311749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841746c7-b61d-49d8-89e1-c75c44e88a93 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:24.346548 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91baae5-50ea-4f82-b96d-2f2d1eaba954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:24.347168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91baae5-50ea-4f82-b96d-2f2d1eaba954 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:24.347452 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91baae5-50ea-4f82-b96d-2f2d1eaba954 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:24.347776 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91baae5-50ea-4f82-b96d-2f2d1eaba954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:24.374973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:24.389823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81333b-9a7f-45f5-8f53-baaee22201fb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:24.400783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:24.416544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91baae5-50ea-4f82-b96d-2f2d1eaba954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:24.418054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91baae5-50ea-4f82-b96d-2f2d1eaba954 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:24.424214 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e8b47-c03e-4200-af47-2212ed00f283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:24.424856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e8b47-c03e-4200-af47-2212ed00f283 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:24.425144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e8b47-c03e-4200-af47-2212ed00f283 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:24.425425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e8b47-c03e-4200-af47-2212ed00f283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:24.435953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e8b47-c03e-4200-af47-2212ed00f283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:24.437390 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e8b47-c03e-4200-af47-2212ed00f283 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-418e8b47-c03e-4200-af47-2212ed00f283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:24.451935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:24.452795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:24.453656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:24.453656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:24.453656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:24.453656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:24.453656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 260/504] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:24.453929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e8b47-c03e-4200-af47-2212ed00f283 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:24.518795 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 245/505] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:24.520382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5729c1-0f07-4d72-b680-e9308d64d9a7 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:24.520670 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5729c1-0f07-4d72-b680-e9308d64d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:24.520947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5729c1-0f07-4d72-b680-e9308d64d9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:24.538159 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-db5729c1-0f07-4d72-b680-e9308d64d9a7 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:24.539333 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-db5729c1-0f07-4d72-b680-e9308d64d9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:24.554127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e8b47-c03e-4200-af47-2212ed00f283 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:24.587960 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cb81b-b248-4093-ab68-a151d954e458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:24.588596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cb81b-b248-4093-ab68-a151d954e458 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:24.588884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cb81b-b248-4093-ab68-a151d954e458 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:24.589159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cb81b-b248-4093-ab68-a151d954e458 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:24.592061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:24.596789 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cb81b-b248-4093-ab68-a151d954e458 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:24.598269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cb81b-b248-4093-ab68-a151d954e458 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:24.606271 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 246/506] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:24.616560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5729c1-0f07-4d72-b680-e9308d64d9a7 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e72cb81b-b248-4093-ab68-a151d954e458 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:24.616652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:24.617509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:24.618409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:24.618409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:24.618409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:24.618409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:24.618409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:24.618409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:24.618409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:24.618409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:24.618409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:21:24.618409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:24.618409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 261/507] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:24.618409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cb81b-b248-4093-ab68-a151d954e458 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:24.643010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:24.719236 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cb81b-b248-4093-ab68-a151d954e458 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:24.720877 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5729c1-0f07-4d72-b680-e9308d64d9a7 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:24.752924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee6a7c-fba0-4f22-b095-ef52528ef778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:24.753098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b191b3-b203-43c9-94ac-7216ba01bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:24.753542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6a7c-fba0-4f22-b095-ef52528ef778 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:24.753708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b191b3-b203-43c9-94ac-7216ba01bfaa None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:24.753828 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6a7c-fba0-4f22-b095-ef52528ef778 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:24.754525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b191b3-b203-43c9-94ac-7216ba01bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:24.754712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6a7c-fba0-4f22-b095-ef52528ef778 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:24.754915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b191b3-b203-43c9-94ac-7216ba01bfaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:24.755410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee6a7c-fba0-4f22-b095-ef52528ef778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:24.755720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee6a7c-fba0-4f22-b095-ef52528ef778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:24.757150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee6a7c-fba0-4f22-b095-ef52528ef778 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:24.764563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b191b3-b203-43c9-94ac-7216ba01bfaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:24.766002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b191b3-b203-43c9-94ac-7216ba01bfaa None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:24.769742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 262/508] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:24.770932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee6a7c-fba0-4f22-b095-ef52528ef778 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d2b191b3-b203-43c9-94ac-7216ba01bfaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:24.781228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:24.782220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:24.783101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:24.783101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:24.783101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:24.783101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:24.783101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 247/509] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:24.783101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b191b3-b203-43c9-94ac-7216ba01bfaa None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:24.823813 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:24.853859 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:24.872530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee6a7c-fba0-4f22-b095-ef52528ef778 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:24.880991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b191b3-b203-43c9-94ac-7216ba01bfaa None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:24.906278 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b32f1e-8f70-4a9e-9d6c-232c722df850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:24.906853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b32f1e-8f70-4a9e-9d6c-232c722df850 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:24.907148 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b32f1e-8f70-4a9e-9d6c-232c722df850 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:24.907428 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b32f1e-8f70-4a9e-9d6c-232c722df850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:24.915088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e348c-c03a-48e9-904e-ac076c66ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:24.915703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e348c-c03a-48e9-904e-ac076c66ef8f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:24.916020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e348c-c03a-48e9-904e-ac076c66ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:24.916309 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e348c-c03a-48e9-904e-ac076c66ef8f None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:24.917100 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e348c-c03a-48e9-904e-ac076c66ef8f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:24.917411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e348c-c03a-48e9-904e-ac076c66ef8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:24.918556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b32f1e-8f70-4a9e-9d6c-232c722df850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:24.918848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e348c-c03a-48e9-904e-ac076c66ef8f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:24.920038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b32f1e-8f70-4a9e-9d6c-232c722df850 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-87b32f1e-8f70-4a9e-9d6c-232c722df850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:24.934564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:24.935449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:24.936635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:24.936635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:24.936635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:24.936635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:24.936635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 263/510] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:24.937003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 248/511] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 27 16:21:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:24.937072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b32f1e-8f70-4a9e-9d6c-232c722df850 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:24.937145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e348c-c03a-48e9-904e-ac076c66ef8f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:25.032890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:25.037066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e348c-c03a-48e9-904e-ac076c66ef8f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:25.045278 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b32f1e-8f70-4a9e-9d6c-232c722df850 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:25.070596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4005a8-1e28-4584-9a31-9ef7c013c8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:25.071228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4005a8-1e28-4584-9a31-9ef7c013c8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:25.071507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4005a8-1e28-4584-9a31-9ef7c013c8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:25.071779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4005a8-1e28-4584-9a31-9ef7c013c8b2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:25.078787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed8925-4506-4cc5-8fad-c676b9b88821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:25.078945 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4005a8-1e28-4584-9a31-9ef7c013c8b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:25.079425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed8925-4506-4cc5-8fad-c676b9b88821 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:25.079712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed8925-4506-4cc5-8fad-c676b9b88821 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:25.080021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed8925-4506-4cc5-8fad-c676b9b88821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:25.080301 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4005a8-1e28-4584-9a31-9ef7c013c8b2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:25.081920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:25.092005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed8925-4506-4cc5-8fad-c676b9b88821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-ee4005a8-1e28-4584-9a31-9ef7c013c8b2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:25.092637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:25.093672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:25.094566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:25.094566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:25.094566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:25.094566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:25.094566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:25.094566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:25.094566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:25.094566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:25.094566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 16:21:25.094566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:25.095596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed8925-4506-4cc5-8fad-c676b9b88821 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:25.095991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 249/512] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:25.095991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4005a8-1e28-4584-9a31-9ef7c013c8b2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-cbed8925-4506-4cc5-8fad-c676b9b88821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:25.112067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:25.113124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:25.118906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:25.118906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:25.118906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:25.118906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:25.118906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 264/513] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:25.118906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed8925-4506-4cc5-8fad-c676b9b88821 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:25.199994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4005a8-1e28-4584-9a31-9ef7c013c8b2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:25.213147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed8925-4506-4cc5-8fad-c676b9b88821 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:25.233095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c54be-5f01-4e80-9b9b-00c94997da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:25.233709 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c54be-5f01-4e80-9b9b-00c94997da06 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:25.233997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c54be-5f01-4e80-9b9b-00c94997da06 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:25.234279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c54be-5f01-4e80-9b9b-00c94997da06 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:25.234967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c54be-5f01-4e80-9b9b-00c94997da06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:25.235273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c54be-5f01-4e80-9b9b-00c94997da06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:25.236656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c54be-5f01-4e80-9b9b-00c94997da06 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:25.245668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca87d3-3eb3-43ee-abfd-a2cadc92bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:25.246273 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca87d3-3eb3-43ee-abfd-a2cadc92bc94 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:25.246554 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca87d3-3eb3-43ee-abfd-a2cadc92bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:25.246828 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca87d3-3eb3-43ee-abfd-a2cadc92bc94 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:25.247507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca87d3-3eb3-43ee-abfd-a2cadc92bc94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:25.247811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca87d3-3eb3-43ee-abfd-a2cadc92bc94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:25.248040 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 250/514] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:25.248838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c54be-5f01-4e80-9b9b-00c94997da06 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:25.249265 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca87d3-3eb3-43ee-abfd-a2cadc92bc94 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:25.264056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 265/515] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:25.265057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca87d3-3eb3-43ee-abfd-a2cadc92bc94 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:25.267674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:25.311955 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:25.350811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c54be-5f01-4e80-9b9b-00c94997da06 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:25.365551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca87d3-3eb3-43ee-abfd-a2cadc92bc94 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:25.384730 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d26812-d358-4ddb-b12e-d6d093c82014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:25.385350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d26812-d358-4ddb-b12e-d6d093c82014 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:25.385630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d26812-d358-4ddb-b12e-d6d093c82014 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:25.385905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d26812-d358-4ddb-b12e-d6d093c82014 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:25.399084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2804e-9135-4b40-bec5-fe6ecea5ca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:25.399705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2804e-9135-4b40-bec5-fe6ecea5ca2c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:25.400018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2804e-9135-4b40-bec5-fe6ecea5ca2c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:25.400296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2804e-9135-4b40-bec5-fe6ecea5ca2c None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:25.401079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2804e-9135-4b40-bec5-fe6ecea5ca2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:25.401391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2804e-9135-4b40-bec5-fe6ecea5ca2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:25.402833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2804e-9135-4b40-bec5-fe6ecea5ca2c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:25.440431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 266/516] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 27 16:21:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:25.441250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2804e-9135-4b40-bec5-fe6ecea5ca2c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:25.452413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d26812-d358-4ddb-b12e-d6d093c82014 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:25.453850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d26812-d358-4ddb-b12e-d6d093c82014 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:25.471873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:25.548115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2804e-9135-4b40-bec5-fe6ecea5ca2c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:25.551187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:25.558654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 251/517] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:25.559493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d26812-d358-4ddb-b12e-d6d093c82014 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:25.583593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af423601-9bfb-4a20-8831-9cb94edf3205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:25.584232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af423601-9bfb-4a20-8831-9cb94edf3205 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:25.584520 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af423601-9bfb-4a20-8831-9cb94edf3205 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:25.584796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af423601-9bfb-4a20-8831-9cb94edf3205 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:25.585478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af423601-9bfb-4a20-8831-9cb94edf3205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:25.585780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af423601-9bfb-4a20-8831-9cb94edf3205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:25.587151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af423601-9bfb-4a20-8831-9cb94edf3205 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:25.599200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 267/518] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:25.600052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af423601-9bfb-4a20-8831-9cb94edf3205 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:25.661661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d26812-d358-4ddb-b12e-d6d093c82014 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:25.678697 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:25.695998 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a475a18-bbb7-4bc4-9239-21b47e09ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:25.696633 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a475a18-bbb7-4bc4-9239-21b47e09ecc9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:25.696915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a475a18-bbb7-4bc4-9239-21b47e09ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:25.697195 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a475a18-bbb7-4bc4-9239-21b47e09ecc9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:25.702837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af423601-9bfb-4a20-8831-9cb94edf3205 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:25.704077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a475a18-bbb7-4bc4-9239-21b47e09ecc9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:25.705534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a475a18-bbb7-4bc4-9239-21b47e09ecc9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5a475a18-bbb7-4bc4-9239-21b47e09ecc9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:25.717773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:25.718677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:25.719579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:25.719579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:25.719579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:25.719579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:25.719579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:25.719579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:25.719579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:25.719579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:25.719579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 16:21:25.719579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:25.719579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 252/519] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:25.720161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a475a18-bbb7-4bc4-9239-21b47e09ecc9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:25.742695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31791a16-793c-4881-9fd4-c16391e214ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:25.743340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31791a16-793c-4881-9fd4-c16391e214ab None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:25.743626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31791a16-793c-4881-9fd4-c16391e214ab None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:25.743935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31791a16-793c-4881-9fd4-c16391e214ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:25.750544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31791a16-793c-4881-9fd4-c16391e214ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:25.752034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31791a16-793c-4881-9fd4-c16391e214ab None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-31791a16-793c-4881-9fd4-c16391e214ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:25.764653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:25.765509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:25.766609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:25.766609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:25.766609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:25.766609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:25.766609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:25.766609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:25.766609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:25.766609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:25.766609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 268/520] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:25.766609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31791a16-793c-4881-9fd4-c16391e214ab None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:25.795811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:25.824943 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a475a18-bbb7-4bc4-9239-21b47e09ecc9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:25.860024 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c39d03-9a04-4d9b-8a00-f64ef0db6207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:25.860641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c39d03-9a04-4d9b-8a00-f64ef0db6207 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:25.860930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c39d03-9a04-4d9b-8a00-f64ef0db6207 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:25.861211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c39d03-9a04-4d9b-8a00-f64ef0db6207 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:25.871243 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31791a16-793c-4881-9fd4-c16391e214ab None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:25.906045 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55831b-46c8-42f5-ab2e-8d1d4f3f893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:25.906500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:25.906684 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55831b-46c8-42f5-ab2e-8d1d4f3f893d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:25.906970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55831b-46c8-42f5-ab2e-8d1d4f3f893d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:25.907251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55831b-46c8-42f5-ab2e-8d1d4f3f893d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:25.918852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55831b-46c8-42f5-ab2e-8d1d4f3f893d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:25.920360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55831b-46c8-42f5-ab2e-8d1d4f3f893d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:25.931890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c39d03-9a04-4d9b-8a00-f64ef0db6207 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:25.933328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c39d03-9a04-4d9b-8a00-f64ef0db6207 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-5f55831b-46c8-42f5-ab2e-8d1d4f3f893d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:25.934477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:25.935333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:25.936229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:25.936229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:25.936229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:25.936229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:25.936229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 269/521] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:25.936503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55831b-46c8-42f5-ab2e-8d1d4f3f893d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:26.013938 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:26.035744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 253/522] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:26.036738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c39d03-9a04-4d9b-8a00-f64ef0db6207 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:26.037929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55831b-46c8-42f5-ab2e-8d1d4f3f893d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:26.072130 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb077b4-9a39-4793-9a9a-d48af6e11887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:26.072747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb077b4-9a39-4793-9a9a-d48af6e11887 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:26.073034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb077b4-9a39-4793-9a9a-d48af6e11887 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:26.073322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb077b4-9a39-4793-9a9a-d48af6e11887 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:26.074344 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb077b4-9a39-4793-9a9a-d48af6e11887 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:26.075799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb077b4-9a39-4793-9a9a-d48af6e11887 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:26.096746 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 270/523] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:21:25 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:21:26.098082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb077b4-9a39-4793-9a9a-d48af6e11887 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:26.127598 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:26.155242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c39d03-9a04-4d9b-8a00-f64ef0db6207 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:26.194304 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059ddf4-a3c2-4e68-b036-2664eea6a419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:26.194940 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059ddf4-a3c2-4e68-b036-2664eea6a419 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:26.195227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059ddf4-a3c2-4e68-b036-2664eea6a419 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:26.195508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059ddf4-a3c2-4e68-b036-2664eea6a419 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:26.196362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059ddf4-a3c2-4e68-b036-2664eea6a419 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:26.196673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059ddf4-a3c2-4e68-b036-2664eea6a419 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:26.198132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059ddf4-a3c2-4e68-b036-2664eea6a419 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:26.223274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 254/524] 10.222.0.67 () {56 vars in 1139 bytes} [Wed Jul 27 16:21:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:26.223274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059ddf4-a3c2-4e68-b036-2664eea6a419 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:26.229402 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb077b4-9a39-4793-9a9a-d48af6e11887 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:26.264692 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:26.273622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d97ba-1b37-486a-b326-9cea6a25460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:26.274551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d97ba-1b37-486a-b326-9cea6a25460e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:26.275415 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d97ba-1b37-486a-b326-9cea6a25460e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:26.275415 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d97ba-1b37-486a-b326-9cea6a25460e None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:26.275903 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d97ba-1b37-486a-b326-9cea6a25460e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:26.276477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d97ba-1b37-486a-b326-9cea6a25460e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:26.277930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d97ba-1b37-486a-b326-9cea6a25460e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:26.298411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 271/525] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:26.299264 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d97ba-1b37-486a-b326-9cea6a25460e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:26.337544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059ddf4-a3c2-4e68-b036-2664eea6a419 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:26.376002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260887e2-0033-472b-a765-d59dfe610dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:26.376669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260887e2-0033-472b-a765-d59dfe610dfe None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:26.376904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260887e2-0033-472b-a765-d59dfe610dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:26.377457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260887e2-0033-472b-a765-d59dfe610dfe None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:26.378154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260887e2-0033-472b-a765-d59dfe610dfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:26.378462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260887e2-0033-472b-a765-d59dfe610dfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:26.380190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260887e2-0033-472b-a765-d59dfe610dfe None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:26.382547 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:26.392406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 255/526] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:26.393304 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260887e2-0033-472b-a765-d59dfe610dfe None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:26.420256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d97ba-1b37-486a-b326-9cea6a25460e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:26.459229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a330a-49b2-40b7-957b-95cd190d027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:26.459901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a330a-49b2-40b7-957b-95cd190d027e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:26.460190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a330a-49b2-40b7-957b-95cd190d027e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:26.460704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a330a-49b2-40b7-957b-95cd190d027e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:26.471236 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a330a-49b2-40b7-957b-95cd190d027e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:26.472782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a330a-49b2-40b7-957b-95cd190d027e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-3c3a330a-49b2-40b7-957b-95cd190d027e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:26.489089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:26.490012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:26.490883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:26.490883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:26.490883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:26.490883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:26.495078 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 272/527] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:26.495788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a330a-49b2-40b7-957b-95cd190d027e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:26.505159 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260887e2-0033-472b-a765-d59dfe610dfe None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:26.541570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a015a3-59e6-40df-9a55-29bedeb0750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:26.542137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a015a3-59e6-40df-9a55-29bedeb0750f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:26.542427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a015a3-59e6-40df-9a55-29bedeb0750f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:26.542705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a015a3-59e6-40df-9a55-29bedeb0750f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:26.544756 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:26.603680 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a330a-49b2-40b7-957b-95cd190d027e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:26.609517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:26.616987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a015a3-59e6-40df-9a55-29bedeb0750f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:26.618601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a015a3-59e6-40df-9a55-29bedeb0750f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:26.641855 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05100cd2-db8d-42d8-a144-b65c2ff8b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:26.642483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05100cd2-db8d-42d8-a144-b65c2ff8b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:26.642770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05100cd2-db8d-42d8-a144-b65c2ff8b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:26.643051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05100cd2-db8d-42d8-a144-b65c2ff8b3a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:26.643851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05100cd2-db8d-42d8-a144-b65c2ff8b3a4 None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=9d5a8ef373ca4ed7bf31361e24e42e54) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:26.644192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05100cd2-db8d-42d8-a144-b65c2ff8b3a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:26.646379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05100cd2-db8d-42d8-a144-b65c2ff8b3a4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:26.655132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 273/528] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:26 2022] GET /identity/v3/role_assignments?user.id=9d5a8ef373ca4ed7bf31361e24e42e54&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:26.655841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05100cd2-db8d-42d8-a144-b65c2ff8b3a4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:26.760279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 256/529] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:26.761468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a015a3-59e6-40df-9a55-29bedeb0750f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:26.800259 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05100cd2-db8d-42d8-a144-b65c2ff8b3a4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:26.812331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:26.843270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2679f1-2699-4d99-88a6-0ef0fec3c363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:26.843958 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2679f1-2699-4d99-88a6-0ef0fec3c363 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:26.844252 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2679f1-2699-4d99-88a6-0ef0fec3c363 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:26.844530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2679f1-2699-4d99-88a6-0ef0fec3c363 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:26.854039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2679f1-2699-4d99-88a6-0ef0fec3c363 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:26.855799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2679f1-2699-4d99-88a6-0ef0fec3c363 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-9d2679f1-2699-4d99-88a6-0ef0fec3c363 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:26.868819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:26.869708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:26.870558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:26.870558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:26.870558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:26.870558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:26.870558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:26.870558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:26.870558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:26.870558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:26.873347 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 274/530] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:26.874430 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2679f1-2699-4d99-88a6-0ef0fec3c363 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:26.886567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a015a3-59e6-40df-9a55-29bedeb0750f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:26.888236 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:26.923025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687aecd-f9f7-45ec-874a-e957861629a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:26.923660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687aecd-f9f7-45ec-874a-e957861629a5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:26.923979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687aecd-f9f7-45ec-874a-e957861629a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:26.924269 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687aecd-f9f7-45ec-874a-e957861629a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:26.925026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687aecd-f9f7-45ec-874a-e957861629a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:26.925341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687aecd-f9f7-45ec-874a-e957861629a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:26.927372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687aecd-f9f7-45ec-874a-e957861629a5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:26.943724 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 257/531] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:26.944730 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687aecd-f9f7-45ec-874a-e957861629a5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:26.983050 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2679f1-2699-4d99-88a6-0ef0fec3c363 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:27.018508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b000369-1adf-485f-9ae2-89b29562eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:27.019240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b000369-1adf-485f-9ae2-89b29562eee0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:27.020685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b000369-1adf-485f-9ae2-89b29562eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:27.021037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b000369-1adf-485f-9ae2-89b29562eee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:27.032002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b000369-1adf-485f-9ae2-89b29562eee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:27.033552 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b000369-1adf-485f-9ae2-89b29562eee0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-8b000369-1adf-485f-9ae2-89b29562eee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:27.048663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:27.049574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:27.050485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:27.050485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:27.050485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:27.050485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:27.054602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 275/532] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:27.055512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b000369-1adf-485f-9ae2-89b29562eee0 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:27.056708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687aecd-f9f7-45ec-874a-e957861629a5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:27.078015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:27.092781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d66952-829c-4bd1-857e-ee49b5f994eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:27.093411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d66952-829c-4bd1-857e-ee49b5f994eb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:27.093700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d66952-829c-4bd1-857e-ee49b5f994eb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:27.093985 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d66952-829c-4bd1-857e-ee49b5f994eb None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:27.094745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d66952-829c-4bd1-857e-ee49b5f994eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:27.095059 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d66952-829c-4bd1-857e-ee49b5f994eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:27.096796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d66952-829c-4bd1-857e-ee49b5f994eb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:27.116478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 258/533] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:27.117599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d66952-829c-4bd1-857e-ee49b5f994eb None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:27.148228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:27.163408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b000369-1adf-485f-9ae2-89b29562eee0 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:27.198443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb8794-cf06-4e9f-846d-4f90c598c2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:27.199180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb8794-cf06-4e9f-846d-4f90c598c2af None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:27.199527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb8794-cf06-4e9f-846d-4f90c598c2af None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:27.200030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb8794-cf06-4e9f-846d-4f90c598c2af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:27.209132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb8794-cf06-4e9f-846d-4f90c598c2af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:27.210665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb8794-cf06-4e9f-846d-4f90c598c2af None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-70eb8794-cf06-4e9f-846d-4f90c598c2af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:27.223797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:27.224727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:27.225602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:27.225602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:27.225602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:27.225602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:27.225602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:27.225602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:27.225602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:27.225602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:27.225602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 276/534] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:27.226079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb8794-cf06-4e9f-846d-4f90c598c2af None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:27.233117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d66952-829c-4bd1-857e-ee49b5f994eb None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:27.272045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe4849-34ec-4f0d-8a8b-3d15f25571f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:27.272679 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe4849-34ec-4f0d-8a8b-3d15f25571f8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:27.273015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe4849-34ec-4f0d-8a8b-3d15f25571f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:27.273299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe4849-34ec-4f0d-8a8b-3d15f25571f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:27.274303 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe4849-34ec-4f0d-8a8b-3d15f25571f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:27.274411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe4849-34ec-4f0d-8a8b-3d15f25571f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:27.275728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe4849-34ec-4f0d-8a8b-3d15f25571f8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:27.289003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 259/535] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:27.289963 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe4849-34ec-4f0d-8a8b-3d15f25571f8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:27.324356 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:27.341138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb8794-cf06-4e9f-846d-4f90c598c2af None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:27.372805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:27.381271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea34a4a-5d02-4467-ad3c-c35930b51f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:27.382284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea34a4a-5d02-4467-ad3c-c35930b51f66 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:27.382862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea34a4a-5d02-4467-ad3c-c35930b51f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:27.383339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea34a4a-5d02-4467-ad3c-c35930b51f66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:27.384399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea34a4a-5d02-4467-ad3c-c35930b51f66 None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=96c5238a91b540b7ba3921a9d561e255) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:27.384914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea34a4a-5d02-4467-ad3c-c35930b51f66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:27.386656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea34a4a-5d02-4467-ad3c-c35930b51f66 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:27.392924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 277/536] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:27 2022] GET /identity/v3/role_assignments?user.id=96c5238a91b540b7ba3921a9d561e255&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:27.393993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea34a4a-5d02-4467-ad3c-c35930b51f66 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:27.399351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe4849-34ec-4f0d-8a8b-3d15f25571f8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:27.446228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c18688-fd02-477a-9974-ec75325d3fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:27.446857 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c18688-fd02-477a-9974-ec75325d3fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:27.447143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c18688-fd02-477a-9974-ec75325d3fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:27.447425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c18688-fd02-477a-9974-ec75325d3fc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:27.454883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c18688-fd02-477a-9974-ec75325d3fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:27.454883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c18688-fd02-477a-9974-ec75325d3fc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:27.454883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c18688-fd02-477a-9974-ec75325d3fc2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:27.469314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 260/537] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:27.471018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c18688-fd02-477a-9974-ec75325d3fc2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:27.531325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea34a4a-5d02-4467-ad3c-c35930b51f66 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:27.569991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495624a-0afe-4924-a9b4-05c2d16d7e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:27.571040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495624a-0afe-4924-a9b4-05c2d16d7e60 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:27.571524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495624a-0afe-4924-a9b4-05c2d16d7e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:27.572124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495624a-0afe-4924-a9b4-05c2d16d7e60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:27.579838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495624a-0afe-4924-a9b4-05c2d16d7e60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:27.583644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495624a-0afe-4924-a9b4-05c2d16d7e60 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-1495624a-0afe-4924-a9b4-05c2d16d7e60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:27.604191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:27.605119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:27.606063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:27.606063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:27.606063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:27.606063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:27.606063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:27.606063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:27.606063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:27.606063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:27.609986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c18688-fd02-477a-9974-ec75325d3fc2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:27.621186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 278/538] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:27.626394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495624a-0afe-4924-a9b4-05c2d16d7e60 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:27.632186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:27.678344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99245914-d99c-49fb-a3e7-89e5bdf8f1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:27.678973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99245914-d99c-49fb-a3e7-89e5bdf8f1ab None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:27.679259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99245914-d99c-49fb-a3e7-89e5bdf8f1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:27.679533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99245914-d99c-49fb-a3e7-89e5bdf8f1ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:27.680357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99245914-d99c-49fb-a3e7-89e5bdf8f1ab None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=b1832d9988604b81bcb075ae77db6d80) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:27.680667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99245914-d99c-49fb-a3e7-89e5bdf8f1ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:27.682096 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99245914-d99c-49fb-a3e7-89e5bdf8f1ab None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:27.692599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:27.701579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 261/539] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:27 2022] GET /identity/v3/role_assignments?user.id=b1832d9988604b81bcb075ae77db6d80&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:27.767971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495624a-0afe-4924-a9b4-05c2d16d7e60 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:27.804813 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc5d49-35be-4ce8-bc07-499fabeb42cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:27.805465 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc5d49-35be-4ce8-bc07-499fabeb42cc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:27.805754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc5d49-35be-4ce8-bc07-499fabeb42cc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:27.806027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc5d49-35be-4ce8-bc07-499fabeb42cc None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:27.806804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc5d49-35be-4ce8-bc07-499fabeb42cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:27.807114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc5d49-35be-4ce8-bc07-499fabeb42cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:27.808692 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc5d49-35be-4ce8-bc07-499fabeb42cc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:27.824059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 279/540] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:27.833903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99245914-d99c-49fb-a3e7-89e5bdf8f1ab None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:27.963074 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99245914-d99c-49fb-a3e7-89e5bdf8f1ab None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:27.999651 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56bfd8-7cc2-4fc7-982f-1d9ae7b9fcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:28.000373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56bfd8-7cc2-4fc7-982f-1d9ae7b9fcef None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:28.000658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56bfd8-7cc2-4fc7-982f-1d9ae7b9fcef None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:28.000983 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56bfd8-7cc2-4fc7-982f-1d9ae7b9fcef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:28.001785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56bfd8-7cc2-4fc7-982f-1d9ae7b9fcef None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=73325bdd109749ad92a66e600fd61a1a) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:28.002100 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56bfd8-7cc2-4fc7-982f-1d9ae7b9fcef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:28.003543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56bfd8-7cc2-4fc7-982f-1d9ae7b9fcef None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:28.009806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 262/541] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:27 2022] GET /identity/v3/role_assignments?user.id=73325bdd109749ad92a66e600fd61a1a&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:28.385079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b609a-7e6d-428f-a12a-524893646323 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:28.385604 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b609a-7e6d-428f-a12a-524893646323 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:28.386065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b609a-7e6d-428f-a12a-524893646323 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:28.387812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 280/542] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:28.401383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629be5e4-57bd-4bee-984a-147552c8ae5e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:28.401883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629be5e4-57bd-4bee-984a-147552c8ae5e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:28.402147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629be5e4-57bd-4bee-984a-147552c8ae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:28.428843 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-629be5e4-57bd-4bee-984a-147552c8ae5e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:28.430051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-629be5e4-57bd-4bee-984a-147552c8ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:28.513608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:28.523535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 263/543] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:28.570078 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b609a-7e6d-428f-a12a-524893646323 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:28.664988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:28.712792 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b609a-7e6d-428f-a12a-524893646323 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:28.762644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f3643-7e08-40be-ad1a-8a691c53d1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:28.763314 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f3643-7e08-40be-ad1a-8a691c53d1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:28.763601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f3643-7e08-40be-ad1a-8a691c53d1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:28.763958 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f3643-7e08-40be-ad1a-8a691c53d1f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:28.777471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f3643-7e08-40be-ad1a-8a691c53d1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e47f3643-7e08-40be-ad1a-8a691c53d1f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:28.782573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:28.783514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:28.784361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:28.784361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:28.784361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:28.784361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:28.784361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:28.784361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:28.784361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:28.784361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:28.784361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:28.784361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:28.784361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:28.784361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:28.784361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 281/544] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:28.791502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629be5e4-57bd-4bee-984a-147552c8ae5e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:28.960302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629be5e4-57bd-4bee-984a-147552c8ae5e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:28.987651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a1669-13bc-432a-912b-02fc948cbdf9 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:28.988651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a1669-13bc-432a-912b-02fc948cbdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:28.989012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a1669-13bc-432a-912b-02fc948cbdf9 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:28.990468 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 282/545] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:21:29.005360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd63be-808d-4e87-a5b0-1ae171a71893 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:29.005647 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd63be-808d-4e87-a5b0-1ae171a71893 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:29.005920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd63be-808d-4e87-a5b0-1ae171a71893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:29.010319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae4791-62f7-49ed-bff8-f644e81d7c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:29.010945 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae4791-62f7-49ed-bff8-f644e81d7c6a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:29.011224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae4791-62f7-49ed-bff8-f644e81d7c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:29.011502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae4791-62f7-49ed-bff8-f644e81d7c6a None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:29.012244 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae4791-62f7-49ed-bff8-f644e81d7c6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:29.012549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae4791-62f7-49ed-bff8-f644e81d7c6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:29.013910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae4791-62f7-49ed-bff8-f644e81d7c6a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:29.032428 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c5cd63be-808d-4e87-a5b0-1ae171a71893 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:29.033605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c5cd63be-808d-4e87-a5b0-1ae171a71893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:29.037874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 264/546] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:29.043361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae4791-62f7-49ed-bff8-f644e81d7c6a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:29.112534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 283/547] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:21:29.154044 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd63be-808d-4e87-a5b0-1ae171a71893 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:29.164094 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:29.232836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:29.274200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd63be-808d-4e87-a5b0-1ae171a71893 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:29.286098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae4791-62f7-49ed-bff8-f644e81d7c6a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:29.313336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50a02c-16d4-41fd-bfe4-089eeba33ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:29.314352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50a02c-16d4-41fd-bfe4-089eeba33ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:29.314843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50a02c-16d4-41fd-bfe4-089eeba33ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:29.315324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50a02c-16d4-41fd-bfe4-089eeba33ae3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:29.327250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50a02c-16d4-41fd-bfe4-089eeba33ae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-ab50a02c-16d4-41fd-bfe4-089eeba33ae3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:29.333054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:29.333939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:29.334766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:29.334766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:29.334766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:29.334766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:29.334766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:29.334766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:29.334766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:29.334766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:29.334766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:29.334766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:29.334766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:29.334766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:29.342598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 284/548] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:29.344102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50a02c-16d4-41fd-bfe4-089eeba33ae3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:29.410826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53186e4a-7c83-48e5-abf7-188259851b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:29.410826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53186e4a-7c83-48e5-abf7-188259851b8e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:29.410826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53186e4a-7c83-48e5-abf7-188259851b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:29.410826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53186e4a-7c83-48e5-abf7-188259851b8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:29.421909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53186e4a-7c83-48e5-abf7-188259851b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:29.423556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53186e4a-7c83-48e5-abf7-188259851b8e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-53186e4a-7c83-48e5-abf7-188259851b8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:29.440654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:29.442001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:29.443661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:29.443661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:29.443661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:29.443661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:29.445031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 265/549] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:29.449735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53186e4a-7c83-48e5-abf7-188259851b8e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:29.508162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50a02c-16d4-41fd-bfe4-089eeba33ae3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:29.540872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:29.569817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c87b96-69d5-4dbd-9bc5-1c8b4fb76f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:29.570838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c87b96-69d5-4dbd-9bc5-1c8b4fb76f08 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:29.571366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c87b96-69d5-4dbd-9bc5-1c8b4fb76f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:29.571366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c87b96-69d5-4dbd-9bc5-1c8b4fb76f08 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:29.572136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c87b96-69d5-4dbd-9bc5-1c8b4fb76f08 None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:29.572451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c87b96-69d5-4dbd-9bc5-1c8b4fb76f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:29.573863 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c87b96-69d5-4dbd-9bc5-1c8b4fb76f08 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:29.587798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 285/550] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:29.594043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c87b96-69d5-4dbd-9bc5-1c8b4fb76f08 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:29.651758 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53186e4a-7c83-48e5-abf7-188259851b8e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:29.664789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:29.694558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb1235-99f0-4a4f-8122-a0db7e5277c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:29.695186 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb1235-99f0-4a4f-8122-a0db7e5277c6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:29.695700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb1235-99f0-4a4f-8122-a0db7e5277c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:29.696015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb1235-99f0-4a4f-8122-a0db7e5277c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:29.698079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb1235-99f0-4a4f-8122-a0db7e5277c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:29.698396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb1235-99f0-4a4f-8122-a0db7e5277c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:29.699774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb1235-99f0-4a4f-8122-a0db7e5277c6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:29.724938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 266/551] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:29.730898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb1235-99f0-4a4f-8122-a0db7e5277c6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:29.819281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c87b96-69d5-4dbd-9bc5-1c8b4fb76f08 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:29.847786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb1235-99f0-4a4f-8122-a0db7e5277c6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:29.884264 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f5751-e6ab-48c1-ad55-9bbc0051a9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:29.885955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f5751-e6ab-48c1-ad55-9bbc0051a9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:29.885955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f5751-e6ab-48c1-ad55-9bbc0051a9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:29.885955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f5751-e6ab-48c1-ad55-9bbc0051a9d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:29.893301 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f5751-e6ab-48c1-ad55-9bbc0051a9d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:29.894934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f5751-e6ab-48c1-ad55-9bbc0051a9d2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d38f5751-e6ab-48c1-ad55-9bbc0051a9d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:29.907216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:29.908448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:29.910216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:29.910216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:29.910216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:29.910216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:29.910216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:29.910216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:29.910216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:29.910216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:29.910216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 16:21:29.910216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:29.911541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da9220-0950-4ae8-893b-b117302159e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:29.912104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 267/552] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:29.912548 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da9220-0950-4ae8-893b-b117302159e2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:29.912833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da9220-0950-4ae8-893b-b117302159e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:29.913110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da9220-0950-4ae8-893b-b117302159e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:29.919033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f5751-e6ab-48c1-ad55-9bbc0051a9d2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:29.938263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da9220-0950-4ae8-893b-b117302159e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:29.940717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da9220-0950-4ae8-893b-b117302159e2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:29.963309 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-51da9220-0950-4ae8-893b-b117302159e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:29.968443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:29.969319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:29.970471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:29.970471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:29.970471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:29.970471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:29.975290 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 286/553] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:29.976856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d68c80-2da3-4f9b-9ecc-56adabbc2bf2 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:29.977357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d68c80-2da3-4f9b-9ecc-56adabbc2bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:29.977870 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d68c80-2da3-4f9b-9ecc-56adabbc2bf2 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:29.979594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 287/554] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:29.984747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d68c80-2da3-4f9b-9ecc-56adabbc2bf2 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:30.026665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:30.060411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f5751-e6ab-48c1-ad55-9bbc0051a9d2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:30.097263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b38d9d-db51-4a0f-8103-0a37ef9306ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:30.098368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b38d9d-db51-4a0f-8103-0a37ef9306ba None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:30.098656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b38d9d-db51-4a0f-8103-0a37ef9306ba None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:30.098937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b38d9d-db51-4a0f-8103-0a37ef9306ba None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:30.099732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b38d9d-db51-4a0f-8103-0a37ef9306ba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:30.100071 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b38d9d-db51-4a0f-8103-0a37ef9306ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:30.101513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b38d9d-db51-4a0f-8103-0a37ef9306ba None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:30.122522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 268/555] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 27 16:21:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:30.123968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961d7d7-df4b-46cb-b112-25ee44dcbc62 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:30.124316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961d7d7-df4b-46cb-b112-25ee44dcbc62 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:30.124599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961d7d7-df4b-46cb-b112-25ee44dcbc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:30.130574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d68c80-2da3-4f9b-9ecc-56adabbc2bf2 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:30.146682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2961d7d7-df4b-46cb-b112-25ee44dcbc62 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:30.147747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2961d7d7-df4b-46cb-b112-25ee44dcbc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:30.181609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad877b-2af6-480c-9246-f336765d66f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:30.182618 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad877b-2af6-480c-9246-f336765d66f4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:30.182994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad877b-2af6-480c-9246-f336765d66f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:30.183287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad877b-2af6-480c-9246-f336765d66f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:30.184024 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad877b-2af6-480c-9246-f336765d66f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:30.184336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad877b-2af6-480c-9246-f336765d66f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:30.185715 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad877b-2af6-480c-9246-f336765d66f4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:30.199511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 288/556] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:30.200666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad877b-2af6-480c-9246-f336765d66f4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:30.227662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 269/557] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:30.234163 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197bca2-59d2-48a3-803c-a9c33162f5df None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:30.234693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197bca2-59d2-48a3-803c-a9c33162f5df None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:30.235190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197bca2-59d2-48a3-803c-a9c33162f5df None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:30.238820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 270/558] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:30.239848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197bca2-59d2-48a3-803c-a9c33162f5df None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:30.260835 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:30.301468 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:30.315128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad877b-2af6-480c-9246-f336765d66f4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:30.350463 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197bca2-59d2-48a3-803c-a9c33162f5df None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:30.351498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed49bd9-38de-491f-8f14-afa730bab8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:30.352263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed49bd9-38de-491f-8f14-afa730bab8da None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:30.352677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed49bd9-38de-491f-8f14-afa730bab8da None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:30.352955 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed49bd9-38de-491f-8f14-afa730bab8da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:30.386433 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35197a6-c1c7-498f-8026-feb17c13d381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:30.387083 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35197a6-c1c7-498f-8026-feb17c13d381 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:30.387370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35197a6-c1c7-498f-8026-feb17c13d381 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:30.387650 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35197a6-c1c7-498f-8026-feb17c13d381 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:30.394759 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35197a6-c1c7-498f-8026-feb17c13d381 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:30.396234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35197a6-c1c7-498f-8026-feb17c13d381 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-c35197a6-c1c7-498f-8026-feb17c13d381 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:30.407792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:30.409467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:30.411475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:30.411475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:30.411475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:30.411475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:30.411475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:30.411475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:30.411475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:30.411475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:30.411475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:21:30.411475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:30.411475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 271/559] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 16:21:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:30.411475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac04bd6-739f-4c1c-8335-08b6950e1077 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:30.411475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac04bd6-739f-4c1c-8335-08b6950e1077 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:30.412241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac04bd6-739f-4c1c-8335-08b6950e1077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:30.430090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5ac04bd6-739f-4c1c-8335-08b6950e1077 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:30.431291 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5ac04bd6-739f-4c1c-8335-08b6950e1077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:30.432392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed49bd9-38de-491f-8f14-afa730bab8da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:30.434305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed49bd9-38de-491f-8f14-afa730bab8da None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:30.500682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 272/560] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:30.501538 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac04bd6-739f-4c1c-8335-08b6950e1077 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:30.510755 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:30.545333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:30.561324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 289/561] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:30.562240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed49bd9-38de-491f-8f14-afa730bab8da None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:30.615183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac04bd6-739f-4c1c-8335-08b6950e1077 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:30.656368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da54dd5-990c-4179-ab29-9c36e0ea7b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:30.657024 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da54dd5-990c-4179-ab29-9c36e0ea7b58 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:30.657308 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da54dd5-990c-4179-ab29-9c36e0ea7b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:30.657584 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da54dd5-990c-4179-ab29-9c36e0ea7b58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:30.665889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed49bd9-38de-491f-8f14-afa730bab8da None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:30.668074 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da54dd5-990c-4179-ab29-9c36e0ea7b58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-7da54dd5-990c-4179-ab29-9c36e0ea7b58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:30.673013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:30.673952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 273/562] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:30.675513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da54dd5-990c-4179-ab29-9c36e0ea7b58 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:30.704337 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007987e-3c38-4537-9c93-fbf918c0b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:30.704961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007987e-3c38-4537-9c93-fbf918c0b05d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:30.705242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007987e-3c38-4537-9c93-fbf918c0b05d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:30.705607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007987e-3c38-4537-9c93-fbf918c0b05d None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:30.706302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007987e-3c38-4537-9c93-fbf918c0b05d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:30.707318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007987e-3c38-4537-9c93-fbf918c0b05d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:30.708722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007987e-3c38-4537-9c93-fbf918c0b05d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:30.725571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 290/563] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 16:21:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:30.726375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007987e-3c38-4537-9c93-fbf918c0b05d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:30.745781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:30.774253 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:30.781170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da54dd5-990c-4179-ab29-9c36e0ea7b58 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:30.815043 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0366bc-e600-4b6c-b963-94573b594feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:30.815681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0366bc-e600-4b6c-b963-94573b594feb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:30.816565 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0366bc-e600-4b6c-b963-94573b594feb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:30.816849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0366bc-e600-4b6c-b963-94573b594feb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:30.826625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0366bc-e600-4b6c-b963-94573b594feb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:30.827434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007987e-3c38-4537-9c93-fbf918c0b05d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-7f0366bc-e600-4b6c-b963-94573b594feb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:30.831595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:30.832653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:30.833486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:30.833486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:30.833486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:30.833486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:30.833486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:30.833486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:30.833486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:30.833486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:30.833486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:30.833486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:30.833486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:30.833486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:30.833486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 274/564] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:30.834408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ae978-e451-435b-8ea8-32807ac821a1 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:30.834508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ae978-e451-435b-8ea8-32807ac821a1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:30.834782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ae978-e451-435b-8ea8-32807ac821a1 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:30.836049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 275/565] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:30.836745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ae978-e451-435b-8ea8-32807ac821a1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:30.866735 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474922fb-b6bf-4ee2-912d-8331642657f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:30.867294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474922fb-b6bf-4ee2-912d-8331642657f7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:30.867573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474922fb-b6bf-4ee2-912d-8331642657f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:30.867841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474922fb-b6bf-4ee2-912d-8331642657f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:30.877887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474922fb-b6bf-4ee2-912d-8331642657f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:30.879613 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474922fb-b6bf-4ee2-912d-8331642657f7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-474922fb-b6bf-4ee2-912d-8331642657f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:30.894630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:30.895527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:30.901029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:30.901029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:30.901029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:30.901029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:30.901029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 291/566] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:30.901029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474922fb-b6bf-4ee2-912d-8331642657f7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:30.942513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ae978-e451-435b-8ea8-32807ac821a1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:30.967325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:30.976772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec065ead-569a-4a89-aaec-31481242f244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:30.977395 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec065ead-569a-4a89-aaec-31481242f244 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:30.977680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec065ead-569a-4a89-aaec-31481242f244 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:30.977957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec065ead-569a-4a89-aaec-31481242f244 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:30.978664 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec065ead-569a-4a89-aaec-31481242f244 None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:30.978977 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec065ead-569a-4a89-aaec-31481242f244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:30.980371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec065ead-569a-4a89-aaec-31481242f244 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:30.988890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 276/567] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:30.989679 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec065ead-569a-4a89-aaec-31481242f244 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:30.996127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:31.000326 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474922fb-b6bf-4ee2-912d-8331642657f7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:31.035511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e37b33-2dab-40c1-ba1c-d3d20bc987bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:31.036188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e37b33-2dab-40c1-ba1c-d3d20bc987bd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:31.036476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e37b33-2dab-40c1-ba1c-d3d20bc987bd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:31.036753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e37b33-2dab-40c1-ba1c-d3d20bc987bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:31.047106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e37b33-2dab-40c1-ba1c-d3d20bc987bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:31.048568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e37b33-2dab-40c1-ba1c-d3d20bc987bd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-64e37b33-2dab-40c1-ba1c-d3d20bc987bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:31.063971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:31.064990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:31.066502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:31.066502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:31.066502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:31.066502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:31.066502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 292/568] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:31.067482 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99953-5476-4221-bede-c4dafc1ce62b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:31.067767 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99953-5476-4221-bede-c4dafc1ce62b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:31.068065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99953-5476-4221-bede-c4dafc1ce62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:31.085442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a9b99953-5476-4221-bede-c4dafc1ce62b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:31.086654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a9b99953-5476-4221-bede-c4dafc1ce62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:31.092712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec065ead-569a-4a89-aaec-31481242f244 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:31.126081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee911c-ddcb-4491-82d5-a1634e68afe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:31.126634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee911c-ddcb-4491-82d5-a1634e68afe2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:31.126921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee911c-ddcb-4491-82d5-a1634e68afe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:31.127206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee911c-ddcb-4491-82d5-a1634e68afe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:31.127940 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee911c-ddcb-4491-82d5-a1634e68afe2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:31.128250 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee911c-ddcb-4491-82d5-a1634e68afe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:31.129829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee911c-ddcb-4491-82d5-a1634e68afe2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:31.137869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 277/569] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:31.138650 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee911c-ddcb-4491-82d5-a1634e68afe2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:31.155407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 293/570] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:31.156292 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b99953-5476-4221-bede-c4dafc1ce62b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:31.188967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:31.236724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:31.240042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee911c-ddcb-4491-82d5-a1634e68afe2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:31.256277 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b99953-5476-4221-bede-c4dafc1ce62b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:31.276928 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3bff-b1a3-4e1a-bbb1-565d9a4f8ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:31.277549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3bff-b1a3-4e1a-bbb1-565d9a4f8ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:31.277834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3bff-b1a3-4e1a-bbb1-565d9a4f8ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:31.278112 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3bff-b1a3-4e1a-bbb1-565d9a4f8ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:31.278808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee3bff-b1a3-4e1a-bbb1-565d9a4f8ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:31.279117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee3bff-b1a3-4e1a-bbb1-565d9a4f8ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:31.280624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee3bff-b1a3-4e1a-bbb1-565d9a4f8ad7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:31.291126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d24224-f603-4a9d-86b9-7c4663d57086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:31.291778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d24224-f603-4a9d-86b9-7c4663d57086 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:31.292088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d24224-f603-4a9d-86b9-7c4663d57086 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:31.292368 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d24224-f603-4a9d-86b9-7c4663d57086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:31.293254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 278/571] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:31.294077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3bff-b1a3-4e1a-bbb1-565d9a4f8ad7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:31.303223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d24224-f603-4a9d-86b9-7c4663d57086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:31.304731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d24224-f603-4a9d-86b9-7c4663d57086 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-98d24224-f603-4a9d-86b9-7c4663d57086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:31.320284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:31.321357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:31.322257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:31.322257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:31.322257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:31.322257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:31.322257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 294/572] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:31.322257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d24224-f603-4a9d-86b9-7c4663d57086 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:31.401702 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3bff-b1a3-4e1a-bbb1-565d9a4f8ad7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:31.412052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:31.423925 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d24224-f603-4a9d-86b9-7c4663d57086 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:31.434991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae50ba9-1fb5-43d3-82cc-4f636fdc2d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:31.435605 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae50ba9-1fb5-43d3-82cc-4f636fdc2d62 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:31.435916 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae50ba9-1fb5-43d3-82cc-4f636fdc2d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:31.436190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae50ba9-1fb5-43d3-82cc-4f636fdc2d62 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:31.436870 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae50ba9-1fb5-43d3-82cc-4f636fdc2d62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:31.437169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae50ba9-1fb5-43d3-82cc-4f636fdc2d62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:31.438508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae50ba9-1fb5-43d3-82cc-4f636fdc2d62 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:31.450296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 279/573] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:31.451107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae50ba9-1fb5-43d3-82cc-4f636fdc2d62 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:31.454965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:31.460528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d480d3f-c234-466c-9afc-37f546a89d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:31.461178 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d480d3f-c234-466c-9afc-37f546a89d9a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:31.461463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d480d3f-c234-466c-9afc-37f546a89d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:31.461742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d480d3f-c234-466c-9afc-37f546a89d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:31.472768 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d480d3f-c234-466c-9afc-37f546a89d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:31.474228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d480d3f-c234-466c-9afc-37f546a89d9a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-4d480d3f-c234-466c-9afc-37f546a89d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:31.488866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:31.489928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:31.490871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:31.490871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:31.490871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:31.490871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:31.490871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 295/574] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:31.491198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d480d3f-c234-466c-9afc-37f546a89d9a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:31.553788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae50ba9-1fb5-43d3-82cc-4f636fdc2d62 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:31.588223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06870d59-f803-4a00-a198-588df42560c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:31.588859 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06870d59-f803-4a00-a198-588df42560c3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:31.589136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06870d59-f803-4a00-a198-588df42560c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:31.589404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06870d59-f803-4a00-a198-588df42560c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:31.589735 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d480d3f-c234-466c-9afc-37f546a89d9a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:31.599673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06870d59-f803-4a00-a198-588df42560c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-06870d59-f803-4a00-a198-588df42560c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:31.605088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:31.606022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:31.606854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:31.606854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:31.606854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:31.606854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:31.606854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:31.606854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:31.606854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:31.606854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:31.606854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:31.606854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:31.606854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:31.606854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:31.606854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 280/575] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:31.607616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06870d59-f803-4a00-a198-588df42560c3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:31.629740 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7abbe5-666d-46c6-adc3-bacc4db0872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:31.630378 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7abbe5-666d-46c6-adc3-bacc4db0872c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:31.630658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7abbe5-666d-46c6-adc3-bacc4db0872c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:31.630926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7abbe5-666d-46c6-adc3-bacc4db0872c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:31.637751 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:31.638086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7abbe5-666d-46c6-adc3-bacc4db0872c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:31.639535 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7abbe5-666d-46c6-adc3-bacc4db0872c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-6f7abbe5-666d-46c6-adc3-bacc4db0872c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:31.651579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:31.652599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:31.653513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:31.653513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:31.653513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:31.653513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:31.653513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:31.653513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:31.653513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:31.653513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:31.653513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 296/576] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:31.654012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7abbe5-666d-46c6-adc3-bacc4db0872c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:31.700901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:31.710619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06870d59-f803-4a00-a198-588df42560c3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:31.744047 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d058c9-a387-492f-95d4-ec56900521a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:31.744660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d058c9-a387-492f-95d4-ec56900521a7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:31.744944 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d058c9-a387-492f-95d4-ec56900521a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:31.745219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d058c9-a387-492f-95d4-ec56900521a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:31.745903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d058c9-a387-492f-95d4-ec56900521a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:31.746206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d058c9-a387-492f-95d4-ec56900521a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:31.747560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d058c9-a387-492f-95d4-ec56900521a7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:31.755301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7abbe5-666d-46c6-adc3-bacc4db0872c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:31.759311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 281/577] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:31.760237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d058c9-a387-492f-95d4-ec56900521a7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:31.789928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa7a62-4e53-4e0b-bbc0-c3ae87c4039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:31.790796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa7a62-4e53-4e0b-bbc0-c3ae87c4039e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:31.791084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa7a62-4e53-4e0b-bbc0-c3ae87c4039e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:31.791365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa7a62-4e53-4e0b-bbc0-c3ae87c4039e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:31.798167 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa7a62-4e53-4e0b-bbc0-c3ae87c4039e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:31.799609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa7a62-4e53-4e0b-bbc0-c3ae87c4039e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-40fa7a62-4e53-4e0b-bbc0-c3ae87c4039e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:31.811450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:31.812422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:31.813333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:31.813333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:31.813333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:31.813333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:31.813333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:31.813333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:31.813333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:31.813333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:31.813333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 297/578] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:31.813824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa7a62-4e53-4e0b-bbc0-c3ae87c4039e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:31.851892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:31.861874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d058c9-a387-492f-95d4-ec56900521a7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:31.895448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f221e23-26b8-426f-aa9b-950db7ef3962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:31.896092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f221e23-26b8-426f-aa9b-950db7ef3962 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:31.896378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f221e23-26b8-426f-aa9b-950db7ef3962 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:31.896656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f221e23-26b8-426f-aa9b-950db7ef3962 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:31.897344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f221e23-26b8-426f-aa9b-950db7ef3962 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:31.897650 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f221e23-26b8-426f-aa9b-950db7ef3962 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:31.899008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f221e23-26b8-426f-aa9b-950db7ef3962 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:31.911516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 282/579] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:31.912274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f221e23-26b8-426f-aa9b-950db7ef3962 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:31.912533 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa7a62-4e53-4e0b-bbc0-c3ae87c4039e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:31.914978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:31.946400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db669cb-0e2b-4d54-b6b9-6a0cdf6a8011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:31.947016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db669cb-0e2b-4d54-b6b9-6a0cdf6a8011 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:31.947295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db669cb-0e2b-4d54-b6b9-6a0cdf6a8011 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:31.947567 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db669cb-0e2b-4d54-b6b9-6a0cdf6a8011 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:31.948305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db669cb-0e2b-4d54-b6b9-6a0cdf6a8011 None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:31.948610 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db669cb-0e2b-4d54-b6b9-6a0cdf6a8011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:31.949960 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db669cb-0e2b-4d54-b6b9-6a0cdf6a8011 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:31.957926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 298/580] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:31.958712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db669cb-0e2b-4d54-b6b9-6a0cdf6a8011 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:32.014659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f221e23-26b8-426f-aa9b-950db7ef3962 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:32.047478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27683c77-a4c2-440b-9f37-39225f00d03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:32.048119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27683c77-a4c2-440b-9f37-39225f00d03b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:32.048398 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27683c77-a4c2-440b-9f37-39225f00d03b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:32.048676 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27683c77-a4c2-440b-9f37-39225f00d03b None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:32.049405 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27683c77-a4c2-440b-9f37-39225f00d03b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:32.049708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27683c77-a4c2-440b-9f37-39225f00d03b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:32.051809 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27683c77-a4c2-440b-9f37-39225f00d03b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:32.057716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db669cb-0e2b-4d54-b6b9-6a0cdf6a8011 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:32.062798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 283/581] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:32.063578 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27683c77-a4c2-440b-9f37-39225f00d03b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:32.077195 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:32.091396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cb156-3bd1-4971-96b5-f4b3102ae4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:32.092149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cb156-3bd1-4971-96b5-f4b3102ae4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:32.092445 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cb156-3bd1-4971-96b5-f4b3102ae4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:32.092726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cb156-3bd1-4971-96b5-f4b3102ae4c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:32.101734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cb156-3bd1-4971-96b5-f4b3102ae4c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:32.103162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cb156-3bd1-4971-96b5-f4b3102ae4c4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-969cb156-3bd1-4971-96b5-f4b3102ae4c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:32.114817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:32.115840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:32.116836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:32.116836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:32.116836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:32.116836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:32.116836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:32.116836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:32.116836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:32.116836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:32.116836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:21:32.116836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:32.116836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 299/582] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:32.116836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cb156-3bd1-4971-96b5-f4b3102ae4c4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:32.145934 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:32.168515 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27683c77-a4c2-440b-9f37-39225f00d03b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:32.201062 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dde4cf-1349-4ad9-85f1-78e0a92f469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:32.201674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dde4cf-1349-4ad9-85f1-78e0a92f469f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:32.201958 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dde4cf-1349-4ad9-85f1-78e0a92f469f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:32.202235 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dde4cf-1349-4ad9-85f1-78e0a92f469f None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:32.202974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dde4cf-1349-4ad9-85f1-78e0a92f469f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:32.203282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dde4cf-1349-4ad9-85f1-78e0a92f469f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:32.204733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dde4cf-1349-4ad9-85f1-78e0a92f469f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:32.216852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 284/583] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:32.217635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dde4cf-1349-4ad9-85f1-78e0a92f469f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:32.219119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cb156-3bd1-4971-96b5-f4b3102ae4c4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:32.252454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e43f79-5949-4f0d-88c1-d97e6fc8852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:32.253090 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e43f79-5949-4f0d-88c1-d97e6fc8852c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:32.253986 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e43f79-5949-4f0d-88c1-d97e6fc8852c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:32.254264 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e43f79-5949-4f0d-88c1-d97e6fc8852c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:32.261586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e43f79-5949-4f0d-88c1-d97e6fc8852c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:32.263010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e43f79-5949-4f0d-88c1-d97e6fc8852c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-41e43f79-5949-4f0d-88c1-d97e6fc8852c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:32.274509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:32.275463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:32.276457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:32.276457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:32.276457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:32.276457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:32.276457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:32.276457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:32.276457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:32.276457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:32.276457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 16:21:32.276457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:32.276457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 300/584] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:32.277265 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e43f79-5949-4f0d-88c1-d97e6fc8852c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:32.290453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:32.322270 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dde4cf-1349-4ad9-85f1-78e0a92f469f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:32.357221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46e4da-b885-479c-b2a3-de18bc2cb447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:32.357856 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46e4da-b885-479c-b2a3-de18bc2cb447 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:32.358134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46e4da-b885-479c-b2a3-de18bc2cb447 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:32.358402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46e4da-b885-479c-b2a3-de18bc2cb447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:32.364001 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:32.370142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46e4da-b885-479c-b2a3-de18bc2cb447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:32.371568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46e4da-b885-479c-b2a3-de18bc2cb447 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:32.378883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e43f79-5949-4f0d-88c1-d97e6fc8852c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-db46e4da-b885-479c-b2a3-de18bc2cb447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:32.385986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:32.387006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:32.388254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:32.388254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:32.388254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:32.388254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:32.388254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 285/585] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:32.388254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46e4da-b885-479c-b2a3-de18bc2cb447 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:32.417459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e45875-cb8c-432f-9dbf-66edbfe5dfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:32.418079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e45875-cb8c-432f-9dbf-66edbfe5dfce None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:32.418361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e45875-cb8c-432f-9dbf-66edbfe5dfce None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:32.418686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e45875-cb8c-432f-9dbf-66edbfe5dfce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:32.419408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e45875-cb8c-432f-9dbf-66edbfe5dfce None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=c48ede3f01be42c39a55c1beeeb85f26) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:32.419715 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e45875-cb8c-432f-9dbf-66edbfe5dfce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:32.421212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e45875-cb8c-432f-9dbf-66edbfe5dfce None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:32.426871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 301/586] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:32 2022] GET /identity/v3/role_assignments?user.id=c48ede3f01be42c39a55c1beeeb85f26&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:32.427553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e45875-cb8c-432f-9dbf-66edbfe5dfce None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:32.508351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46e4da-b885-479c-b2a3-de18bc2cb447 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:32.533705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:32.542739 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e45875-cb8c-432f-9dbf-66edbfe5dfce None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:32.548033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c30bb-15b5-400f-8c58-9f7a9eb2a050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:32.548669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c30bb-15b5-400f-8c58-9f7a9eb2a050 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:32.548950 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c30bb-15b5-400f-8c58-9f7a9eb2a050 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:32.549223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c30bb-15b5-400f-8c58-9f7a9eb2a050 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:32.550022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c30bb-15b5-400f-8c58-9f7a9eb2a050 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:32.550454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c30bb-15b5-400f-8c58-9f7a9eb2a050 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:32.551975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c30bb-15b5-400f-8c58-9f7a9eb2a050 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:32.575668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 286/587] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 27 16:21:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:32.575668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c30bb-15b5-400f-8c58-9f7a9eb2a050 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:32.589289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932da70-c3a6-457d-9f06-69a41e32bdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:32.589973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932da70-c3a6-457d-9f06-69a41e32bdf4 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:32.590251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932da70-c3a6-457d-9f06-69a41e32bdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:32.590531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932da70-c3a6-457d-9f06-69a41e32bdf4 None admin] PATH_INFO: `/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/9d5a8ef373ca4ed7bf31361e24e42e54/roles/93a2fa7fee0546bfb1e36487e6785cdd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:32.608996 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932da70-c3a6-457d-9f06-69a41e32bdf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01ef9cd2ffc4edd94cbf0017a720a57, user_id=9d5a8ef373ca4ed7bf31361e24e42e54, role_id=93a2fa7fee0546bfb1e36487e6785cdd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:32.610454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932da70-c3a6-457d-9f06-69a41e32bdf4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:32.621341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:32.636247 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 302/588] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:21:32 2022] PUT /identity/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/9d5a8ef373ca4ed7bf31361e24e42e54/roles/93a2fa7fee0546bfb1e36487e6785cdd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:32.636247 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932da70-c3a6-457d-9f06-69a41e32bdf4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:32.704979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c30bb-15b5-400f-8c58-9f7a9eb2a050 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:32.745573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494c591-6341-4682-a10f-d9f6d4a54095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:32.746248 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494c591-6341-4682-a10f-d9f6d4a54095 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:32.746637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494c591-6341-4682-a10f-d9f6d4a54095 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:32.746913 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494c591-6341-4682-a10f-d9f6d4a54095 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:32.747876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494c591-6341-4682-a10f-d9f6d4a54095 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:32.748258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494c591-6341-4682-a10f-d9f6d4a54095 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:32.749747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494c591-6341-4682-a10f-d9f6d4a54095 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:32.773544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 287/589] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 27 16:21:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:32.774628 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494c591-6341-4682-a10f-d9f6d4a54095 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:32.795141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932da70-c3a6-457d-9f06-69a41e32bdf4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:32.824548 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:32.840037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567af84-5d71-4224-91ae-979c63ac6cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:32.841005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567af84-5d71-4224-91ae-979c63ac6cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:32.841995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567af84-5d71-4224-91ae-979c63ac6cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:32.841995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567af84-5d71-4224-91ae-979c63ac6cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:32.842254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567af84-5d71-4224-91ae-979c63ac6cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:32.842539 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567af84-5d71-4224-91ae-979c63ac6cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:32.844147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567af84-5d71-4224-91ae-979c63ac6cf2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:32.857800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 303/590] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:32.859371 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567af84-5d71-4224-91ae-979c63ac6cf2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:32.900942 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494c591-6341-4682-a10f-d9f6d4a54095 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:32.939838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b8408-3188-46b6-b062-60692b5a4f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:32.940505 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b8408-3188-46b6-b062-60692b5a4f88 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:32.941353 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b8408-3188-46b6-b062-60692b5a4f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:32.942349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b8408-3188-46b6-b062-60692b5a4f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:32.946794 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:32.955639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b8408-3188-46b6-b062-60692b5a4f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:32.957634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b8408-3188-46b6-b062-60692b5a4f88 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-510b8408-3188-46b6-b062-60692b5a4f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:32.974749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:32.975666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:32.976583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:32.976583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:32.976583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:32.976583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:32.980622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 288/591] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:32.981568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b8408-3188-46b6-b062-60692b5a4f88 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:32.996959 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567af84-5d71-4224-91ae-979c63ac6cf2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:33.042926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882f590-4b4e-45a3-a400-9b44f65b8d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:33.044031 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882f590-4b4e-45a3-a400-9b44f65b8d56 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:33.044323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882f590-4b4e-45a3-a400-9b44f65b8d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:33.044883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882f590-4b4e-45a3-a400-9b44f65b8d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:33.061201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882f590-4b4e-45a3-a400-9b44f65b8d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:33.062677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882f590-4b4e-45a3-a400-9b44f65b8d56 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-5882f590-4b4e-45a3-a400-9b44f65b8d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:33.080223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:33.081179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:33.083016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:33.083016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:33.083016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:33.083016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:33.083016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 304/592] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:33.083305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882f590-4b4e-45a3-a400-9b44f65b8d56 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:33.091654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:33.102485 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b8408-3188-46b6-b062-60692b5a4f88 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:33.139260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0fb31-1eee-4c09-95a9-06febe2a01a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:33.139710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0fb31-1eee-4c09-95a9-06febe2a01a9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:33.140048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0fb31-1eee-4c09-95a9-06febe2a01a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:33.140330 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0fb31-1eee-4c09-95a9-06febe2a01a9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:33.149015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0fb31-1eee-4c09-95a9-06febe2a01a9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:33.150478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0fb31-1eee-4c09-95a9-06febe2a01a9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-4cd0fb31-1eee-4c09-95a9-06febe2a01a9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:33.162434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:33.163420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:33.164401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:33.164401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:33.164401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:33.164401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:33.164401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:33.164401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:33.164401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:33.164401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:33.164401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 16:21:33.164401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:33.168524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 289/593] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:33.169260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0fb31-1eee-4c09-95a9-06febe2a01a9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:33.197257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882f590-4b4e-45a3-a400-9b44f65b8d56 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:33.214504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:33.241999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb0483-ce54-4f1c-a418-f98afa766e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:33.242622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb0483-ce54-4f1c-a418-f98afa766e74 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:33.242907 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb0483-ce54-4f1c-a418-f98afa766e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:33.243183 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb0483-ce54-4f1c-a418-f98afa766e74 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:33.243884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb0483-ce54-4f1c-a418-f98afa766e74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:33.244197 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb0483-ce54-4f1c-a418-f98afa766e74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:33.245575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb0483-ce54-4f1c-a418-f98afa766e74 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:33.261772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 305/594] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:33.262879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb0483-ce54-4f1c-a418-f98afa766e74 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:33.272951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0fb31-1eee-4c09-95a9-06febe2a01a9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:33.316346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d1038-19c2-4506-a7b9-23a51a231104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:33.317241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d1038-19c2-4506-a7b9-23a51a231104 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:33.318023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d1038-19c2-4506-a7b9-23a51a231104 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:33.318461 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d1038-19c2-4506-a7b9-23a51a231104 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:33.319609 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d1038-19c2-4506-a7b9-23a51a231104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:33.320369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d1038-19c2-4506-a7b9-23a51a231104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:33.322031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d1038-19c2-4506-a7b9-23a51a231104 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:33.339472 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 290/595] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:33.340827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d1038-19c2-4506-a7b9-23a51a231104 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:33.357244 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:33.392856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb0483-ce54-4f1c-a418-f98afa766e74 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:33.438062 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16511692-2b7e-493c-895f-7bf1da724d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:33.438687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16511692-2b7e-493c-895f-7bf1da724d3c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:33.438969 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16511692-2b7e-493c-895f-7bf1da724d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:33.439242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16511692-2b7e-493c-895f-7bf1da724d3c None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:33.440465 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16511692-2b7e-493c-895f-7bf1da724d3c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:33.441496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16511692-2b7e-493c-895f-7bf1da724d3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:33.443391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16511692-2b7e-493c-895f-7bf1da724d3c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:33.465652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 306/596] 10.222.0.67 () {56 vars in 1139 bytes} [Wed Jul 27 16:21:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:33.466485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16511692-2b7e-493c-895f-7bf1da724d3c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:33.473267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d1038-19c2-4506-a7b9-23a51a231104 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:33.505779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:33.518223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085756e6-cc17-451b-8315-d570e29c7678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:33.518987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085756e6-cc17-451b-8315-d570e29c7678 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:33.519360 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085756e6-cc17-451b-8315-d570e29c7678 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:33.519639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085756e6-cc17-451b-8315-d570e29c7678 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:33.527005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085756e6-cc17-451b-8315-d570e29c7678 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:33.528476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085756e6-cc17-451b-8315-d570e29c7678 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-085756e6-cc17-451b-8315-d570e29c7678 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:33.543048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:33.544050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:33.544935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:33.544935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:33.544935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:33.544935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:33.544935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:33.544935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:33.544935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:33.544935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:33.548153 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 291/597] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:33.549166 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085756e6-cc17-451b-8315-d570e29c7678 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:33.588389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16511692-2b7e-493c-895f-7bf1da724d3c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:33.623514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30533533-0fc3-4fbf-a378-3ef28ba23531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:33.624541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30533533-0fc3-4fbf-a378-3ef28ba23531 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:33.625024 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30533533-0fc3-4fbf-a378-3ef28ba23531 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:33.625493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30533533-0fc3-4fbf-a378-3ef28ba23531 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:33.627045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:33.635577 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30533533-0fc3-4fbf-a378-3ef28ba23531 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:33.637370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30533533-0fc3-4fbf-a378-3ef28ba23531 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-30533533-0fc3-4fbf-a378-3ef28ba23531 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:33.650653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:33.651571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:33.652581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:33.652581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:33.652581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:33.652581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:33.652581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:33.652581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:33.652581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:33.652581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:33.655655 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 307/598] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:33.656777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30533533-0fc3-4fbf-a378-3ef28ba23531 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:33.665451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085756e6-cc17-451b-8315-d570e29c7678 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:33.701539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bec9a-f9db-4804-8584-eaeac32be6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:33.702207 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bec9a-f9db-4804-8584-eaeac32be6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:33.702489 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bec9a-f9db-4804-8584-eaeac32be6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:33.702764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bec9a-f9db-4804-8584-eaeac32be6e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:33.759773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:33.773088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30533533-0fc3-4fbf-a378-3ef28ba23531 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:33.811476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cd7d0-02ef-48c1-8677-739f70719060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:33.812975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cd7d0-02ef-48c1-8677-739f70719060 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:33.813454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cd7d0-02ef-48c1-8677-739f70719060 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:33.813919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cd7d0-02ef-48c1-8677-739f70719060 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:33.814896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cd7d0-02ef-48c1-8677-739f70719060 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:33.815406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cd7d0-02ef-48c1-8677-739f70719060 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:33.817176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cd7d0-02ef-48c1-8677-739f70719060 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:33.830917 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 308/599] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:33.832796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cd7d0-02ef-48c1-8677-739f70719060 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:33.839958 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bec9a-f9db-4804-8584-eaeac32be6e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:33.841307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bec9a-f9db-4804-8584-eaeac32be6e8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-546bec9a-f9db-4804-8584-eaeac32be6e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:33.858392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:33.859380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:33.860887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:33.860887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:33.860887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:33.860887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:33.860887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 292/600] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:33.860887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bec9a-f9db-4804-8584-eaeac32be6e8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:33.950164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cd7d0-02ef-48c1-8677-739f70719060 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:33.971630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bec9a-f9db-4804-8584-eaeac32be6e8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:33.988494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c826a1-8877-4a95-a319-c75baf6b70a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:33.989493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c826a1-8877-4a95-a319-c75baf6b70a4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:33.990094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c826a1-8877-4a95-a319-c75baf6b70a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:33.990564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c826a1-8877-4a95-a319-c75baf6b70a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:33.991567 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c826a1-8877-4a95-a319-c75baf6b70a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:33.992098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c826a1-8877-4a95-a319-c75baf6b70a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:33.993834 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c826a1-8877-4a95-a319-c75baf6b70a4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:33.996581 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:34.008793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3fd92-4687-4765-bdcf-cec21fb11472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:34.009466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3fd92-4687-4765-bdcf-cec21fb11472 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:34.009748 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3fd92-4687-4765-bdcf-cec21fb11472 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:34.010076 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3fd92-4687-4765-bdcf-cec21fb11472 None admin] PATH_INFO: `/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/96c5238a91b540b7ba3921a9d561e255/roles/93a2fa7fee0546bfb1e36487e6785cdd` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:34.010869 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 309/601] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:34.011983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c826a1-8877-4a95-a319-c75baf6b70a4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:34.032113 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:34.033336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3fd92-4687-4765-bdcf-cec21fb11472 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01ef9cd2ffc4edd94cbf0017a720a57, user_id=96c5238a91b540b7ba3921a9d561e255, role_id=93a2fa7fee0546bfb1e36487e6785cdd)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:34.036295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3fd92-4687-4765-bdcf-cec21fb11472 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:34.054309 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 293/602] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:21:33 2022] PUT /identity/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/96c5238a91b540b7ba3921a9d561e255/roles/93a2fa7fee0546bfb1e36487e6785cdd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:34.055476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3fd92-4687-4765-bdcf-cec21fb11472 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:34.191987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3fd92-4687-4765-bdcf-cec21fb11472 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:34.207982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c826a1-8877-4a95-a319-c75baf6b70a4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:34.264316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759aba9-92a0-46a9-852b-fdd58101bde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:34.266015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759aba9-92a0-46a9-852b-fdd58101bde9 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:34.266015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759aba9-92a0-46a9-852b-fdd58101bde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:34.266015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759aba9-92a0-46a9-852b-fdd58101bde9 None admin] PATH_INFO: `/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/b1832d9988604b81bcb075ae77db6d80/roles/93a2fa7fee0546bfb1e36487e6785cdd` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:34.274895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca88b4-c1f0-40c8-9f2d-b22c3b6ffbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:34.275525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca88b4-c1f0-40c8-9f2d-b22c3b6ffbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:34.275803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca88b4-c1f0-40c8-9f2d-b22c3b6ffbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:34.276094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca88b4-c1f0-40c8-9f2d-b22c3b6ffbc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:34.276794 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca88b4-c1f0-40c8-9f2d-b22c3b6ffbc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:34.277142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca88b4-c1f0-40c8-9f2d-b22c3b6ffbc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:34.278525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca88b4-c1f0-40c8-9f2d-b22c3b6ffbc8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:34.293700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759aba9-92a0-46a9-852b-fdd58101bde9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01ef9cd2ffc4edd94cbf0017a720a57, user_id=b1832d9988604b81bcb075ae77db6d80, role_id=93a2fa7fee0546bfb1e36487e6785cdd)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:34.295010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 310/603] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:34.295824 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759aba9-92a0-46a9-852b-fdd58101bde9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:34.300146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca88b4-c1f0-40c8-9f2d-b22c3b6ffbc8 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:34.327006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 294/604] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:21:34 2022] PUT /identity/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/b1832d9988604b81bcb075ae77db6d80/roles/93a2fa7fee0546bfb1e36487e6785cdd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:34.404274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:34.451803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca88b4-c1f0-40c8-9f2d-b22c3b6ffbc8 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:34.503629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39972e-67d0-4153-98fc-0c2d48ef28f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:34.504311 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39972e-67d0-4153-98fc-0c2d48ef28f3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:34.504597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39972e-67d0-4153-98fc-0c2d48ef28f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:34.504872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39972e-67d0-4153-98fc-0c2d48ef28f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:34.516075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39972e-67d0-4153-98fc-0c2d48ef28f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:34.517469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39972e-67d0-4153-98fc-0c2d48ef28f3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-3e39972e-67d0-4153-98fc-0c2d48ef28f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:34.530225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:34.531181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:34.532144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:34.532144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:34.532144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:34.532144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:34.532144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:34.532144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:34.532144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:34.532144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:34.532144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 311/605] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:34.537432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759aba9-92a0-46a9-852b-fdd58101bde9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:34.555672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351216a-5f5a-4855-9713-116203870be2 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:34.556021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351216a-5f5a-4855-9713-116203870be2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:34.556262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351216a-5f5a-4855-9713-116203870be2 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:34.557955 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 312/606] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:34.563317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317a799-c07a-45e9-b36a-597ed2b9e870 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:34.563602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317a799-c07a-45e9-b36a-597ed2b9e870 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:34.563888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317a799-c07a-45e9-b36a-597ed2b9e870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:34.571169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:34.584685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8317a799-c07a-45e9-b36a-597ed2b9e870 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:34.585875 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8317a799-c07a-45e9-b36a-597ed2b9e870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:34.687969 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 313/607] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 16:21:34.704820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317a799-c07a-45e9-b36a-597ed2b9e870 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:34.714061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759aba9-92a0-46a9-852b-fdd58101bde9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:34.788230 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db942f9-fc77-40d4-9ce6-5ac36cd12e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:34.788791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db942f9-fc77-40d4-9ce6-5ac36cd12e93 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:34.789076 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db942f9-fc77-40d4-9ce6-5ac36cd12e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:34.789353 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db942f9-fc77-40d4-9ce6-5ac36cd12e93 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:34.790109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db942f9-fc77-40d4-9ce6-5ac36cd12e93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:34.790416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db942f9-fc77-40d4-9ce6-5ac36cd12e93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:34.791843 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db942f9-fc77-40d4-9ce6-5ac36cd12e93 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:34.806766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:34.816638 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 295/608] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:34.823502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db942f9-fc77-40d4-9ce6-5ac36cd12e93 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:34.876521 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317a799-c07a-45e9-b36a-597ed2b9e870 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:34.919396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ca181-afc8-4302-b73a-75e07e01dce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:34.920068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ca181-afc8-4302-b73a-75e07e01dce1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:34.920350 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ca181-afc8-4302-b73a-75e07e01dce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:34.920619 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ca181-afc8-4302-b73a-75e07e01dce1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:34.932706 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ca181-afc8-4302-b73a-75e07e01dce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-c02ca181-afc8-4302-b73a-75e07e01dce1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:34.938351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:34.939288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:34.940283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:34.940283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:34.940283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:34.940283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:34.940283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:34.940283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:34.940283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:34.940283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:34.940283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:34.940283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:34.940283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:34.940283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:34.943988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 314/609] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:34.947334 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ca181-afc8-4302-b73a-75e07e01dce1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:34.991373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:35.014004 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db942f9-fc77-40d4-9ce6-5ac36cd12e93 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:35.051967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61709d82-56b4-4c7e-b09e-feb210b36761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:35.052565 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61709d82-56b4-4c7e-b09e-feb210b36761 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:35.052949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61709d82-56b4-4c7e-b09e-feb210b36761 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:35.053224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61709d82-56b4-4c7e-b09e-feb210b36761 None admin] PATH_INFO: `/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/73325bdd109749ad92a66e600fd61a1a/roles/93a2fa7fee0546bfb1e36487e6785cdd` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:35.059882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ca181-afc8-4302-b73a-75e07e01dce1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:35.069109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61709d82-56b4-4c7e-b09e-feb210b36761 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01ef9cd2ffc4edd94cbf0017a720a57, user_id=73325bdd109749ad92a66e600fd61a1a, role_id=93a2fa7fee0546bfb1e36487e6785cdd)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:35.070646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61709d82-56b4-4c7e-b09e-feb210b36761 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:35.082158 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:35.089138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 296/610] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:21:34 2022] PUT /identity/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/73325bdd109749ad92a66e600fd61a1a/roles/93a2fa7fee0546bfb1e36487e6785cdd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:35.091385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2af60-07aa-4986-973b-1bff6196e4af None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:35.091878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2af60-07aa-4986-973b-1bff6196e4af None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:35.092495 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2af60-07aa-4986-973b-1bff6196e4af None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:35.095454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 297/611] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:35.101711 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de870c-1d0e-4781-92f8-3e85d5f667f5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:35.103985 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de870c-1d0e-4781-92f8-3e85d5f667f5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:35.103985 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de870c-1d0e-4781-92f8-3e85d5f667f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:35.106593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da487858-65a7-4e74-9e92-485430c563ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:35.107544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da487858-65a7-4e74-9e92-485430c563ca None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:35.108105 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da487858-65a7-4e74-9e92-485430c563ca None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:35.108606 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da487858-65a7-4e74-9e92-485430c563ca None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:35.109568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da487858-65a7-4e74-9e92-485430c563ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:35.110078 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da487858-65a7-4e74-9e92-485430c563ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:35.111781 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da487858-65a7-4e74-9e92-485430c563ca None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:35.123125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 315/612] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:35.130005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da487858-65a7-4e74-9e92-485430c563ca None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:35.149476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-66de870c-1d0e-4781-92f8-3e85d5f667f5 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:35.152412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-66de870c-1d0e-4781-92f8-3e85d5f667f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:35.274081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 298/613] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:35.295012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da487858-65a7-4e74-9e92-485430c563ca None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:35.298252 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de870c-1d0e-4781-92f8-3e85d5f667f5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:35.337871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c73d6e-55d4-49d0-94c7-62e9bdc024f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:35.338854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c73d6e-55d4-49d0-94c7-62e9bdc024f7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:35.339335 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c73d6e-55d4-49d0-94c7-62e9bdc024f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:35.339806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c73d6e-55d4-49d0-94c7-62e9bdc024f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:35.356300 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c73d6e-55d4-49d0-94c7-62e9bdc024f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:35.358549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c73d6e-55d4-49d0-94c7-62e9bdc024f7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:35.372850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-59c73d6e-55d4-49d0-94c7-62e9bdc024f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:35.379525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:35.380447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:35.381348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:35.381348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:35.381348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:35.381348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:35.383609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 316/614] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:35.392900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c73d6e-55d4-49d0-94c7-62e9bdc024f7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:35.434946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de870c-1d0e-4781-92f8-3e85d5f667f5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:35.466115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:35.518323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9a43b-278c-4c90-aeab-229891e90d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:35.519538 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9a43b-278c-4c90-aeab-229891e90d0c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:35.519999 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9a43b-278c-4c90-aeab-229891e90d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:35.520283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9a43b-278c-4c90-aeab-229891e90d0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:35.533260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9a43b-278c-4c90-aeab-229891e90d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-64f9a43b-278c-4c90-aeab-229891e90d0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:35.538723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:35.540203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:35.541052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:35.541052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:35.541052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:35.541052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:35.541052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:35.541052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:35.541052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:35.541052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:35.541052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:35.541052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:35.541052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:35.541052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:35.541052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 299/615] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:35.546307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9a43b-278c-4c90-aeab-229891e90d0c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:35.586800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c73d6e-55d4-49d0-94c7-62e9bdc024f7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:35.652266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650be6dc-196b-41af-b250-ae7e2d6cf991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:35.652828 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650be6dc-196b-41af-b250-ae7e2d6cf991 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:35.653113 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650be6dc-196b-41af-b250-ae7e2d6cf991 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:35.653392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650be6dc-196b-41af-b250-ae7e2d6cf991 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:35.654092 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650be6dc-196b-41af-b250-ae7e2d6cf991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:35.654403 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650be6dc-196b-41af-b250-ae7e2d6cf991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:35.655887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650be6dc-196b-41af-b250-ae7e2d6cf991 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:35.669633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 317/616] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:35.676978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650be6dc-196b-41af-b250-ae7e2d6cf991 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:35.684138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9a43b-278c-4c90-aeab-229891e90d0c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:35.709770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:35.722283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f8028-12ee-434b-af38-97664c4e8471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:35.722915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f8028-12ee-434b-af38-97664c4e8471 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:35.723191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f8028-12ee-434b-af38-97664c4e8471 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:35.723466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f8028-12ee-434b-af38-97664c4e8471 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:35.724248 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f8028-12ee-434b-af38-97664c4e8471 None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:35.724554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f8028-12ee-434b-af38-97664c4e8471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:35.725909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f8028-12ee-434b-af38-97664c4e8471 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:35.734512 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 300/617] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:35.739957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f8028-12ee-434b-af38-97664c4e8471 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:35.828628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650be6dc-196b-41af-b250-ae7e2d6cf991 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:35.832016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:35.903517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e4e57-76d7-48fa-9e49-edc221a8cb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:35.904171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e4e57-76d7-48fa-9e49-edc221a8cb37 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:35.904464 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e4e57-76d7-48fa-9e49-edc221a8cb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:35.904743 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e4e57-76d7-48fa-9e49-edc221a8cb37 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:35.917223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e4e57-76d7-48fa-9e49-edc221a8cb37 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:35.918693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e4e57-76d7-48fa-9e49-edc221a8cb37 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:35.935358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f8028-12ee-434b-af38-97664c4e8471 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-5a2e4e57-76d7-48fa-9e49-edc221a8cb37 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:35.938096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:35.939056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:35.940051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:35.940051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:35.940051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:35.940051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:35.940051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:35.940051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:35.940051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:35.940051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:35.940051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 16:21:35.940051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:35.948305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 318/618] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:35.953723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e4e57-76d7-48fa-9e49-edc221a8cb37 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:35.975623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a1a49-8172-4a52-8361-9a4e2c7d818c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:35.976352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a1a49-8172-4a52-8361-9a4e2c7d818c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:35.976637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a1a49-8172-4a52-8361-9a4e2c7d818c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:35.976912 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a1a49-8172-4a52-8361-9a4e2c7d818c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:35.988849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a1a49-8172-4a52-8361-9a4e2c7d818c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:35.990276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a1a49-8172-4a52-8361-9a4e2c7d818c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-6a2a1a49-8172-4a52-8361-9a4e2c7d818c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:36.005878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:36.007884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:36.008953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:36.008953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:36.008953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:36.008953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:36.008953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 301/619] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:36.014945 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a1a49-8172-4a52-8361-9a4e2c7d818c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:36.096239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:36.116434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e4e57-76d7-48fa-9e49-edc221a8cb37 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:36.183325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e9155-71ac-4dcf-a7b5-17de00d04802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:36.183889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e9155-71ac-4dcf-a7b5-17de00d04802 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:36.184192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e9155-71ac-4dcf-a7b5-17de00d04802 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:36.184473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e9155-71ac-4dcf-a7b5-17de00d04802 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:36.185271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e9155-71ac-4dcf-a7b5-17de00d04802 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:36.185583 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e9155-71ac-4dcf-a7b5-17de00d04802 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:36.187261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e9155-71ac-4dcf-a7b5-17de00d04802 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:36.220751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 319/620] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 27 16:21:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:36.222667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a1a49-8172-4a52-8361-9a4e2c7d818c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:36.225835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e9155-71ac-4dcf-a7b5-17de00d04802 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:36.252396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:36.297148 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336eec-d566-452e-ae08-805331a19f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:36.298179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336eec-d566-452e-ae08-805331a19f01 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:36.298680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336eec-d566-452e-ae08-805331a19f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:36.299174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336eec-d566-452e-ae08-805331a19f01 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:36.300644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336eec-d566-452e-ae08-805331a19f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:36.301109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336eec-d566-452e-ae08-805331a19f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:36.302640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336eec-d566-452e-ae08-805331a19f01 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:36.334449 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 302/621] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:36.340008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336eec-d566-452e-ae08-805331a19f01 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:36.363907 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e9155-71ac-4dcf-a7b5-17de00d04802 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:36.395821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723806bb-33af-44e8-9342-c24bdca118ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:36.396624 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723806bb-33af-44e8-9342-c24bdca118ef None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:36.396984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723806bb-33af-44e8-9342-c24bdca118ef None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:36.397335 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723806bb-33af-44e8-9342-c24bdca118ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:36.408090 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723806bb-33af-44e8-9342-c24bdca118ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:36.409736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723806bb-33af-44e8-9342-c24bdca118ef None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-723806bb-33af-44e8-9342-c24bdca118ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:36.425905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:36.426906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:36.427840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:36.427840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:36.427840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:36.427840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:36.427840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 320/622] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:36.436850 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723806bb-33af-44e8-9342-c24bdca118ef None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:36.523983 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:36.533177 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336eec-d566-452e-ae08-805331a19f01 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:36.562387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:36.586049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bd582-8f8f-45fe-9447-462774ae9ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:36.587627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bd582-8f8f-45fe-9447-462774ae9ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:36.588623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bd582-8f8f-45fe-9447-462774ae9ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:36.589393 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bd582-8f8f-45fe-9447-462774ae9ed6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:36.600101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bd582-8f8f-45fe-9447-462774ae9ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:36.602260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bd582-8f8f-45fe-9447-462774ae9ed6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:36.609004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723806bb-33af-44e8-9342-c24bdca118ef None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-716bd582-8f8f-45fe-9447-462774ae9ed6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:36.617516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:36.618604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:36.619555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:36.619555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:36.619555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:36.619555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:36.619555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:36.619555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:36.619555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:36.619555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:36.619555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:21:36.619555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:36.621279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 303/623] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 16:21:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:36.626349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f979-0b65-4191-9439-29b242f54890 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:36.626349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f979-0b65-4191-9439-29b242f54890 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:36.626349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f979-0b65-4191-9439-29b242f54890 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:36.628802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 304/624] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:36.630138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f979-0b65-4191-9439-29b242f54890 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:36.661072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a2407-d7d3-400d-984f-f0bf5585fdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:36.662231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a2407-d7d3-400d-984f-f0bf5585fdba None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:36.662626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a2407-d7d3-400d-984f-f0bf5585fdba None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:36.663000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a2407-d7d3-400d-984f-f0bf5585fdba None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:36.664096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a2407-d7d3-400d-984f-f0bf5585fdba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:36.664503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a2407-d7d3-400d-984f-f0bf5585fdba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:36.666400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a2407-d7d3-400d-984f-f0bf5585fdba None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:36.683954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 321/625] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:36.685280 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5127e-7084-4954-a177-d5453a1ca6fd None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:36.685575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5127e-7084-4954-a177-d5453a1ca6fd None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:36.685903 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5127e-7084-4954-a177-d5453a1ca6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:36.713171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c5f5127e-7084-4954-a177-d5453a1ca6fd None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:36.714699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c5f5127e-7084-4954-a177-d5453a1ca6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:36.765413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f979-0b65-4191-9439-29b242f54890 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:36.809488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8135e41-8a32-4ea3-ade2-60daf5f708e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:36.810351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8135e41-8a32-4ea3-ade2-60daf5f708e6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:36.810767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8135e41-8a32-4ea3-ade2-60daf5f708e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:36.811197 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8135e41-8a32-4ea3-ade2-60daf5f708e6 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:36.812221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8135e41-8a32-4ea3-ade2-60daf5f708e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:36.812728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8135e41-8a32-4ea3-ade2-60daf5f708e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:36.814361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8135e41-8a32-4ea3-ade2-60daf5f708e6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:36.816106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 322/626] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:36.817016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5127e-7084-4954-a177-d5453a1ca6fd None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:36.842782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 305/627] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 16:21:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:36.849534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d10c0-dd87-4afd-85fc-cb86cfeb5ac6 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:36.849822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d10c0-dd87-4afd-85fc-cb86cfeb5ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:36.850093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d10c0-dd87-4afd-85fc-cb86cfeb5ac6 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:36.851617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 306/628] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:21:36.852354 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d10c0-dd87-4afd-85fc-cb86cfeb5ac6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:36.869151 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:36.902055 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:36.950452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5127e-7084-4954-a177-d5453a1ca6fd None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:36.956837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d10c0-dd87-4afd-85fc-cb86cfeb5ac6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:36.988019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ee35-0110-4d43-b26e-47294c13030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:36.989041 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ee35-0110-4d43-b26e-47294c13030b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:36.989328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ee35-0110-4d43-b26e-47294c13030b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:36.989605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ee35-0110-4d43-b26e-47294c13030b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:36.993349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e535e3e-e0fd-4535-b8b9-8ce1f07c5f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:36.993990 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e535e3e-e0fd-4535-b8b9-8ce1f07c5f87 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:36.994273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e535e3e-e0fd-4535-b8b9-8ce1f07c5f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:36.994545 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e535e3e-e0fd-4535-b8b9-8ce1f07c5f87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:36.996419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079ee35-0110-4d43-b26e-47294c13030b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:36.997991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079ee35-0110-4d43-b26e-47294c13030b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:37.005973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e535e3e-e0fd-4535-b8b9-8ce1f07c5f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-a079ee35-0110-4d43-b26e-47294c13030b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:37.009614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:37.010505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:37.011522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:37.011522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:37.011522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:37.011522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:37.011522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:37.011522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:37.011522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:37.011522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:37.011522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 323/629] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:37.012075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ee35-0110-4d43-b26e-47294c13030b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-4e535e3e-e0fd-4535-b8b9-8ce1f07c5f87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:37.012741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:37.013642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:37.015023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:37.015023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:37.015023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:37.015023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:37.015023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:37.015023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:37.015023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:37.015023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:37.015023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:37.015023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:37.015023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:37.015023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:37.017621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 307/630] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:37.020426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510cd7f-dde9-4d11-b47a-d38016f60dcd None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:37.020880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510cd7f-dde9-4d11-b47a-d38016f60dcd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:37.021726 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510cd7f-dde9-4d11-b47a-d38016f60dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:37.041110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c510cd7f-dde9-4d11-b47a-d38016f60dcd None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:37.042400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c510cd7f-dde9-4d11-b47a-d38016f60dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:37.119909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 308/631] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:37.119909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510cd7f-dde9-4d11-b47a-d38016f60dcd None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:37.120190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ee35-0110-4d43-b26e-47294c13030b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:37.124145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:37.135624 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:37.160481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fb071-546f-4871-9d2d-3b539f16b739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:37.161102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fb071-546f-4871-9d2d-3b539f16b739 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:37.161384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fb071-546f-4871-9d2d-3b539f16b739 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:37.161659 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fb071-546f-4871-9d2d-3b539f16b739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:37.233633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fb071-546f-4871-9d2d-3b539f16b739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:37.234735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510cd7f-dde9-4d11-b47a-d38016f60dcd None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:37.235086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fb071-546f-4871-9d2d-3b539f16b739 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:37.270467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3df31d-9982-4a36-a2e2-3e5c3f5da575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:37.271017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3df31d-9982-4a36-a2e2-3e5c3f5da575 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:37.271303 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3df31d-9982-4a36-a2e2-3e5c3f5da575 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:37.271587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3df31d-9982-4a36-a2e2-3e5c3f5da575 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:37.272366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3df31d-9982-4a36-a2e2-3e5c3f5da575 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:37.272677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3df31d-9982-4a36-a2e2-3e5c3f5da575 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:37.274091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3df31d-9982-4a36-a2e2-3e5c3f5da575 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:37.296406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 309/632] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:37.296406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3df31d-9982-4a36-a2e2-3e5c3f5da575 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:37.360962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:37.365238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 324/633] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:37.366080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fb071-546f-4871-9d2d-3b539f16b739 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:37.381527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:37.400188 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3df31d-9982-4a36-a2e2-3e5c3f5da575 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:37.433573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2ecef-a37e-4b04-8792-02019c552979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:37.434194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2ecef-a37e-4b04-8792-02019c552979 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:37.434483 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2ecef-a37e-4b04-8792-02019c552979 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:37.434764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2ecef-a37e-4b04-8792-02019c552979 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:37.435475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2ecef-a37e-4b04-8792-02019c552979 None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:37.435786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2ecef-a37e-4b04-8792-02019c552979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:37.437182 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2ecef-a37e-4b04-8792-02019c552979 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:37.445535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 310/634] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:37.446308 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2ecef-a37e-4b04-8792-02019c552979 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:37.467723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fb071-546f-4871-9d2d-3b539f16b739 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:37.501648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42c0cb-f3c9-4d1c-89b2-ffa78ff32a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:37.502297 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42c0cb-f3c9-4d1c-89b2-ffa78ff32a0a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:37.502585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42c0cb-f3c9-4d1c-89b2-ffa78ff32a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:37.503392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42c0cb-f3c9-4d1c-89b2-ffa78ff32a0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:37.513542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42c0cb-f3c9-4d1c-89b2-ffa78ff32a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-dc42c0cb-f3c9-4d1c-89b2-ffa78ff32a0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:37.519026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:37.520056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:37.521412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:37.521412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:37.521412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:37.521412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:37.521412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:37.521412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:37.521412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:37.521412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:37.521412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:37.521412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:37.521412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:37.521412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:37.521412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 325/635] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:37.522362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc03a7-84fc-4fb3-9f36-2a31454a2e78 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:37.522573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc03a7-84fc-4fb3-9f36-2a31454a2e78 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:37.522858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc03a7-84fc-4fb3-9f36-2a31454a2e78 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:37.524141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 326/636] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:37.524841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc03a7-84fc-4fb3-9f36-2a31454a2e78 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:37.551275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2ecef-a37e-4b04-8792-02019c552979 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:37.576135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:37.586069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2154eae-eff4-471f-a17f-22df626fe253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:37.586736 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2154eae-eff4-471f-a17f-22df626fe253 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:37.587026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2154eae-eff4-471f-a17f-22df626fe253 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:37.587299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2154eae-eff4-471f-a17f-22df626fe253 None admin] PATH_INFO: `/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/c48ede3f01be42c39a55c1beeeb85f26/roles/93a2fa7fee0546bfb1e36487e6785cdd` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:37.603685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:37.619848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2154eae-eff4-471f-a17f-22df626fe253 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01ef9cd2ffc4edd94cbf0017a720a57, user_id=c48ede3f01be42c39a55c1beeeb85f26, role_id=93a2fa7fee0546bfb1e36487e6785cdd)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:37.621307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2154eae-eff4-471f-a17f-22df626fe253 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:37.629999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc03a7-84fc-4fb3-9f36-2a31454a2e78 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:37.633959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 311/637] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:21:37 2022] PUT /identity/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/c48ede3f01be42c39a55c1beeeb85f26/roles/93a2fa7fee0546bfb1e36487e6785cdd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:37.634772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2154eae-eff4-471f-a17f-22df626fe253 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:37.678096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51037e-bc5b-4379-954f-b7316022902a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:37.679200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51037e-bc5b-4379-954f-b7316022902a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:37.679570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51037e-bc5b-4379-954f-b7316022902a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:37.679978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51037e-bc5b-4379-954f-b7316022902a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:37.692744 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51037e-bc5b-4379-954f-b7316022902a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:37.694257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51037e-bc5b-4379-954f-b7316022902a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-7e51037e-bc5b-4379-954f-b7316022902a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:37.711125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:37.712529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:37.713475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:37.713475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:37.713475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:37.713475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:37.713475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 327/638] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:37.713475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51037e-bc5b-4379-954f-b7316022902a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:37.756519 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2154eae-eff4-471f-a17f-22df626fe253 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:37.797880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3affa-b763-4e21-9842-a7a0c5c0e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:37.798735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3affa-b763-4e21-9842-a7a0c5c0e627 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:37.799025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3affa-b763-4e21-9842-a7a0c5c0e627 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:37.799305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3affa-b763-4e21-9842-a7a0c5c0e627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:37.810507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3affa-b763-4e21-9842-a7a0c5c0e627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:37.811988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3affa-b763-4e21-9842-a7a0c5c0e627 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:37.826151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51037e-bc5b-4379-954f-b7316022902a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-79a3affa-b763-4e21-9842-a7a0c5c0e627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:37.828375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:37.829345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:37.830253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:37.830253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:37.830253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:37.830253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:37.830253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 312/639] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:37.830871 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf34c-894b-486a-aaba-e950703fb35b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:37.831674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf34c-894b-486a-aaba-e950703fb35b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:37.831976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf34c-894b-486a-aaba-e950703fb35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:37.850677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-424bf34c-894b-486a-aaba-e950703fb35b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:37.851876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-424bf34c-894b-486a-aaba-e950703fb35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:37.856933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:37.867507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94204c-37c1-47e7-b0b1-95cec64d3d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:37.868161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94204c-37c1-47e7-b0b1-95cec64d3d8a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:37.868445 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94204c-37c1-47e7-b0b1-95cec64d3d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:37.868723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94204c-37c1-47e7-b0b1-95cec64d3d8a None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:37.869437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94204c-37c1-47e7-b0b1-95cec64d3d8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:37.869742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94204c-37c1-47e7-b0b1-95cec64d3d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:37.871107 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94204c-37c1-47e7-b0b1-95cec64d3d8a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:37.878218 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:37.879801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 328/640] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:37.880650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94204c-37c1-47e7-b0b1-95cec64d3d8a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:37.928444 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 313/641] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:37.929342 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf34c-894b-486a-aaba-e950703fb35b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:37.998540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94204c-37c1-47e7-b0b1-95cec64d3d8a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:38.035806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c9fef-4d21-442d-8aec-dbfc96fa821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:38.036560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c9fef-4d21-442d-8aec-dbfc96fa821f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:38.036845 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c9fef-4d21-442d-8aec-dbfc96fa821f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:38.037281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c9fef-4d21-442d-8aec-dbfc96fa821f None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:38.037854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c9fef-4d21-442d-8aec-dbfc96fa821f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:38.038104 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c9fef-4d21-442d-8aec-dbfc96fa821f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:38.039480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c9fef-4d21-442d-8aec-dbfc96fa821f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:38.040337 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf34c-894b-486a-aaba-e950703fb35b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:38.052964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 329/642] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:38.054234 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c9fef-4d21-442d-8aec-dbfc96fa821f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:38.078185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f903a-d803-4d3c-a3d0-fb9a49c30875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:38.079485 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f903a-d803-4d3c-a3d0-fb9a49c30875 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:38.079946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f903a-d803-4d3c-a3d0-fb9a49c30875 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:38.080369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f903a-d803-4d3c-a3d0-fb9a49c30875 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:38.081422 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f903a-d803-4d3c-a3d0-fb9a49c30875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:38.081894 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f903a-d803-4d3c-a3d0-fb9a49c30875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:38.083273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f903a-d803-4d3c-a3d0-fb9a49c30875 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:38.096060 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 314/643] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:38.096401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f903a-d803-4d3c-a3d0-fb9a49c30875 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:38.109228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:38.116964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:38.170209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c9fef-4d21-442d-8aec-dbfc96fa821f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:38.204301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83db57a-dbd8-4f8d-802a-ff7a716bcfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:38.204939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83db57a-dbd8-4f8d-802a-ff7a716bcfdf None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:38.205220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83db57a-dbd8-4f8d-802a-ff7a716bcfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:38.205493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83db57a-dbd8-4f8d-802a-ff7a716bcfdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:38.211481 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f903a-d803-4d3c-a3d0-fb9a49c30875 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:38.216197 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83db57a-dbd8-4f8d-802a-ff7a716bcfdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:38.217628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83db57a-dbd8-4f8d-802a-ff7a716bcfdf None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e83db57a-dbd8-4f8d-802a-ff7a716bcfdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:38.232349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:38.233317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:38.239617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:38.239617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:38.239617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:38.239617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:38.239617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 330/644] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:38.239617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83db57a-dbd8-4f8d-802a-ff7a716bcfdf None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:38.255300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0add4-e26e-4d97-879f-c2b650eb52c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:38.255980 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0add4-e26e-4d97-879f-c2b650eb52c6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:38.256260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0add4-e26e-4d97-879f-c2b650eb52c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:38.256531 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0add4-e26e-4d97-879f-c2b650eb52c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:38.267582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0add4-e26e-4d97-879f-c2b650eb52c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-68b0add4-e26e-4d97-879f-c2b650eb52c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:38.273542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:38.274509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:38.275407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:38.275407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:38.275407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:38.275407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:38.275407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:38.275407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:38.275407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:38.275407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:38.275407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:38.275407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:38.275407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:38.275407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:38.275407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 315/645] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:38.276266 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0add4-e26e-4d97-879f-c2b650eb52c6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:38.344820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:38.347559 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83db57a-dbd8-4f8d-802a-ff7a716bcfdf None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:38.363556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:38.386409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0add4-e26e-4d97-879f-c2b650eb52c6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:38.389384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435c399-6779-4eef-9345-3a7c0da8c3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:38.389808 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435c399-6779-4eef-9345-3a7c0da8c3fb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:38.390095 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435c399-6779-4eef-9345-3a7c0da8c3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:38.390375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435c399-6779-4eef-9345-3a7c0da8c3fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:38.398030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435c399-6779-4eef-9345-3a7c0da8c3fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:38.399492 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435c399-6779-4eef-9345-3a7c0da8c3fb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-5435c399-6779-4eef-9345-3a7c0da8c3fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:38.412122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:38.413043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:38.413923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:38.413923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:38.413923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:38.413923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:38.413923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:38.413923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:38.413923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:38.413923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:38.418289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 331/646] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:38.419027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435c399-6779-4eef-9345-3a7c0da8c3fb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:38.424255 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa2851-6624-4ab3-89ca-a48b73c61dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:38.425434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa2851-6624-4ab3-89ca-a48b73c61dfe None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:38.425713 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa2851-6624-4ab3-89ca-a48b73c61dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:38.425987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa2851-6624-4ab3-89ca-a48b73c61dfe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:38.434354 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa2851-6624-4ab3-89ca-a48b73c61dfe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:38.435764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa2851-6624-4ab3-89ca-a48b73c61dfe None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-08aa2851-6624-4ab3-89ca-a48b73c61dfe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:38.447430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:38.448437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:38.449396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:38.449396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:38.449396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:38.449396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:38.449396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:38.449396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:38.449396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:38.449396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:38.449396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:21:38.449396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:38.449396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 316/647] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:38.449396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa2851-6624-4ab3-89ca-a48b73c61dfe None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:38.529987 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435c399-6779-4eef-9345-3a7c0da8c3fb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:38.555755 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa2851-6624-4ab3-89ca-a48b73c61dfe None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:38.564930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a548194-7b50-40da-a59d-c3076ffd828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:38.566096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a548194-7b50-40da-a59d-c3076ffd828b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:38.566387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a548194-7b50-40da-a59d-c3076ffd828b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:38.566665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a548194-7b50-40da-a59d-c3076ffd828b None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:38.567352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a548194-7b50-40da-a59d-c3076ffd828b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:38.567658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a548194-7b50-40da-a59d-c3076ffd828b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:38.569071 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a548194-7b50-40da-a59d-c3076ffd828b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:38.585582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 332/648] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:38.585582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a548194-7b50-40da-a59d-c3076ffd828b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:38.597623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2653c-605d-451a-9fe8-915e9eb803f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:38.598167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2653c-605d-451a-9fe8-915e9eb803f9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:38.598450 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2653c-605d-451a-9fe8-915e9eb803f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:38.598727 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2653c-605d-451a-9fe8-915e9eb803f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:38.599447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2653c-605d-451a-9fe8-915e9eb803f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:38.599771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2653c-605d-451a-9fe8-915e9eb803f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:38.601164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2653c-605d-451a-9fe8-915e9eb803f9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:38.606763 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:38.609636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:38.616742 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 317/649] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:38.617640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2653c-605d-451a-9fe8-915e9eb803f9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:38.705523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a548194-7b50-40da-a59d-c3076ffd828b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:38.727561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2653c-605d-451a-9fe8-915e9eb803f9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:38.744256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6675d9-7e33-4461-87a3-f58de4185c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:38.744886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6675d9-7e33-4461-87a3-f58de4185c9a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:38.745167 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6675d9-7e33-4461-87a3-f58de4185c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:38.745441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6675d9-7e33-4461-87a3-f58de4185c9a None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:38.746200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6675d9-7e33-4461-87a3-f58de4185c9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:38.746507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6675d9-7e33-4461-87a3-f58de4185c9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:38.748007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6675d9-7e33-4461-87a3-f58de4185c9a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:38.763396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 333/650] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:38.764588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6675d9-7e33-4461-87a3-f58de4185c9a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:38.771807 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4d154-609f-46c8-be7b-442b99d1a965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:38.772483 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4d154-609f-46c8-be7b-442b99d1a965 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:38.772768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4d154-609f-46c8-be7b-442b99d1a965 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:38.773045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4d154-609f-46c8-be7b-442b99d1a965 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:38.773840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4d154-609f-46c8-be7b-442b99d1a965 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:38.774149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4d154-609f-46c8-be7b-442b99d1a965 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:38.775564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4d154-609f-46c8-be7b-442b99d1a965 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:38.794205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 318/651] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 27 16:21:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:38.795039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4d154-609f-46c8-be7b-442b99d1a965 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:38.857068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:38.859029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:38.882526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6675d9-7e33-4461-87a3-f58de4185c9a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:38.902807 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4d154-609f-46c8-be7b-442b99d1a965 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:38.919732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e836c25-1582-40c3-a075-793326003fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:38.920524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e836c25-1582-40c3-a075-793326003fda None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:38.920812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e836c25-1582-40c3-a075-793326003fda None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:38.921091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e836c25-1582-40c3-a075-793326003fda None admin] PATH_INFO: `/v3/users/glance` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:38.929576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e836c25-1582-40c3-a075-793326003fda None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:38.931149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e836c25-1582-40c3-a075-793326003fda None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:38.937365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befba689-4f5a-4170-9af1-063ba8d01987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:38.938003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befba689-4f5a-4170-9af1-063ba8d01987 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:38.938291 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befba689-4f5a-4170-9af1-063ba8d01987 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:38.938567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befba689-4f5a-4170-9af1-063ba8d01987 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-3e836c25-1582-40c3-a075-793326003fda None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:38.943068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:38.944251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:38.945360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:38.945360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:38.945360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:38.945360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:38.945360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:38.945360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:38.945360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:38.945360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:38.945360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 16:21:38.945360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:38.948997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 334/652] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:38.949581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e836c25-1582-40c3-a075-793326003fda None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:38.950144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befba689-4f5a-4170-9af1-063ba8d01987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:38.951587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befba689-4f5a-4170-9af1-063ba8d01987 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-befba689-4f5a-4170-9af1-063ba8d01987 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:38.967614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:38.968615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:38.969775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:38.969775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:38.969775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:38.969775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:38.969775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 319/653] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:38.969775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befba689-4f5a-4170-9af1-063ba8d01987 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:39.060926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e836c25-1582-40c3-a075-793326003fda None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:39.074822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befba689-4f5a-4170-9af1-063ba8d01987 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:39.085815 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:39.097961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc2272-fa69-4915-80f6-c5353e33f849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:39.098585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc2272-fa69-4915-80f6-c5353e33f849 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:39.098870 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc2272-fa69-4915-80f6-c5353e33f849 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:39.099149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc2272-fa69-4915-80f6-c5353e33f849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:39.099957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc2272-fa69-4915-80f6-c5353e33f849 None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=9d5a8ef373ca4ed7bf31361e24e42e54) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:39.100275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc2272-fa69-4915-80f6-c5353e33f849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:39.101709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc2272-fa69-4915-80f6-c5353e33f849 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:39.107940 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 335/654] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:38 2022] GET /identity/v3/role_assignments?user.id=9d5a8ef373ca4ed7bf31361e24e42e54&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:39.108532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc2272-fa69-4915-80f6-c5353e33f849 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:39.111808 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:39.126474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cf729-191e-4d44-a54a-456c0029161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:39.127419 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cf729-191e-4d44-a54a-456c0029161a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:39.128336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cf729-191e-4d44-a54a-456c0029161a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:39.128796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cf729-191e-4d44-a54a-456c0029161a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:39.228466 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc2272-fa69-4915-80f6-c5353e33f849 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:39.236957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cf729-191e-4d44-a54a-456c0029161a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:39.239133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cf729-191e-4d44-a54a-456c0029161a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:39.279652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5ffd9-b7d7-496a-b1aa-edc8cc7ee4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:39.280317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ffd9-b7d7-496a-b1aa-edc8cc7ee4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:39.280624 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ffd9-b7d7-496a-b1aa-edc8cc7ee4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:39.280876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ffd9-b7d7-496a-b1aa-edc8cc7ee4d9 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:39.282008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5ffd9-b7d7-496a-b1aa-edc8cc7ee4d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:39.282008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5ffd9-b7d7-496a-b1aa-edc8cc7ee4d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:39.283417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5ffd9-b7d7-496a-b1aa-edc8cc7ee4d9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:39.305304 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 336/655] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 27 16:21:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:39.305994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5ffd9-b7d7-496a-b1aa-edc8cc7ee4d9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:39.379991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 320/656] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:39.381841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cf729-191e-4d44-a54a-456c0029161a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:39.387338 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:39.398295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:39.439694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5ffd9-b7d7-496a-b1aa-edc8cc7ee4d9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:39.493035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362fe91-5df4-4b16-bf8c-47bdc7a0b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:39.493708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362fe91-5df4-4b16-bf8c-47bdc7a0b960 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:39.493992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362fe91-5df4-4b16-bf8c-47bdc7a0b960 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:39.494270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362fe91-5df4-4b16-bf8c-47bdc7a0b960 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:39.495250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362fe91-5df4-4b16-bf8c-47bdc7a0b960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:39.495557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362fe91-5df4-4b16-bf8c-47bdc7a0b960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:39.497584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362fe91-5df4-4b16-bf8c-47bdc7a0b960 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:39.500224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cf729-191e-4d44-a54a-456c0029161a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:39.514025 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 337/657] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:39.515378 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362fe91-5df4-4b16-bf8c-47bdc7a0b960 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:39.542005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713ffc3-5183-4b1c-b768-4146e99c8623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:39.543030 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713ffc3-5183-4b1c-b768-4146e99c8623 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:39.543566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713ffc3-5183-4b1c-b768-4146e99c8623 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:39.544080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713ffc3-5183-4b1c-b768-4146e99c8623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:39.622099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713ffc3-5183-4b1c-b768-4146e99c8623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:39.624400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713ffc3-5183-4b1c-b768-4146e99c8623 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:39.639120 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:39.654882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362fe91-5df4-4b16-bf8c-47bdc7a0b960 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:39.681659 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:39.699188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061385e2-9644-4e5a-a7a7-dd87a1f188b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:39.699842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061385e2-9644-4e5a-a7a7-dd87a1f188b7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:39.700157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061385e2-9644-4e5a-a7a7-dd87a1f188b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:39.700437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061385e2-9644-4e5a-a7a7-dd87a1f188b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:39.712513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061385e2-9644-4e5a-a7a7-dd87a1f188b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:39.713977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061385e2-9644-4e5a-a7a7-dd87a1f188b7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-061385e2-9644-4e5a-a7a7-dd87a1f188b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:39.729154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:39.730093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:39.730984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:39.730984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:39.730984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:39.730984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:39.730984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 338/658] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:39.732341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061385e2-9644-4e5a-a7a7-dd87a1f188b7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:39.752849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 321/659] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:39.752849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e178b-b5a7-4c90-b57d-034f78bfa4c7 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:39.752849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e178b-b5a7-4c90-b57d-034f78bfa4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:39.752849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e178b-b5a7-4c90-b57d-034f78bfa4c7 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:39.752849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 322/660] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:39.752849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e178b-b5a7-4c90-b57d-034f78bfa4c7 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:39.843926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061385e2-9644-4e5a-a7a7-dd87a1f188b7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:39.863238 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e178b-b5a7-4c90-b57d-034f78bfa4c7 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:39.874014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:39.879396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07fb2c-fed8-4df5-bb80-3229fa0e4333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:39.880092 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07fb2c-fed8-4df5-bb80-3229fa0e4333 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:39.880382 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07fb2c-fed8-4df5-bb80-3229fa0e4333 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:39.880665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07fb2c-fed8-4df5-bb80-3229fa0e4333 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:39.888556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07fb2c-fed8-4df5-bb80-3229fa0e4333 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:39.890062 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07fb2c-fed8-4df5-bb80-3229fa0e4333 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:39.901487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdc402-ef62-4e63-a71e-a64236e65a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-6d07fb2c-fed8-4df5-bb80-3229fa0e4333 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:39.901819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:39.902749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:39.903691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:39.903691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:39.903691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:39.903691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:39.903691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:39.903691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:39.903691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:39.903691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:39.903691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 16:21:39.903691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:39.904771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdc402-ef62-4e63-a71e-a64236e65a2d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:39.904771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdc402-ef62-4e63-a71e-a64236e65a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:39.904771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdc402-ef62-4e63-a71e-a64236e65a2d None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:39.904771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdc402-ef62-4e63-a71e-a64236e65a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:39.904771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdc402-ef62-4e63-a71e-a64236e65a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:39.905088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdc402-ef62-4e63-a71e-a64236e65a2d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:39.907595 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 339/661] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:39.908473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07fb2c-fed8-4df5-bb80-3229fa0e4333 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:39.922183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 323/662] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:39.922183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e98ecd-90b5-414e-9578-d8ac7775f321 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:39.922183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e98ecd-90b5-414e-9578-d8ac7775f321 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:39.922183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e98ecd-90b5-414e-9578-d8ac7775f321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:39.939812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-48e98ecd-90b5-414e-9578-d8ac7775f321 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:39.941532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-48e98ecd-90b5-414e-9578-d8ac7775f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:39.948017 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:40.014386 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 324/663] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:40.019516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07fb2c-fed8-4df5-bb80-3229fa0e4333 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:40.020807 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e98ecd-90b5-414e-9578-d8ac7775f321 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:40.056460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d825c8b-73d2-4b9e-b21d-1c945fb89afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:40.057342 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825c8b-73d2-4b9e-b21d-1c945fb89afc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:40.057777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825c8b-73d2-4b9e-b21d-1c945fb89afc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:40.058239 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825c8b-73d2-4b9e-b21d-1c945fb89afc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:40.071219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d825c8b-73d2-4b9e-b21d-1c945fb89afc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:40.073327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d825c8b-73d2-4b9e-b21d-1c945fb89afc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-6d825c8b-73d2-4b9e-b21d-1c945fb89afc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:40.090518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:40.091668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:40.092741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:40.092741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:40.092741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:40.092741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:40.099110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 340/664] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:40.100166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d825c8b-73d2-4b9e-b21d-1c945fb89afc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:40.126646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:40.130256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e98ecd-90b5-414e-9578-d8ac7775f321 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:40.169234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe85cb-2386-477d-9fbf-120518ca9f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:40.169786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe85cb-2386-477d-9fbf-120518ca9f08 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:40.170072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe85cb-2386-477d-9fbf-120518ca9f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:40.170512 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe85cb-2386-477d-9fbf-120518ca9f08 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:40.171780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe85cb-2386-477d-9fbf-120518ca9f08 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:40.172128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe85cb-2386-477d-9fbf-120518ca9f08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:40.173551 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe85cb-2386-477d-9fbf-120518ca9f08 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:40.191501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 325/665] 10.222.0.67 () {56 vars in 1139 bytes} [Wed Jul 27 16:21:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:40.192065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:40.192369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe85cb-2386-477d-9fbf-120518ca9f08 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:40.211974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d825c8b-73d2-4b9e-b21d-1c945fb89afc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:40.247199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad06172-b9a7-4311-9c2c-690ca4c9cbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:40.247845 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad06172-b9a7-4311-9c2c-690ca4c9cbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:40.248150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad06172-b9a7-4311-9c2c-690ca4c9cbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:40.248425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad06172-b9a7-4311-9c2c-690ca4c9cbc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:40.256351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad06172-b9a7-4311-9c2c-690ca4c9cbc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:40.257770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad06172-b9a7-4311-9c2c-690ca4c9cbc5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-bad06172-b9a7-4311-9c2c-690ca4c9cbc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:40.269800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:40.270864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:40.276841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:40.276841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:40.276841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:40.276841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:40.276841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:40.276841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:40.276841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:40.276841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:40.276841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 341/666] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:40.276841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad06172-b9a7-4311-9c2c-690ca4c9cbc5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:40.306036 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe85cb-2386-477d-9fbf-120518ca9f08 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:40.342484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9e791-efaf-4336-a61b-f82cd7659360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:40.343340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9e791-efaf-4336-a61b-f82cd7659360 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:40.343772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9e791-efaf-4336-a61b-f82cd7659360 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:40.344193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9e791-efaf-4336-a61b-f82cd7659360 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:40.356883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9e791-efaf-4336-a61b-f82cd7659360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-fdc9e791-efaf-4336-a61b-f82cd7659360 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:40.362371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:40.363503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:40.364550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:40.364550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:40.364550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:40.364550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:40.364550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:40.364550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:40.364550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:40.364550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:40.364550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:40.364550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:40.364550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:40.364550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:40.366677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 326/667] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:40.367723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9e791-efaf-4336-a61b-f82cd7659360 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:40.383720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad06172-b9a7-4311-9c2c-690ca4c9cbc5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:40.390138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:40.418929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386b0fc-44ab-4ae4-9705-90f9d32270df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:40.419610 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386b0fc-44ab-4ae4-9705-90f9d32270df None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:40.419843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386b0fc-44ab-4ae4-9705-90f9d32270df None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:40.420152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386b0fc-44ab-4ae4-9705-90f9d32270df None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:40.420863 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386b0fc-44ab-4ae4-9705-90f9d32270df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:40.421185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386b0fc-44ab-4ae4-9705-90f9d32270df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:40.422557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386b0fc-44ab-4ae4-9705-90f9d32270df None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:40.434486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 342/668] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:40.435315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386b0fc-44ab-4ae4-9705-90f9d32270df None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:40.445954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:40.491433 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9e791-efaf-4336-a61b-f82cd7659360 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:40.527847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2564c0-c796-4e4f-b4ba-03dc1a8373b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:40.528507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2564c0-c796-4e4f-b4ba-03dc1a8373b6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:40.528789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2564c0-c796-4e4f-b4ba-03dc1a8373b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:40.529064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2564c0-c796-4e4f-b4ba-03dc1a8373b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:40.544283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386b0fc-44ab-4ae4-9705-90f9d32270df None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:40.579142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b102bc-bf36-4538-b2c1-255490aefab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:40.579765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b102bc-bf36-4538-b2c1-255490aefab3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:40.580077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b102bc-bf36-4538-b2c1-255490aefab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:40.580358 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b102bc-bf36-4538-b2c1-255490aefab3 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:40.582064 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b102bc-bf36-4538-b2c1-255490aefab3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:40.582379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b102bc-bf36-4538-b2c1-255490aefab3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:40.583820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b102bc-bf36-4538-b2c1-255490aefab3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:40.595723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 343/669] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:40.597609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b102bc-bf36-4538-b2c1-255490aefab3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:40.615144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2564c0-c796-4e4f-b4ba-03dc1a8373b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:40.617494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2564c0-c796-4e4f-b4ba-03dc1a8373b6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:40.644386 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:40.667252 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:40.706180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b102bc-bf36-4538-b2c1-255490aefab3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:40.743971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f3ff5-764a-4b94-84c7-ac1546666d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:40.744596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f3ff5-764a-4b94-84c7-ac1546666d8f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:40.744883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f3ff5-764a-4b94-84c7-ac1546666d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:40.745167 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f3ff5-764a-4b94-84c7-ac1546666d8f None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:40.745766 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 327/670] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:40.745877 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f3ff5-764a-4b94-84c7-ac1546666d8f None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:40.746185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f3ff5-764a-4b94-84c7-ac1546666d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:40.747581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f3ff5-764a-4b94-84c7-ac1546666d8f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:40.750846 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2564c0-c796-4e4f-b4ba-03dc1a8373b6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:40.760712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 344/671] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:40.760712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f3ff5-764a-4b94-84c7-ac1546666d8f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:40.858849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2564c0-c796-4e4f-b4ba-03dc1a8373b6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:40.868153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f3ff5-764a-4b94-84c7-ac1546666d8f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:40.878949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:40.896966 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:40.897788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99d356-a11c-4eb1-b281-1188c4e31e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:40.898589 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99d356-a11c-4eb1-b281-1188c4e31e2c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:40.898729 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99d356-a11c-4eb1-b281-1188c4e31e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:40.899031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99d356-a11c-4eb1-b281-1188c4e31e2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:40.905685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76157926-9bb2-41e4-b75e-24a312bebc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:40.906307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157926-9bb2-41e4-b75e-24a312bebc1c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:40.906594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157926-9bb2-41e4-b75e-24a312bebc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:40.906715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99d356-a11c-4eb1-b281-1188c4e31e2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:40.906885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157926-9bb2-41e4-b75e-24a312bebc1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:40.907650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76157926-9bb2-41e4-b75e-24a312bebc1c None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=96c5238a91b540b7ba3921a9d561e255) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:40.907995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76157926-9bb2-41e4-b75e-24a312bebc1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:40.908102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99d356-a11c-4eb1-b281-1188c4e31e2c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:40.909949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76157926-9bb2-41e4-b75e-24a312bebc1c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:40.922605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 345/672] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:40 2022] GET /identity/v3/role_assignments?user.id=96c5238a91b540b7ba3921a9d561e255&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:40.922605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76157926-9bb2-41e4-b75e-24a312bebc1c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-9d99d356-a11c-4eb1-b281-1188c4e31e2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:40.922920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:40.923932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:40.925215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:40.925215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:40.925215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:40.925215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:40.925215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:40.925215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:40.925215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:40.925215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:40.925215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 328/673] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:40.925215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99d356-a11c-4eb1-b281-1188c4e31e2c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:41.043062 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76157926-9bb2-41e4-b75e-24a312bebc1c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:41.060235 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99d356-a11c-4eb1-b281-1188c4e31e2c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:41.084510 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290214f7-4593-42ad-b7ba-86c342ee153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:41.085283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290214f7-4593-42ad-b7ba-86c342ee153d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:41.085621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290214f7-4593-42ad-b7ba-86c342ee153d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:41.085969 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290214f7-4593-42ad-b7ba-86c342ee153d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:41.099596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290214f7-4593-42ad-b7ba-86c342ee153d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:41.101488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290214f7-4593-42ad-b7ba-86c342ee153d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:41.116252 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c7a70-b0d2-4ca6-889a-9b05a248be28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:41.117068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c7a70-b0d2-4ca6-889a-9b05a248be28 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:41.117453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c7a70-b0d2-4ca6-889a-9b05a248be28 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:41.117738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c7a70-b0d2-4ca6-889a-9b05a248be28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-290214f7-4593-42ad-b7ba-86c342ee153d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:41.119423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:41.120331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:41.121236 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:41.121236 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:41.121236 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:41.121236 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:41.121856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 346/674] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:41.122289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290214f7-4593-42ad-b7ba-86c342ee153d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:41.132723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c7a70-b0d2-4ca6-889a-9b05a248be28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:41.134676 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c7a70-b0d2-4ca6-889a-9b05a248be28 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-9d0c7a70-b0d2-4ca6-889a-9b05a248be28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:41.154369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:41.155366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:41.156305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:41.156305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:41.156305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:41.156305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:41.156305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 329/675] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:41.157329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c7a70-b0d2-4ca6-889a-9b05a248be28 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:41.187234 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:41.197314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:41.255750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290214f7-4593-42ad-b7ba-86c342ee153d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:41.291721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c7a70-b0d2-4ca6-889a-9b05a248be28 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:41.299920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea9140-ce43-4893-8fc3-731792e1ccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:41.300515 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea9140-ce43-4893-8fc3-731792e1ccd2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:41.300780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea9140-ce43-4893-8fc3-731792e1ccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:41.301053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea9140-ce43-4893-8fc3-731792e1ccd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:41.302158 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea9140-ce43-4893-8fc3-731792e1ccd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:41.302474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea9140-ce43-4893-8fc3-731792e1ccd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:41.304271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea9140-ce43-4893-8fc3-731792e1ccd2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:41.317794 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 347/676] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:41.318628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea9140-ce43-4893-8fc3-731792e1ccd2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:41.335801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd6a24-4d97-4a13-8a77-16f2376601e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:41.336530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd6a24-4d97-4a13-8a77-16f2376601e9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:41.337097 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd6a24-4d97-4a13-8a77-16f2376601e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:41.337435 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd6a24-4d97-4a13-8a77-16f2376601e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:41.338530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd6a24-4d97-4a13-8a77-16f2376601e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:41.338901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd6a24-4d97-4a13-8a77-16f2376601e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:41.340860 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd6a24-4d97-4a13-8a77-16f2376601e9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:41.354888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 330/677] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:41.356225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9162b6a-c72b-41b3-bc86-f3bce3cccdbc None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:41.356513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9162b6a-c72b-41b3-bc86-f3bce3cccdbc None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:41.356789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9162b6a-c72b-41b3-bc86-f3bce3cccdbc None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:41.358126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 331/678] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:41.362986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9162b6a-c72b-41b3-bc86-f3bce3cccdbc None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:41.448770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea9140-ce43-4893-8fc3-731792e1ccd2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:41.452148 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:41.491097 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:41.505329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03a3be-2447-4b57-b20e-2d5fe922df01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:41.506415 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03a3be-2447-4b57-b20e-2d5fe922df01 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:41.506987 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03a3be-2447-4b57-b20e-2d5fe922df01 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:41.507536 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03a3be-2447-4b57-b20e-2d5fe922df01 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:41.508717 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9162b6a-c72b-41b3-bc86-f3bce3cccdbc None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:41.508827 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03a3be-2447-4b57-b20e-2d5fe922df01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:41.509214 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03a3be-2447-4b57-b20e-2d5fe922df01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:41.511525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03a3be-2447-4b57-b20e-2d5fe922df01 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:41.534631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 348/679] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:41.534631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03a3be-2447-4b57-b20e-2d5fe922df01 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:41.558891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0577c1a-5ff2-46bf-9152-4e11935bffee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:41.559533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0577c1a-5ff2-46bf-9152-4e11935bffee None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:41.559910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0577c1a-5ff2-46bf-9152-4e11935bffee None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:41.560259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0577c1a-5ff2-46bf-9152-4e11935bffee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:41.561115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0577c1a-5ff2-46bf-9152-4e11935bffee None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=b1832d9988604b81bcb075ae77db6d80) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:41.561562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0577c1a-5ff2-46bf-9152-4e11935bffee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:41.562917 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0577c1a-5ff2-46bf-9152-4e11935bffee None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:41.579887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 332/680] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:41 2022] GET /identity/v3/role_assignments?user.id=b1832d9988604b81bcb075ae77db6d80&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:41.579887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3044e9-5365-43dc-b71b-0b3a241b6335 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:41.579887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3044e9-5365-43dc-b71b-0b3a241b6335 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:41.579887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3044e9-5365-43dc-b71b-0b3a241b6335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:41.599752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0e3044e9-5365-43dc-b71b-0b3a241b6335 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:41.601131 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0e3044e9-5365-43dc-b71b-0b3a241b6335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:41.673468 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03a3be-2447-4b57-b20e-2d5fe922df01 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:41.690781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 333/681] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:41.691825 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3044e9-5365-43dc-b71b-0b3a241b6335 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:41.713175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b2f53-c5c1-461f-a54c-cb901d5aa324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:41.713831 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b2f53-c5c1-461f-a54c-cb901d5aa324 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:41.714117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b2f53-c5c1-461f-a54c-cb901d5aa324 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:41.714393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b2f53-c5c1-461f-a54c-cb901d5aa324 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:41.722991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b2f53-c5c1-461f-a54c-cb901d5aa324 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:41.724588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b2f53-c5c1-461f-a54c-cb901d5aa324 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-797b2f53-c5c1-461f-a54c-cb901d5aa324 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:41.737401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:41.738380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:41.739742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:41.739742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:41.739742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:41.739742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:41.739742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:41.739742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:41.739742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:41.739742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:41.739742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 349/682] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:41.740279 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b2f53-c5c1-461f-a54c-cb901d5aa324 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:41.775026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:41.807091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:41.826134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3044e9-5365-43dc-b71b-0b3a241b6335 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:41.866030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b2f53-c5c1-461f-a54c-cb901d5aa324 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:41.866336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f158b-9638-41d9-9066-4e6ef01fbe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:41.866912 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f158b-9638-41d9-9066-4e6ef01fbe02 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:41.867194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f158b-9638-41d9-9066-4e6ef01fbe02 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:41.867585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f158b-9638-41d9-9066-4e6ef01fbe02 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:41.876456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f158b-9638-41d9-9066-4e6ef01fbe02 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:41.878457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f158b-9638-41d9-9066-4e6ef01fbe02 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-662f158b-9638-41d9-9066-4e6ef01fbe02 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:41.893090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:41.894938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:41.895949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:41.895949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:41.895949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:41.895949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:41.895949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:41.895949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:41.895949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:41.895949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:41.895949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 16:21:41.895949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:41.895949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 334/683] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:41.895949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f158b-9638-41d9-9066-4e6ef01fbe02 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:41.911379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01962cd2-a0f6-4fb3-a3c2-0d993cb7f362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:41.912063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962cd2-a0f6-4fb3-a3c2-0d993cb7f362 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:41.912353 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962cd2-a0f6-4fb3-a3c2-0d993cb7f362 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:41.912635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962cd2-a0f6-4fb3-a3c2-0d993cb7f362 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:41.923405 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01962cd2-a0f6-4fb3-a3c2-0d993cb7f362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-01962cd2-a0f6-4fb3-a3c2-0d993cb7f362 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:41.929040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:41.930009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:41.931240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:41.931240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:41.931240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:41.931240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:41.931240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:41.931240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:41.931240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:41.931240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:41.931240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:41.931240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:41.931240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:41.931240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:41.931240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 350/684] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:41.932023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01962cd2-a0f6-4fb3-a3c2-0d993cb7f362 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:42.018808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f158b-9638-41d9-9066-4e6ef01fbe02 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:42.025980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:42.042998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01962cd2-a0f6-4fb3-a3c2-0d993cb7f362 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:42.060907 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615ed58-5b82-49b7-bcee-8581bed2bd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:42.061888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615ed58-5b82-49b7-bcee-8581bed2bd57 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:42.062380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615ed58-5b82-49b7-bcee-8581bed2bd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:42.062861 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615ed58-5b82-49b7-bcee-8581bed2bd57 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:42.063943 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615ed58-5b82-49b7-bcee-8581bed2bd57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:42.064472 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615ed58-5b82-49b7-bcee-8581bed2bd57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:42.066341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615ed58-5b82-49b7-bcee-8581bed2bd57 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:42.078499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bcb9e-7f0d-4222-8839-de7cf97f8b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:42.079047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bcb9e-7f0d-4222-8839-de7cf97f8b92 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:42.079333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bcb9e-7f0d-4222-8839-de7cf97f8b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:42.079669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bcb9e-7f0d-4222-8839-de7cf97f8b92 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:42.081048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bcb9e-7f0d-4222-8839-de7cf97f8b92 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:42.081376 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bcb9e-7f0d-4222-8839-de7cf97f8b92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:42.082647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 335/685] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:42.082866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bcb9e-7f0d-4222-8839-de7cf97f8b92 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:42.084023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615ed58-5b82-49b7-bcee-8581bed2bd57 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:42.088316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:42.106922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 351/686] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 27 16:21:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:42.107960 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bcb9e-7f0d-4222-8839-de7cf97f8b92 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:42.192712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615ed58-5b82-49b7-bcee-8581bed2bd57 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:42.232350 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bcb9e-7f0d-4222-8839-de7cf97f8b92 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:42.233527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799dcbb-9bc8-4312-8b42-f24f548ff3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:42.234678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799dcbb-9bc8-4312-8b42-f24f548ff3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:42.236076 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799dcbb-9bc8-4312-8b42-f24f548ff3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:42.236559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799dcbb-9bc8-4312-8b42-f24f548ff3e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:42.238045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799dcbb-9bc8-4312-8b42-f24f548ff3e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:42.238570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799dcbb-9bc8-4312-8b42-f24f548ff3e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:42.240164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799dcbb-9bc8-4312-8b42-f24f548ff3e1 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:42.252314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 336/687] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:42.253805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799dcbb-9bc8-4312-8b42-f24f548ff3e1 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:42.278817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb6923-d2e0-4ee1-bbc3-7b5fdf1491a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:42.279795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb6923-d2e0-4ee1-bbc3-7b5fdf1491a2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:42.280122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb6923-d2e0-4ee1-bbc3-7b5fdf1491a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:42.280404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb6923-d2e0-4ee1-bbc3-7b5fdf1491a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:42.281200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb6923-d2e0-4ee1-bbc3-7b5fdf1491a2 None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=73325bdd109749ad92a66e600fd61a1a) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:42.281518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb6923-d2e0-4ee1-bbc3-7b5fdf1491a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:42.282949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb6923-d2e0-4ee1-bbc3-7b5fdf1491a2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:42.291845 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 352/688] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:42 2022] GET /identity/v3/role_assignments?user.id=73325bdd109749ad92a66e600fd61a1a&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:42.292851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb6923-d2e0-4ee1-bbc3-7b5fdf1491a2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:42.305308 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:42.342388 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:42.418610 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799dcbb-9bc8-4312-8b42-f24f548ff3e1 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:42.484137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb6923-d2e0-4ee1-bbc3-7b5fdf1491a2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:42.494925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047a2d5-ffa2-431f-9c69-74f0b63c40dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:42.495565 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047a2d5-ffa2-431f-9c69-74f0b63c40dc None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:42.495852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047a2d5-ffa2-431f-9c69-74f0b63c40dc None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:42.496247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047a2d5-ffa2-431f-9c69-74f0b63c40dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:42.532421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f7bc4-e325-4394-8ac5-71de2ba73e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:42.534140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f7bc4-e325-4394-8ac5-71de2ba73e53 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:42.534558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f7bc4-e325-4394-8ac5-71de2ba73e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:42.534842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f7bc4-e325-4394-8ac5-71de2ba73e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:42.548396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f7bc4-e325-4394-8ac5-71de2ba73e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:42.550863 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f7bc4-e325-4394-8ac5-71de2ba73e53 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e56f7bc4-e325-4394-8ac5-71de2ba73e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:42.572133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:42.573077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:42.573977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:42.573977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:42.573977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:42.573977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:42.574688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 353/689] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:42.579472 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047a2d5-ffa2-431f-9c69-74f0b63c40dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:42.580884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f7bc4-e325-4394-8ac5-71de2ba73e53 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:42.581077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047a2d5-ffa2-431f-9c69-74f0b63c40dc None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:42.666327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:42.669817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:42.707935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 337/690] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:42.716837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047a2d5-ffa2-431f-9c69-74f0b63c40dc None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:42.736479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f7bc4-e325-4394-8ac5-71de2ba73e53 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:42.818784 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c00178-82d4-4dc0-b778-d3a3c5d33289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:42.819659 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c00178-82d4-4dc0-b778-d3a3c5d33289 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:42.820151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c00178-82d4-4dc0-b778-d3a3c5d33289 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:42.820592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c00178-82d4-4dc0-b778-d3a3c5d33289 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:42.821437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c00178-82d4-4dc0-b778-d3a3c5d33289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:42.821894 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c00178-82d4-4dc0-b778-d3a3c5d33289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:42.825315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c00178-82d4-4dc0-b778-d3a3c5d33289 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:42.856000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 354/691] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:42.866828 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047a2d5-ffa2-431f-9c69-74f0b63c40dc None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:42.869692 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c00178-82d4-4dc0-b778-d3a3c5d33289 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:42.964517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc373c-596d-4d82-9f18-8940a579990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:42.965363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc373c-596d-4d82-9f18-8940a579990b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:42.965644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc373c-596d-4d82-9f18-8940a579990b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:42.966009 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc373c-596d-4d82-9f18-8940a579990b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:42.983257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c00178-82d4-4dc0-b778-d3a3c5d33289 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:43.001066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc373c-596d-4d82-9f18-8940a579990b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:43.003064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc373c-596d-4d82-9f18-8940a579990b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:43.013973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:43.036222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037e3b9-68b8-493f-8929-c0d636d9cfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:43.036222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037e3b9-68b8-493f-8929-c0d636d9cfff None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:43.036222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037e3b9-68b8-493f-8929-c0d636d9cfff None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:43.036222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037e3b9-68b8-493f-8929-c0d636d9cfff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-57bc373c-596d-4d82-9f18-8940a579990b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:43.037314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:43.038260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:43.039189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:43.039189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:43.039189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:43.039189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:43.041461 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 338/692] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:43.046687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc373c-596d-4d82-9f18-8940a579990b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:43.047895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037e3b9-68b8-493f-8929-c0d636d9cfff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:43.050054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037e3b9-68b8-493f-8929-c0d636d9cfff None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-8037e3b9-68b8-493f-8929-c0d636d9cfff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:43.073557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:43.074596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:43.075562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:43.075562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:43.075562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:43.075562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:43.075562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:43.075562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:43.075562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:43.075562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:43.075562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:21:43.075562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:43.081577 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 355/693] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 16:21:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:43.087237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037e3b9-68b8-493f-8929-c0d636d9cfff None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:43.091787 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:43.219683 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc373c-596d-4d82-9f18-8940a579990b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:43.220593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037e3b9-68b8-493f-8929-c0d636d9cfff None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:43.258557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad58c53-b387-4280-8c00-a90dfe96effb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:43.259185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad58c53-b387-4280-8c00-a90dfe96effb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:43.259472 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad58c53-b387-4280-8c00-a90dfe96effb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:43.259752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad58c53-b387-4280-8c00-a90dfe96effb None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:43.260500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad58c53-b387-4280-8c00-a90dfe96effb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:43.260780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad58c53-b387-4280-8c00-a90dfe96effb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:43.262138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad58c53-b387-4280-8c00-a90dfe96effb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:43.263806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037d64c-8d99-405a-9086-bad3d590ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:43.265077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037d64c-8d99-405a-9086-bad3d590ad43 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:43.265485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037d64c-8d99-405a-9086-bad3d590ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:43.265840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037d64c-8d99-405a-9086-bad3d590ad43 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:43.266757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037d64c-8d99-405a-9086-bad3d590ad43 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:43.267142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037d64c-8d99-405a-9086-bad3d590ad43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:43.269275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037d64c-8d99-405a-9086-bad3d590ad43 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:43.275360 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 339/694] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:43.276661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2eeaa-6da0-4b06-b591-4c86acb7172d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:43.276953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2eeaa-6da0-4b06-b591-4c86acb7172d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:43.277233 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2eeaa-6da0-4b06-b591-4c86acb7172d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:43.278761 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 340/695] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:43.280469 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2eeaa-6da0-4b06-b591-4c86acb7172d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:43.297451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 356/696] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 16:21:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:43.299430 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed6891-ae21-456d-8bff-71dffde32cbd None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:43.299793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed6891-ae21-456d-8bff-71dffde32cbd None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:43.300270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed6891-ae21-456d-8bff-71dffde32cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:43.324973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-32ed6891-ae21-456d-8bff-71dffde32cbd None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:43.326303 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-32ed6891-ae21-456d-8bff-71dffde32cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:43.358976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:43.382231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:43.408555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2eeaa-6da0-4b06-b591-4c86acb7172d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:43.418810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 357/697] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:43.418810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed6891-ae21-456d-8bff-71dffde32cbd None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:43.449868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9904c1-8f7f-4b91-9580-7c30b35c8b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:43.450718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9904c1-8f7f-4b91-9580-7c30b35c8b99 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:43.451096 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9904c1-8f7f-4b91-9580-7c30b35c8b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:43.451497 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9904c1-8f7f-4b91-9580-7c30b35c8b99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:43.460093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9904c1-8f7f-4b91-9580-7c30b35c8b99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:43.461700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9904c1-8f7f-4b91-9580-7c30b35c8b99 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-9d9904c1-8f7f-4b91-9580-7c30b35c8b99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:43.474415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:43.475524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:43.476666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:43.476666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:43.476666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:43.476666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:43.476666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:43.476666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:43.476666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:43.476666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:43.479118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 341/698] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:43.479292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9904c1-8f7f-4b91-9580-7c30b35c8b99 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:43.562625 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed6891-ae21-456d-8bff-71dffde32cbd None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:43.593434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9904c1-8f7f-4b91-9580-7c30b35c8b99 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:43.605761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137f33d-ae93-4925-94f9-97c8cd4d123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:43.606487 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137f33d-ae93-4925-94f9-97c8cd4d123e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:43.606843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137f33d-ae93-4925-94f9-97c8cd4d123e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:43.607194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137f33d-ae93-4925-94f9-97c8cd4d123e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:43.642053 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e850eba-f7e3-48cb-afce-8831babac758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:43.643662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e850eba-f7e3-48cb-afce-8831babac758 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:43.643987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e850eba-f7e3-48cb-afce-8831babac758 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:43.644336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e850eba-f7e3-48cb-afce-8831babac758 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:43.645192 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e850eba-f7e3-48cb-afce-8831babac758 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:43.647219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e850eba-f7e3-48cb-afce-8831babac758 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:43.650357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-7e850eba-f7e3-48cb-afce-8831babac758 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:43.674363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:43.676124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:21:43.676959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:43.681206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 342/699] 10.222.0.67 () {56 vars in 1129 bytes} [Wed Jul 27 16:21:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:43.682228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e850eba-f7e3-48cb-afce-8831babac758 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:43.685640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:43.717185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137f33d-ae93-4925-94f9-97c8cd4d123e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:43.720179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137f33d-ae93-4925-94f9-97c8cd4d123e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:43.821644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e850eba-f7e3-48cb-afce-8831babac758 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:43.832629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 358/700] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:43.833741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137f33d-ae93-4925-94f9-97c8cd4d123e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:43.863370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8685c-d21b-47f8-8ef7-29128529e5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:43.864403 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8685c-d21b-47f8-8ef7-29128529e5cb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:43.864871 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8685c-d21b-47f8-8ef7-29128529e5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:43.865424 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8685c-d21b-47f8-8ef7-29128529e5cb None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:43.866468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8685c-d21b-47f8-8ef7-29128529e5cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:43.866964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8685c-d21b-47f8-8ef7-29128529e5cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:43.868626 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8685c-d21b-47f8-8ef7-29128529e5cb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:43.883120 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 343/701] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:43.884241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8685c-d21b-47f8-8ef7-29128529e5cb None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:43.903496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:43.941774 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137f33d-ae93-4925-94f9-97c8cd4d123e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:43.959129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:43.978155 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f32a3-e872-488b-9020-8bbf1aece803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:43.978864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f32a3-e872-488b-9020-8bbf1aece803 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:43.979146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f32a3-e872-488b-9020-8bbf1aece803 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:43.979420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f32a3-e872-488b-9020-8bbf1aece803 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:43.980124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f32a3-e872-488b-9020-8bbf1aece803 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:43.980435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f32a3-e872-488b-9020-8bbf1aece803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:43.981802 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f32a3-e872-488b-9020-8bbf1aece803 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:43.986625 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 359/702] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 27 16:21:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:43.987675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f32a3-e872-488b-9020-8bbf1aece803 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:44.006425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8685c-d21b-47f8-8ef7-29128529e5cb None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:44.041875 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633317a-4656-48cb-bcb0-b6f7b4f52371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:44.042511 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633317a-4656-48cb-bcb0-b6f7b4f52371 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:44.042789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633317a-4656-48cb-bcb0-b6f7b4f52371 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:44.043062 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633317a-4656-48cb-bcb0-b6f7b4f52371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:44.053286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633317a-4656-48cb-bcb0-b6f7b4f52371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:44.054708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633317a-4656-48cb-bcb0-b6f7b4f52371 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-8633317a-4656-48cb-bcb0-b6f7b4f52371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:44.069905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:44.070847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:44.071790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:44.071790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:44.071790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:44.071790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:44.071790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 344/703] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:44.072537 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103112f5-841b-43af-89e9-b0b2461d0dce None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:44.072634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103112f5-841b-43af-89e9-b0b2461d0dce None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:44.073176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103112f5-841b-43af-89e9-b0b2461d0dce None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:44.074518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 345/704] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:44.076318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103112f5-841b-43af-89e9-b0b2461d0dce None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:44.105994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f32a3-e872-488b-9020-8bbf1aece803 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:44.136864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:44.144884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bae47-3ee1-4b17-91ca-0d4b11b5a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:44.145505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bae47-3ee1-4b17-91ca-0d4b11b5a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:44.145791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bae47-3ee1-4b17-91ca-0d4b11b5a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:44.146091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bae47-3ee1-4b17-91ca-0d4b11b5a1e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:44.146883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bae47-3ee1-4b17-91ca-0d4b11b5a1e3 None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=c48ede3f01be42c39a55c1beeeb85f26) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:44.147191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bae47-3ee1-4b17-91ca-0d4b11b5a1e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:44.148650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bae47-3ee1-4b17-91ca-0d4b11b5a1e3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:44.159968 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 360/705] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:43 2022] GET /identity/v3/role_assignments?user.id=c48ede3f01be42c39a55c1beeeb85f26&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:44.159968 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bae47-3ee1-4b17-91ca-0d4b11b5a1e3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:44.205051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103112f5-841b-43af-89e9-b0b2461d0dce None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:44.227754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:44.258216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f125da8-1639-4282-8ec9-85555ce490b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:44.258857 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f125da8-1639-4282-8ec9-85555ce490b3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:44.259409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f125da8-1639-4282-8ec9-85555ce490b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:44.259689 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f125da8-1639-4282-8ec9-85555ce490b3 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:44.260435 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f125da8-1639-4282-8ec9-85555ce490b3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:44.261265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f125da8-1639-4282-8ec9-85555ce490b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:44.262970 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f125da8-1639-4282-8ec9-85555ce490b3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:44.275903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 346/706] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 27 16:21:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:44.275903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550fd4d-9799-4585-b5eb-e2826cbbee9b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:44.275903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550fd4d-9799-4585-b5eb-e2826cbbee9b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:44.275903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550fd4d-9799-4585-b5eb-e2826cbbee9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:44.298323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b550fd4d-9799-4585-b5eb-e2826cbbee9b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:44.300325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b550fd4d-9799-4585-b5eb-e2826cbbee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:44.301965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bae47-3ee1-4b17-91ca-0d4b11b5a1e3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:44.375676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c26cf2-65e4-4a17-8fa2-b9f9ef56247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:44.376632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c26cf2-65e4-4a17-8fa2-b9f9ef56247f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:44.377085 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c26cf2-65e4-4a17-8fa2-b9f9ef56247f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:44.378075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c26cf2-65e4-4a17-8fa2-b9f9ef56247f None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:44.378950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c26cf2-65e4-4a17-8fa2-b9f9ef56247f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:44.379426 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c26cf2-65e4-4a17-8fa2-b9f9ef56247f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:44.381192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c26cf2-65e4-4a17-8fa2-b9f9ef56247f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:44.394274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 347/707] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:44.402720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 361/708] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:44.407878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550fd4d-9799-4585-b5eb-e2826cbbee9b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:44.425418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c26cf2-65e4-4a17-8fa2-b9f9ef56247f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:44.487914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:44.543155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550fd4d-9799-4585-b5eb-e2826cbbee9b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:44.550605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c26cf2-65e4-4a17-8fa2-b9f9ef56247f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:44.554275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:44.583437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f5a45-27f6-4613-b962-d39c940b0205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:44.584123 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f5a45-27f6-4613-b962-d39c940b0205 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:44.584404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f5a45-27f6-4613-b962-d39c940b0205 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:44.584674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f5a45-27f6-4613-b962-d39c940b0205 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:44.591721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f5a45-27f6-4613-b962-d39c940b0205 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:44.593180 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f5a45-27f6-4613-b962-d39c940b0205 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:44.598535 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353a866-e69f-481f-ae0f-ac630b17b609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:44.599488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353a866-e69f-481f-ae0f-ac630b17b609 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:44.600005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353a866-e69f-481f-ae0f-ac630b17b609 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:44.600754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353a866-e69f-481f-ae0f-ac630b17b609 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-088f5a45-27f6-4613-b962-d39c940b0205 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:44.606331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:44.607240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:44.608601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:44.608601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:44.608601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:44.608601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:44.608601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:44.608601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:44.608601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:44.608601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:44.612418 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 348/709] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:44.614028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f5a45-27f6-4613-b962-d39c940b0205 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:44.616439 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353a866-e69f-481f-ae0f-ac630b17b609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:44.619352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353a866-e69f-481f-ae0f-ac630b17b609 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-0353a866-e69f-481f-ae0f-ac630b17b609 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:44.644174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:44.645116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:44.646025 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:44.646025 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:44.646025 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:44.646025 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:44.648055 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 362/710] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:44.660442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353a866-e69f-481f-ae0f-ac630b17b609 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:44.739384 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f5a45-27f6-4613-b962-d39c940b0205 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:44.777023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9b794-d894-4619-8001-aad0277e67f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:44.778004 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9b794-d894-4619-8001-aad0277e67f0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:44.778496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9b794-d894-4619-8001-aad0277e67f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:44.778999 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9b794-d894-4619-8001-aad0277e67f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:44.779982 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9b794-d894-4619-8001-aad0277e67f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:44.780515 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9b794-d894-4619-8001-aad0277e67f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:44.782171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9b794-d894-4619-8001-aad0277e67f0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:44.795710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 349/711] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:44.797339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b621097-7f9f-4d27-874a-b8760a93a0b9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:44.797838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b621097-7f9f-4d27-874a-b8760a93a0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:44.798322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b621097-7f9f-4d27-874a-b8760a93a0b9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:44.800242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 350/712] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:44.808409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b621097-7f9f-4d27-874a-b8760a93a0b9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:44.841231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:44.849255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353a866-e69f-481f-ae0f-ac630b17b609 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:44.857779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:44.896584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fe500-3d38-435e-8d59-dfb03a39e26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:44.897296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fe500-3d38-435e-8d59-dfb03a39e26d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:44.898136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fe500-3d38-435e-8d59-dfb03a39e26d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:44.898517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fe500-3d38-435e-8d59-dfb03a39e26d None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:44.899311 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fe500-3d38-435e-8d59-dfb03a39e26d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:44.899716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fe500-3d38-435e-8d59-dfb03a39e26d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:44.901584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fe500-3d38-435e-8d59-dfb03a39e26d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:44.921175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 363/713] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:44.921175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2585ff-daa4-4eb7-803f-938616683980 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:44.921175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2585ff-daa4-4eb7-803f-938616683980 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:44.921175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2585ff-daa4-4eb7-803f-938616683980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:44.936582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b621097-7f9f-4d27-874a-b8760a93a0b9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:44.943215 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-4f2585ff-daa4-4eb7-803f-938616683980 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:44.944655 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4f2585ff-daa4-4eb7-803f-938616683980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:44.978540 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc726e-c347-4aeb-a536-472be946c19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:44.979176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc726e-c347-4aeb-a536-472be946c19c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:44.979467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc726e-c347-4aeb-a536-472be946c19c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:44.979894 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc726e-c347-4aeb-a536-472be946c19c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:44.981054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc726e-c347-4aeb-a536-472be946c19c None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=9d5a8ef373ca4ed7bf31361e24e42e54) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:44.981362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc726e-c347-4aeb-a536-472be946c19c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:44.983076 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc726e-c347-4aeb-a536-472be946c19c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:44.990162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 351/714] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:44 2022] GET /identity/v3/role_assignments?user.id=9d5a8ef373ca4ed7bf31361e24e42e54&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:44.990973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc726e-c347-4aeb-a536-472be946c19c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:45.066421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 364/715] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:45.091963 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2585ff-daa4-4eb7-803f-938616683980 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:45.196098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:45.208845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc726e-c347-4aeb-a536-472be946c19c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:45.247237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fa868-a7db-4a90-abca-62aadf32d060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:45.248207 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fa868-a7db-4a90-abca-62aadf32d060 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:45.248633 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fa868-a7db-4a90-abca-62aadf32d060 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:45.249050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fa868-a7db-4a90-abca-62aadf32d060 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:45.249863 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fa868-a7db-4a90-abca-62aadf32d060 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:45.251419 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fa868-a7db-4a90-abca-62aadf32d060 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:45.275702 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 352/716] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:21:44 2022] POST /identity/v3/users => generated 254 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:21:45.301239 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2585ff-daa4-4eb7-803f-938616683980 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:45.320298 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:45.341491 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5a213-5d6e-4308-8e20-14cd00d35ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:45.342404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5a213-5d6e-4308-8e20-14cd00d35ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:45.342840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5a213-5d6e-4308-8e20-14cd00d35ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:45.343559 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5a213-5d6e-4308-8e20-14cd00d35ca0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:45.344910 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5a213-5d6e-4308-8e20-14cd00d35ca0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:45.346920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5a213-5d6e-4308-8e20-14cd00d35ca0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-a4d5a213-5d6e-4308-8e20-14cd00d35ca0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:45.358668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:45.359975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:21:45.363230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:45.364751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 365/717] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:45 2022] GET /identity/v3/services/network => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:45.372276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fa868-a7db-4a90-abca-62aadf32d060 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:45.516358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fa868-a7db-4a90-abca-62aadf32d060 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:45.552720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003c7e6-bce2-47a9-8737-89857ae6b39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:45.553517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003c7e6-bce2-47a9-8737-89857ae6b39b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:45.553903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003c7e6-bce2-47a9-8737-89857ae6b39b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:45.554285 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003c7e6-bce2-47a9-8737-89857ae6b39b None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:45.555202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003c7e6-bce2-47a9-8737-89857ae6b39b None admin] RBAC: Adding query filter params (name=network) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:45.555613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003c7e6-bce2-47a9-8737-89857ae6b39b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:45.557121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003c7e6-bce2-47a9-8737-89857ae6b39b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:45.562157 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 353/718] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 16:21:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:45.569276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5a213-5d6e-4308-8e20-14cd00d35ca0 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:45.682788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5a213-5d6e-4308-8e20-14cd00d35ca0 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:45.721245 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba87c0-2323-4ccb-8db1-a32603ff9a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:45.722191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba87c0-2323-4ccb-8db1-a32603ff9a76 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:45.722616 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba87c0-2323-4ccb-8db1-a32603ff9a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:45.722908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba87c0-2323-4ccb-8db1-a32603ff9a76 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:45.723600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba87c0-2323-4ccb-8db1-a32603ff9a76 None admin] RBAC: Adding query filter params (type=network) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:45.723943 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba87c0-2323-4ccb-8db1-a32603ff9a76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:45.725329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba87c0-2323-4ccb-8db1-a32603ff9a76 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:45.731805 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 366/719] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 16:21:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:46.727322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6031f-b280-4c7b-b42d-97566b44c2d3 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:46.727839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6031f-b280-4c7b-b42d-97566b44c2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:46.727936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6031f-b280-4c7b-b42d-97566b44c2d3 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:46.729502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 354/720] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:46.734307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487bc72-0d62-42f9-a2c2-ef075c419b76 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:46.734714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487bc72-0d62-42f9-a2c2-ef075c419b76 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:46.734906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487bc72-0d62-42f9-a2c2-ef075c419b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:46.759269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5487bc72-0d62-42f9-a2c2-ef075c419b76 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:46.760500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5487bc72-0d62-42f9-a2c2-ef075c419b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:46.783749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:46.839825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 367/721] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:46.853782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010f24c-0a19-4d3d-93d7-bb985102bd62 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:46.854067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010f24c-0a19-4d3d-93d7-bb985102bd62 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:46.854344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010f24c-0a19-4d3d-93d7-bb985102bd62 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:46.855934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 355/722] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:46.861084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fe13a-3fd8-4a62-8bdc-5e327dffcc66 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:46.861372 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fe13a-3fd8-4a62-8bdc-5e327dffcc66 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:46.861785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fe13a-3fd8-4a62-8bdc-5e327dffcc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:46.875729 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010f24c-0a19-4d3d-93d7-bb985102bd62 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:46.894891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-775fe13a-3fd8-4a62-8bdc-5e327dffcc66 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:46.896124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-775fe13a-3fd8-4a62-8bdc-5e327dffcc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:46.904299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:47.094078 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 368/723] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:47.117685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fe13a-3fd8-4a62-8bdc-5e327dffcc66 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:47.136536 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010f24c-0a19-4d3d-93d7-bb985102bd62 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:47.189748 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf72295-20c1-4546-b05c-8784dc4d08c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:47.190372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf72295-20c1-4546-b05c-8784dc4d08c7 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:47.190651 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf72295-20c1-4546-b05c-8784dc4d08c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:47.190925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf72295-20c1-4546-b05c-8784dc4d08c7 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:47.191611 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf72295-20c1-4546-b05c-8784dc4d08c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:47.193012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf72295-20c1-4546-b05c-8784dc4d08c7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:47.215311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 356/724] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:21:46 2022] POST /identity/v3/services => generated 251 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:21:47.228144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:47.236442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32ee7f-b518-472e-bb6f-6c2322ebc903 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:47.236893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32ee7f-b518-472e-bb6f-6c2322ebc903 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:47.237626 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32ee7f-b518-472e-bb6f-6c2322ebc903 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:47.239517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 357/725] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:47.252769 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44ff87-44cb-45c2-981e-4156390f559c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:47.253103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44ff87-44cb-45c2-981e-4156390f559c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:47.253328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44ff87-44cb-45c2-981e-4156390f559c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:47.254984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fe13a-3fd8-4a62-8bdc-5e327dffcc66 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:47.292157 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0d44ff87-44cb-45c2-981e-4156390f559c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:47.293466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0d44ff87-44cb-45c2-981e-4156390f559c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:47.302480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4509e4a-c084-484a-b0bc-ab779322449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:47.303163 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4509e4a-c084-484a-b0bc-ab779322449d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:47.303451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4509e4a-c084-484a-b0bc-ab779322449d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:47.303733 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4509e4a-c084-484a-b0bc-ab779322449d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:47.315951 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4509e4a-c084-484a-b0bc-ab779322449d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e4509e4a-c084-484a-b0bc-ab779322449d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:47.329179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:47.330786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:47.331839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:47.331839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:47.331839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:47.331839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:47.331839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:47.331839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:47.331839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:47.331839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:47.331839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:47.331839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:47.331839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:47.331839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:47.331839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 369/726] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:47.341363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4509e4a-c084-484a-b0bc-ab779322449d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:47.396608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 358/727] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:47.414296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44ff87-44cb-45c2-981e-4156390f559c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:47.428220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:47.502966 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4509e4a-c084-484a-b0bc-ab779322449d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:47.542772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384986a-5039-45a9-af5d-90c2de892c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:47.543406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384986a-5039-45a9-af5d-90c2de892c08 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:47.543696 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384986a-5039-45a9-af5d-90c2de892c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:47.544005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384986a-5039-45a9-af5d-90c2de892c08 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:47.544787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384986a-5039-45a9-af5d-90c2de892c08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:47.545103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384986a-5039-45a9-af5d-90c2de892c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:47.546481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384986a-5039-45a9-af5d-90c2de892c08 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:47.556840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 370/728] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:47.557267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44ff87-44cb-45c2-981e-4156390f559c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:47.565969 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384986a-5039-45a9-af5d-90c2de892c08 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:47.569052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:47.629212 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69085918-e3dc-4086-bb55-8452681756e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:47.629882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69085918-e3dc-4086-bb55-8452681756e6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:47.630187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69085918-e3dc-4086-bb55-8452681756e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:47.630442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69085918-e3dc-4086-bb55-8452681756e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:47.657388 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69085918-e3dc-4086-bb55-8452681756e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-69085918-e3dc-4086-bb55-8452681756e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:47.662298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:47.663219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:47.664103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:47.664103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:47.664103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:47.664103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:47.664103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:47.664103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:47.664103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:47.664103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:47.664103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:47.664103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:47.664103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:47.664103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:47.664103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 359/729] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:47.680702 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69085918-e3dc-4086-bb55-8452681756e6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:47.753241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384986a-5039-45a9-af5d-90c2de892c08 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:47.804827 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d57a-8c35-469e-9842-2c50e25d94ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:47.805488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d57a-8c35-469e-9842-2c50e25d94ce None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:47.805776 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d57a-8c35-469e-9842-2c50e25d94ce None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:47.806057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d57a-8c35-469e-9842-2c50e25d94ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:47.810274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:47.833271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7d57a-8c35-469e-9842-2c50e25d94ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:47.834741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7d57a-8c35-469e-9842-2c50e25d94ce None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-3ef7d57a-8c35-469e-9842-2c50e25d94ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:47.860463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:47.861786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:47.863049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:47.863049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:47.863049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:47.863049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:47.868746 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 371/730] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:47.881225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d57a-8c35-469e-9842-2c50e25d94ce None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:47.890666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69085918-e3dc-4086-bb55-8452681756e6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:47.970601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:48.013873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2312136-ae6e-4366-9508-2eb593f25f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:48.014898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312136-ae6e-4366-9508-2eb593f25f1f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:48.015415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312136-ae6e-4366-9508-2eb593f25f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:48.015939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312136-ae6e-4366-9508-2eb593f25f1f None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:48.016875 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2312136-ae6e-4366-9508-2eb593f25f1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:48.017389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2312136-ae6e-4366-9508-2eb593f25f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:48.019091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2312136-ae6e-4366-9508-2eb593f25f1f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:48.043901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d57a-8c35-469e-9842-2c50e25d94ce None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:48.044652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 360/731] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:48.056320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2312136-ae6e-4366-9508-2eb593f25f1f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:48.117668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcd41d-eb82-44d3-b0d9-d547d2681fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:48.118676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcd41d-eb82-44d3-b0d9-d547d2681fbc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:48.119256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcd41d-eb82-44d3-b0d9-d547d2681fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:48.119738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcd41d-eb82-44d3-b0d9-d547d2681fbc None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:48.120716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcd41d-eb82-44d3-b0d9-d547d2681fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:48.126715 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcd41d-eb82-44d3-b0d9-d547d2681fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:48.128442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcd41d-eb82-44d3-b0d9-d547d2681fbc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:48.160021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 372/732] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:48.161422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559095f1-7f0b-47b5-b771-f395bf26372c None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:48.161715 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559095f1-7f0b-47b5-b771-f395bf26372c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:48.161995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559095f1-7f0b-47b5-b771-f395bf26372c None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:48.167792 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 373/733] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:48.168662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559095f1-7f0b-47b5-b771-f395bf26372c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:48.222405 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2312136-ae6e-4366-9508-2eb593f25f1f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:48.272253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:48.289526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbb5ab-b23e-4d12-b491-3031985ce469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:48.290725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbb5ab-b23e-4d12-b491-3031985ce469 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:48.291135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbb5ab-b23e-4d12-b491-3031985ce469 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:48.291422 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbb5ab-b23e-4d12-b491-3031985ce469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:48.324348 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbb5ab-b23e-4d12-b491-3031985ce469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:48.327359 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbb5ab-b23e-4d12-b491-3031985ce469 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:48.356809 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559095f1-7f0b-47b5-b771-f395bf26372c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-a3dbb5ab-b23e-4d12-b491-3031985ce469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:48.364454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:48.365599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:48.366644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:48.366644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:48.366644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:48.366644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:48.372870 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 361/734] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:48.374230 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c199bb-c26d-4a07-8233-76d6d154193f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:48.376379 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c199bb-c26d-4a07-8233-76d6d154193f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:48.377990 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c199bb-c26d-4a07-8233-76d6d154193f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:48.384383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:48.408099 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabda94-16bb-4aae-aa69-683618e1d532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:48.409570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabda94-16bb-4aae-aa69-683618e1d532 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:48.409999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabda94-16bb-4aae-aa69-683618e1d532 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:48.410710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabda94-16bb-4aae-aa69-683618e1d532 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:48.412991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-57c199bb-c26d-4a07-8233-76d6d154193f None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:48.414299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-57c199bb-c26d-4a07-8233-76d6d154193f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:48.422679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabda94-16bb-4aae-aa69-683618e1d532 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:48.425100 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabda94-16bb-4aae-aa69-683618e1d532 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-3dabda94-16bb-4aae-aa69-683618e1d532 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:48.442643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:48.443633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:48.444615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:48.444615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:48.444615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:48.444615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:48.444615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:48.444615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:48.444615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:48.444615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:48.444615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 16:21:48.444615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:48.447665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 374/735] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:48.448854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabda94-16bb-4aae-aa69-683618e1d532 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:48.513071 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 362/736] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:48.515070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed070bf-15e2-4c46-848b-48a207981710 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:48.515590 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed070bf-15e2-4c46-848b-48a207981710 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:48.516170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed070bf-15e2-4c46-848b-48a207981710 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:48.517610 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 363/737] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:48.518584 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed070bf-15e2-4c46-848b-48a207981710 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:48.605501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabda94-16bb-4aae-aa69-683618e1d532 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:48.647733 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716a95c-d5a5-4846-8218-f2e5ebeef483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:48.648389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716a95c-d5a5-4846-8218-f2e5ebeef483 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:48.648668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716a95c-d5a5-4846-8218-f2e5ebeef483 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:48.648943 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716a95c-d5a5-4846-8218-f2e5ebeef483 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:48.649640 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716a95c-d5a5-4846-8218-f2e5ebeef483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:48.650385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716a95c-d5a5-4846-8218-f2e5ebeef483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:48.651769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716a95c-d5a5-4846-8218-f2e5ebeef483 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:48.654643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed070bf-15e2-4c46-848b-48a207981710 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:48.664202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:48.667279 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 375/738] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:48.669142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce6c5b-4ee3-42ef-a23e-e90d8711d18f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:48.669430 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce6c5b-4ee3-42ef-a23e-e90d8711d18f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:48.669705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce6c5b-4ee3-42ef-a23e-e90d8711d18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:48.691582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a0ce6c5b-4ee3-42ef-a23e-e90d8711d18f None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:48.692821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a0ce6c5b-4ee3-42ef-a23e-e90d8711d18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:48.697923 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42562715-bbe3-488f-8b0f-49ce9f7b2002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:48.698555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42562715-bbe3-488f-8b0f-49ce9f7b2002 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:48.698839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42562715-bbe3-488f-8b0f-49ce9f7b2002 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:48.699114 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42562715-bbe3-488f-8b0f-49ce9f7b2002 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:48.699943 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42562715-bbe3-488f-8b0f-49ce9f7b2002 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:48.700256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42562715-bbe3-488f-8b0f-49ce9f7b2002 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:48.701685 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42562715-bbe3-488f-8b0f-49ce9f7b2002 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:48.724187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:48.731226 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 364/739] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 27 16:21:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:48.731226 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42562715-bbe3-488f-8b0f-49ce9f7b2002 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:48.785749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 376/740] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 16:21:48.786572 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce6c5b-4ee3-42ef-a23e-e90d8711d18f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:48.863171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42562715-bbe3-488f-8b0f-49ce9f7b2002 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:48.907743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c615c0-e5be-404b-9e5e-373bf1948c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:48.909593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c615c0-e5be-404b-9e5e-373bf1948c45 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:48.910490 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c615c0-e5be-404b-9e5e-373bf1948c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:48.910490 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c615c0-e5be-404b-9e5e-373bf1948c45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:48.921829 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce6c5b-4ee3-42ef-a23e-e90d8711d18f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:48.926262 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c615c0-e5be-404b-9e5e-373bf1948c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-38c615c0-e5be-404b-9e5e-373bf1948c45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:48.931415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:48.932563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:48.933425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:48.933425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:48.933425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:48.933425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:48.933425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:48.933425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:48.933425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:48.933425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:48.933425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:48.933425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:48.933425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:48.933425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:48.937705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 365/741] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:48.938954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c615c0-e5be-404b-9e5e-373bf1948c45 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:48.963754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfaca2-1a6f-453b-af1a-bae5ed8b67dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:48.964446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfaca2-1a6f-453b-af1a-bae5ed8b67dc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:48.964733 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfaca2-1a6f-453b-af1a-bae5ed8b67dc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:48.965018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfaca2-1a6f-453b-af1a-bae5ed8b67dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:48.974087 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfaca2-1a6f-453b-af1a-bae5ed8b67dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:48.974817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfaca2-1a6f-453b-af1a-bae5ed8b67dc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:48.979533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-bbcfaca2-1a6f-453b-af1a-bae5ed8b67dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:48.989189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:48.990480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:48.991687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:48.991687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:48.991687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:48.991687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:48.991687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:48.991687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:48.991687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:48.991687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:48.991687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:21:48.991687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:48.995007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 377/742] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 16:21:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:48.995843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfaca2-1a6f-453b-af1a-bae5ed8b67dc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:49.026616 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:49.084358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c615c0-e5be-404b-9e5e-373bf1948c45 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:49.108992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfaca2-1a6f-453b-af1a-bae5ed8b67dc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:49.129667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e69fb3-6324-4289-868a-28481671bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:49.130299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e69fb3-6324-4289-868a-28481671bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:49.130587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e69fb3-6324-4289-868a-28481671bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:49.130866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e69fb3-6324-4289-868a-28481671bbb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:49.153925 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a8a1b-8aea-4083-a15e-9b2a1ad672f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:49.154262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a8a1b-8aea-4083-a15e-9b2a1ad672f4 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:49.154470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a8a1b-8aea-4083-a15e-9b2a1ad672f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:49.154754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a8a1b-8aea-4083-a15e-9b2a1ad672f4 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:49.155461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a8a1b-8aea-4083-a15e-9b2a1ad672f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:49.156880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a8a1b-8aea-4083-a15e-9b2a1ad672f4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:49.175706 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 378/743] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:21:48 2022] POST /identity/v3/services => generated 240 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:21:49.176920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a8a1b-8aea-4083-a15e-9b2a1ad672f4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:49.237712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e69fb3-6324-4289-868a-28481671bbb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:49.239778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e69fb3-6324-4289-868a-28481671bbb5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:49.278011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:49.322620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:49.350266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a8a1b-8aea-4083-a15e-9b2a1ad672f4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:49.385798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 366/744] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:48 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 16:21:49.386656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e69fb3-6324-4289-868a-28481671bbb5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:49.403027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cdff6-3741-4f74-9c24-30a79833c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:49.404122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cdff6-3741-4f74-9c24-30a79833c038 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:49.404662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cdff6-3741-4f74-9c24-30a79833c038 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:49.405011 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cdff6-3741-4f74-9c24-30a79833c038 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:49.405824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cdff6-3741-4f74-9c24-30a79833c038 None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:49.406199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cdff6-3741-4f74-9c24-30a79833c038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:49.408731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cdff6-3741-4f74-9c24-30a79833c038 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:49.418262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 379/745] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:49.419181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cdff6-3741-4f74-9c24-30a79833c038 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:49.497481 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e69fb3-6324-4289-868a-28481671bbb5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:49.523567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:49.538276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0b473-6348-4eaf-a154-90b7a64c8820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:49.539021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0b473-6348-4eaf-a154-90b7a64c8820 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:49.539375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0b473-6348-4eaf-a154-90b7a64c8820 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:49.539723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0b473-6348-4eaf-a154-90b7a64c8820 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:49.541239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0b473-6348-4eaf-a154-90b7a64c8820 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:49.541626 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0b473-6348-4eaf-a154-90b7a64c8820 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:49.543466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0b473-6348-4eaf-a154-90b7a64c8820 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:49.554524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cdff6-3741-4f74-9c24-30a79833c038 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:49.569512 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 367/746] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 16:21:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:49.569512 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0b473-6348-4eaf-a154-90b7a64c8820 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:49.596861 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be29c1-bc2f-4525-ad5c-3426ec24da4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:49.597814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be29c1-bc2f-4525-ad5c-3426ec24da4e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:49.598280 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be29c1-bc2f-4525-ad5c-3426ec24da4e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:49.598780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be29c1-bc2f-4525-ad5c-3426ec24da4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:49.611786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be29c1-bc2f-4525-ad5c-3426ec24da4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:49.613699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be29c1-bc2f-4525-ad5c-3426ec24da4e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:49.615781 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-b4be29c1-bc2f-4525-ad5c-3426ec24da4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:49.631600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:49.632765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:49.635026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:49.635026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:49.635026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:49.635026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:49.637358 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 380/747] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:49.638435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be29c1-bc2f-4525-ad5c-3426ec24da4e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:49.687466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0b473-6348-4eaf-a154-90b7a64c8820 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:49.732636 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9310cd-dec8-4a14-a7fc-cb8252aa0ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:49.733294 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9310cd-dec8-4a14-a7fc-cb8252aa0ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:49.733584 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9310cd-dec8-4a14-a7fc-cb8252aa0ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:49.733869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9310cd-dec8-4a14-a7fc-cb8252aa0ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:49.748556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9310cd-dec8-4a14-a7fc-cb8252aa0ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:49.750224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9310cd-dec8-4a14-a7fc-cb8252aa0ce2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:49.754831 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be29c1-bc2f-4525-ad5c-3426ec24da4e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-fe9310cd-dec8-4a14-a7fc-cb8252aa0ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:49.770567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:49.771509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:49.773065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:49.773065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:49.773065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:49.773065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:49.773065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 368/748] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:49.773340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9310cd-dec8-4a14-a7fc-cb8252aa0ce2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:49.790102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d274ebf-6816-4301-a9d2-1ac7c45fc2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:49.790771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d274ebf-6816-4301-a9d2-1ac7c45fc2df None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:49.791199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d274ebf-6816-4301-a9d2-1ac7c45fc2df None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:49.791483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d274ebf-6816-4301-a9d2-1ac7c45fc2df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:49.802271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d274ebf-6816-4301-a9d2-1ac7c45fc2df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:49.803729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d274ebf-6816-4301-a9d2-1ac7c45fc2df None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:49.813810 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-8d274ebf-6816-4301-a9d2-1ac7c45fc2df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:49.818281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:49.819169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:49.820108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:49.820108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:49.820108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:49.820108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:49.824140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 381/749] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:49.825177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df023c58-15ab-4807-804a-3092e0322003 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:49.825468 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df023c58-15ab-4807-804a-3092e0322003 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:49.825750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df023c58-15ab-4807-804a-3092e0322003 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:49.827167 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 382/750] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:49.827720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df023c58-15ab-4807-804a-3092e0322003 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:49.881084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:49.889400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9310cd-dec8-4a14-a7fc-cb8252aa0ce2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:49.927126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cbda3-acd2-46d1-a081-cb7cbd6d3b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:49.927897 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cbda3-acd2-46d1-a081-cb7cbd6d3b5e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:49.928174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cbda3-acd2-46d1-a081-cb7cbd6d3b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:49.928452 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cbda3-acd2-46d1-a081-cb7cbd6d3b5e None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:49.929148 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cbda3-acd2-46d1-a081-cb7cbd6d3b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:49.929457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cbda3-acd2-46d1-a081-cb7cbd6d3b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:49.930931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cbda3-acd2-46d1-a081-cb7cbd6d3b5e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:49.944309 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df023c58-15ab-4807-804a-3092e0322003 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:49.944499 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 369/751] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:49.945288 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cbda3-acd2-46d1-a081-cb7cbd6d3b5e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:49.984675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf39b3-c343-48df-9501-c5cc33a836b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:49.985366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf39b3-c343-48df-9501-c5cc33a836b0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:49.985654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf39b3-c343-48df-9501-c5cc33a836b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:49.985983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf39b3-c343-48df-9501-c5cc33a836b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:49.987045 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf39b3-c343-48df-9501-c5cc33a836b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:49.987226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf39b3-c343-48df-9501-c5cc33a836b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:49.988661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf39b3-c343-48df-9501-c5cc33a836b0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:50.006487 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 383/752] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:50.007604 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf9ff2-5255-42aa-b9da-58c33eb5f265 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:50.007920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf9ff2-5255-42aa-b9da-58c33eb5f265 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:50.008204 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf9ff2-5255-42aa-b9da-58c33eb5f265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:50.025554 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a1cf9ff2-5255-42aa-b9da-58c33eb5f265 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:50.026741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a1cf9ff2-5255-42aa-b9da-58c33eb5f265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:50.053534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:50.062902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cbda3-acd2-46d1-a081-cb7cbd6d3b5e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:50.098897 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cad3e-c9fe-4528-9aff-bd62ba434dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:50.099079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 384/753] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:21:50.099823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf9ff2-5255-42aa-b9da-58c33eb5f265 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:50.100344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cad3e-c9fe-4528-9aff-bd62ba434dfe None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:50.100846 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cad3e-c9fe-4528-9aff-bd62ba434dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:50.101329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cad3e-c9fe-4528-9aff-bd62ba434dfe None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:50.102220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cad3e-c9fe-4528-9aff-bd62ba434dfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:50.102715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cad3e-c9fe-4528-9aff-bd62ba434dfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:50.104291 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cad3e-c9fe-4528-9aff-bd62ba434dfe None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:50.117635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 370/754] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:50.118760 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cad3e-c9fe-4528-9aff-bd62ba434dfe None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:50.147302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:50.217537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf9ff2-5255-42aa-b9da-58c33eb5f265 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:50.222173 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cad3e-c9fe-4528-9aff-bd62ba434dfe None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:50.254358 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec412d-1b4a-4cde-b1ea-f938502e8e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:50.255013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec412d-1b4a-4cde-b1ea-f938502e8e8c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:50.255289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec412d-1b4a-4cde-b1ea-f938502e8e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:50.255569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec412d-1b4a-4cde-b1ea-f938502e8e8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:50.256447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32247eb2-794b-46ae-8b40-f3b6eb1b5c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:50.257091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247eb2-794b-46ae-8b40-f3b6eb1b5c24 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:50.257384 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247eb2-794b-46ae-8b40-f3b6eb1b5c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:50.257658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247eb2-794b-46ae-8b40-f3b6eb1b5c24 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:50.262965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec412d-1b4a-4cde-b1ea-f938502e8e8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:50.264670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec412d-1b4a-4cde-b1ea-f938502e8e8c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:50.264782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32247eb2-794b-46ae-8b40-f3b6eb1b5c24 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:50.266101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32247eb2-794b-46ae-8b40-f3b6eb1b5c24 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-8fec412d-1b4a-4cde-b1ea-f938502e8e8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:50.277172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:50.278093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:50.278999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:50.278999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:50.278999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:50.278999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:50.278999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:50.278999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:50.278999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:50.278999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-32247eb2-794b-46ae-8b40-f3b6eb1b5c24 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:50.279439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:50.280327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:50.281948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:50.281948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:50.281948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:50.281948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:50.281948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:50.281948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:50.281948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:50.281948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:50.281948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 16:21:50.281948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:50.281948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 371/755] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 16:21:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:50.281948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32247eb2-794b-46ae-8b40-f3b6eb1b5c24 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:50.288842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 385/756] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:50.289903 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec412d-1b4a-4cde-b1ea-f938502e8e8c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:50.300401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:50.388693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32247eb2-794b-46ae-8b40-f3b6eb1b5c24 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:50.397945 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:50.405077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec412d-1b4a-4cde-b1ea-f938502e8e8c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:50.428217 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d986413-8c1c-4f1f-9045-f10bc17e25ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:50.428868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d986413-8c1c-4f1f-9045-f10bc17e25ac None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:50.429151 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d986413-8c1c-4f1f-9045-f10bc17e25ac None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:50.429414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d986413-8c1c-4f1f-9045-f10bc17e25ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:50.436255 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d986413-8c1c-4f1f-9045-f10bc17e25ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:50.437679 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d986413-8c1c-4f1f-9045-f10bc17e25ac None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:50.442724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ef4b3-0d91-4f31-86bf-458f0dd69dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:50.443581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ef4b3-0d91-4f31-86bf-458f0dd69dbd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:50.444103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ef4b3-0d91-4f31-86bf-458f0dd69dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:50.444457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ef4b3-0d91-4f31-86bf-458f0dd69dbd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:50.445151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ef4b3-0d91-4f31-86bf-458f0dd69dbd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:50.446512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ef4b3-0d91-4f31-86bf-458f0dd69dbd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-9d986413-8c1c-4f1f-9045-f10bc17e25ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:50.449313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:50.450191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:50.451108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:50.451108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:50.451108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:50.451108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:50.451108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:50.451108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:50.451108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:50.451108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:50.455966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 372/757] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:50.456801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d986413-8c1c-4f1f-9045-f10bc17e25ac None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-ef4ef4b3-0d91-4f31-86bf-458f0dd69dbd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:50.458213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:50.459112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:50.459998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 386/758] 10.222.0.67 () {56 vars in 1129 bytes} [Wed Jul 27 16:21:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:50.462275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ef4b3-0d91-4f31-86bf-458f0dd69dbd None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:50.537171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:50.563566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d986413-8c1c-4f1f-9045-f10bc17e25ac None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:50.567645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ef4b3-0d91-4f31-86bf-458f0dd69dbd None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:50.599293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd670b6-f91f-4b94-a551-eaea1739fe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:50.599934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd670b6-f91f-4b94-a551-eaea1739fe71 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:50.600219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd670b6-f91f-4b94-a551-eaea1739fe71 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:50.600494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd670b6-f91f-4b94-a551-eaea1739fe71 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:50.601272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd670b6-f91f-4b94-a551-eaea1739fe71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:50.601581 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd670b6-f91f-4b94-a551-eaea1739fe71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:50.603001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd670b6-f91f-4b94-a551-eaea1739fe71 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:50.603820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5d3da-7673-47f7-8472-b3576055a3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:50.604455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5d3da-7673-47f7-8472-b3576055a3cb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:50.604738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5d3da-7673-47f7-8472-b3576055a3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:50.605013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5d3da-7673-47f7-8472-b3576055a3cb None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:50.605756 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5d3da-7673-47f7-8472-b3576055a3cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:50.606047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5d3da-7673-47f7-8472-b3576055a3cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:50.607444 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5d3da-7673-47f7-8472-b3576055a3cb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:50.619456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 387/759] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:50.620281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5d3da-7673-47f7-8472-b3576055a3cb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:50.626957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 373/760] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 27 16:21:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:50.628010 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd670b6-f91f-4b94-a551-eaea1739fe71 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:50.647755 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:50.737298 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5d3da-7673-47f7-8472-b3576055a3cb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:50.739880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd670b6-f91f-4b94-a551-eaea1739fe71 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:50.770469 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:50.772957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0b881-e0cd-46cf-91cf-4059981231d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:50.773630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0b881-e0cd-46cf-91cf-4059981231d4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:50.773948 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0b881-e0cd-46cf-91cf-4059981231d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:50.774268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0b881-e0cd-46cf-91cf-4059981231d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:50.775082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0b881-e0cd-46cf-91cf-4059981231d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:50.775400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0b881-e0cd-46cf-91cf-4059981231d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:50.776000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a90e94-d882-4f28-aa49-4fcc2a6e6a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:50.776857 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a90e94-d882-4f28-aa49-4fcc2a6e6a22 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:50.776971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0b881-e0cd-46cf-91cf-4059981231d4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:50.777394 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a90e94-d882-4f28-aa49-4fcc2a6e6a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:50.777828 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a90e94-d882-4f28-aa49-4fcc2a6e6a22 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:50.778642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a90e94-d882-4f28-aa49-4fcc2a6e6a22 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:50.779088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a90e94-d882-4f28-aa49-4fcc2a6e6a22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:50.780587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a90e94-d882-4f28-aa49-4fcc2a6e6a22 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:50.790362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 374/762] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 27 16:21:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:50.790579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 388/762] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:50.791426 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0b881-e0cd-46cf-91cf-4059981231d4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:50.792130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a90e94-d882-4f28-aa49-4fcc2a6e6a22 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:50.874620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:50.897410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0b881-e0cd-46cf-91cf-4059981231d4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:50.904377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a90e94-d882-4f28-aa49-4fcc2a6e6a22 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:50.933088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b2340-5766-43f2-9f72-c000dda307a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:50.933599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b2340-5766-43f2-9f72-c000dda307a1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:50.933885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b2340-5766-43f2-9f72-c000dda307a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:50.934167 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b2340-5766-43f2-9f72-c000dda307a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:50.943069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39662f-8551-4274-9cf2-1341200ad0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:50.943696 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39662f-8551-4274-9cf2-1341200ad0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:50.944014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39662f-8551-4274-9cf2-1341200ad0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:50.944296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39662f-8551-4274-9cf2-1341200ad0d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:50.945080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39662f-8551-4274-9cf2-1341200ad0d9 None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=c48ede3f01be42c39a55c1beeeb85f26) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:50.945393 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39662f-8551-4274-9cf2-1341200ad0d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:50.946801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39662f-8551-4274-9cf2-1341200ad0d9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:50.952565 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 375/763] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:50 2022] GET /identity/v3/role_assignments?user.id=c48ede3f01be42c39a55c1beeeb85f26&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:50.953183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39662f-8551-4274-9cf2-1341200ad0d9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:51.041432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:51.048072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b2340-5766-43f2-9f72-c000dda307a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:51.050499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b2340-5766-43f2-9f72-c000dda307a1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:51.100297 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39662f-8551-4274-9cf2-1341200ad0d9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:51.143137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51156a-efc0-4ba3-848e-434652262205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:51.143770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51156a-efc0-4ba3-848e-434652262205 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:51.144098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51156a-efc0-4ba3-848e-434652262205 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:51.144375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51156a-efc0-4ba3-848e-434652262205 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:51.145061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51156a-efc0-4ba3-848e-434652262205 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:51.145370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51156a-efc0-4ba3-848e-434652262205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:51.146732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51156a-efc0-4ba3-848e-434652262205 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:51.155980 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 376/764] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 27 16:21:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:51.156829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51156a-efc0-4ba3-848e-434652262205 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:51.159326 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:51.193488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 389/765] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:21:51.194695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b2340-5766-43f2-9f72-c000dda307a1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:51.296865 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51156a-efc0-4ba3-848e-434652262205 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:51.311331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b2340-5766-43f2-9f72-c000dda307a1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:51.327412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:51.340463 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065c11c-8fd4-4eca-ada3-70667ee35cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:51.341259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c11c-8fd4-4eca-ada3-70667ee35cd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:51.341547 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c11c-8fd4-4eca-ada3-70667ee35cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:51.341832 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c11c-8fd4-4eca-ada3-70667ee35cd0 None admin] PATH_INFO: `/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/9d5a8ef373ca4ed7bf31361e24e42e54/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:51.344046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065c11c-8fd4-4eca-ada3-70667ee35cd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01ef9cd2ffc4edd94cbf0017a720a57, user_id=9d5a8ef373ca4ed7bf31361e24e42e54, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:51.345901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065c11c-8fd4-4eca-ada3-70667ee35cd0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:51.349290 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb1813-75ac-40a0-b3bf-8c7e78c7fceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:51.349961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb1813-75ac-40a0-b3bf-8c7e78c7fceb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:51.350248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb1813-75ac-40a0-b3bf-8c7e78c7fceb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:51.350527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb1813-75ac-40a0-b3bf-8c7e78c7fceb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:51.351317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb1813-75ac-40a0-b3bf-8c7e78c7fceb None admin] RBAC: Adding query filter params (interface=public, service_id=c3fb33f8cfbb4e54a66d4e5ca51ca4e2, region_id=RegionOne) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:51.351674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb1813-75ac-40a0-b3bf-8c7e78c7fceb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:51.353209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb1813-75ac-40a0-b3bf-8c7e78c7fceb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:51.367905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 377/766] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:21:51 2022] PUT /identity/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/9d5a8ef373ca4ed7bf31361e24e42e54/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:51.368102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 390/767] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 16:21:51 2022] GET /identity/v3/endpoints?service_id=c3fb33f8cfbb4e54a66d4e5ca51ca4e2&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:51.368102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19c97b-d67c-4e60-a94c-cef4264b8ba6 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:51.368102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19c97b-d67c-4e60-a94c-cef4264b8ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:51.368102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19c97b-d67c-4e60-a94c-cef4264b8ba6 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:51.368102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 391/768] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:51.368460 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065c11c-8fd4-4eca-ada3-70667ee35cd0 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:51.369499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19c97b-d67c-4e60-a94c-cef4264b8ba6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:51.434011 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:51.509361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19c97b-d67c-4e60-a94c-cef4264b8ba6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:51.526952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065c11c-8fd4-4eca-ada3-70667ee35cd0 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:51.551697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026e97b-a880-432f-acde-847bcf631555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:51.552701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026e97b-a880-432f-acde-847bcf631555 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:51.553163 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026e97b-a880-432f-acde-847bcf631555 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:51.553756 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026e97b-a880-432f-acde-847bcf631555 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:51.554653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026e97b-a880-432f-acde-847bcf631555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:51.556257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026e97b-a880-432f-acde-847bcf631555 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:51.567909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 392/769] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 16:21:51 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:51.567909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e236a5-dbdd-4c09-a0ef-160373ae9e1b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:51.567909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e236a5-dbdd-4c09-a0ef-160373ae9e1b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:51.567909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e236a5-dbdd-4c09-a0ef-160373ae9e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:51.574214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8aaaf-d4cb-4121-8f66-cdcedd6e48f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:51.574936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8aaaf-d4cb-4121-8f66-cdcedd6e48f8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:51.575223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8aaaf-d4cb-4121-8f66-cdcedd6e48f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:51.575498 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8aaaf-d4cb-4121-8f66-cdcedd6e48f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:51.587345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b0e236a5-dbdd-4c09-a0ef-160373ae9e1b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:51.588743 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b0e236a5-dbdd-4c09-a0ef-160373ae9e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:51.589610 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8aaaf-d4cb-4121-8f66-cdcedd6e48f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:51.591182 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8aaaf-d4cb-4121-8f66-cdcedd6e48f8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-0ae8aaaf-d4cb-4121-8f66-cdcedd6e48f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:51.609068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:51.610046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:51.611231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:51.611231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:51.611231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:51.611231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:51.611231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 378/770] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:51.617605 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8aaaf-d4cb-4121-8f66-cdcedd6e48f8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:51.686899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 393/771] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:21:51.692321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:51.728434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e236a5-dbdd-4c09-a0ef-160373ae9e1b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:51.756851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8aaaf-d4cb-4121-8f66-cdcedd6e48f8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:51.801216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:51.815736 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b497adc-79a8-4ffd-a5da-75bbd130929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:51.816909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b497adc-79a8-4ffd-a5da-75bbd130929d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:51.817407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b497adc-79a8-4ffd-a5da-75bbd130929d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:51.817883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b497adc-79a8-4ffd-a5da-75bbd130929d None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:51.818778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b497adc-79a8-4ffd-a5da-75bbd130929d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:51.819300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b497adc-79a8-4ffd-a5da-75bbd130929d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:51.820941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b497adc-79a8-4ffd-a5da-75bbd130929d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:51.836867 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 379/772] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:51.841907 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b497adc-79a8-4ffd-a5da-75bbd130929d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:51.902740 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e236a5-dbdd-4c09-a0ef-160373ae9e1b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:51.946580 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f30502-32e9-4212-83b2-32b1513b165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:51.947222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f30502-32e9-4212-83b2-32b1513b165a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:51.947502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f30502-32e9-4212-83b2-32b1513b165a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:51.947772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f30502-32e9-4212-83b2-32b1513b165a None admin] PATH_INFO: `/v3/services/network` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:51.948440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f30502-32e9-4212-83b2-32b1513b165a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:51.949879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f30502-32e9-4212-83b2-32b1513b165a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-47f30502-32e9-4212-83b2-32b1513b165a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:51.960287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:51.961296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:51.962147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 394/773] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:51 2022] GET /identity/v3/services/network => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:51.968284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f30502-32e9-4212-83b2-32b1513b165a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:52.007191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:52.018805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b497adc-79a8-4ffd-a5da-75bbd130929d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:52.087079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9882a38-0b83-419b-93e7-51cea2b3d21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:52.087644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882a38-0b83-419b-93e7-51cea2b3d21d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:52.087944 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882a38-0b83-419b-93e7-51cea2b3d21d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:52.088295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882a38-0b83-419b-93e7-51cea2b3d21d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:52.105055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9882a38-0b83-419b-93e7-51cea2b3d21d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:52.106496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9882a38-0b83-419b-93e7-51cea2b3d21d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-e9882a38-0b83-419b-93e7-51cea2b3d21d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:52.122429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:52.123375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:52.124318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:52.124318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:52.124318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:52.124318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:52.124318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:52.124318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:52.124318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:52.124318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:52.133766 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 380/774] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:52.134679 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9882a38-0b83-419b-93e7-51cea2b3d21d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:52.157323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f30502-32e9-4212-83b2-32b1513b165a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:52.160202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:52.202150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f033-6100-4430-bda0-f1c0276263f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:52.202779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f033-6100-4430-bda0-f1c0276263f8 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:52.203062 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f033-6100-4430-bda0-f1c0276263f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:52.203338 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f033-6100-4430-bda0-f1c0276263f8 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:52.204048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0f033-6100-4430-bda0-f1c0276263f8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:52.204352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0f033-6100-4430-bda0-f1c0276263f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:52.206116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0f033-6100-4430-bda0-f1c0276263f8 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:52.219976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 395/775] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 16:21:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:52.224552 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f033-6100-4430-bda0-f1c0276263f8 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:52.340889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9882a38-0b83-419b-93e7-51cea2b3d21d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:52.358046 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f033-6100-4430-bda0-f1c0276263f8 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:52.393990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e805b-4f75-4d44-bf59-52e2739a2c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:52.394611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e805b-4f75-4d44-bf59-52e2739a2c7d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:52.394895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e805b-4f75-4d44-bf59-52e2739a2c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:52.395167 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e805b-4f75-4d44-bf59-52e2739a2c7d None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:52.395837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e805b-4f75-4d44-bf59-52e2739a2c7d None admin] RBAC: Adding query filter params (type=network) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:52.396168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e805b-4f75-4d44-bf59-52e2739a2c7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:52.397626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e805b-4f75-4d44-bf59-52e2739a2c7d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:52.403005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 396/776] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 16:21:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:52.406856 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202846c-24fd-4798-8aab-76f1aa9efdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:52.407478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202846c-24fd-4798-8aab-76f1aa9efdc9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:52.407757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202846c-24fd-4798-8aab-76f1aa9efdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:52.408620 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202846c-24fd-4798-8aab-76f1aa9efdc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:52.409877 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e805b-4f75-4d44-bf59-52e2739a2c7d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:52.416370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202846c-24fd-4798-8aab-76f1aa9efdc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:52.416946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202846c-24fd-4798-8aab-76f1aa9efdc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:52.418771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202846c-24fd-4798-8aab-76f1aa9efdc9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:52.445322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 381/777] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:52.448221 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:52.451458 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202846c-24fd-4798-8aab-76f1aa9efdc9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:52.498086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:52.518302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e805b-4f75-4d44-bf59-52e2739a2c7d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:52.593392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfffb76-fc00-4b85-b339-f68da3e88d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:52.596048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfffb76-fc00-4b85-b339-f68da3e88d98 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:52.596496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfffb76-fc00-4b85-b339-f68da3e88d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:52.596914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfffb76-fc00-4b85-b339-f68da3e88d98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:52.598000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfffb76-fc00-4b85-b339-f68da3e88d98 None admin] RBAC: Adding query filter params (interface=public, service_id=31e97ad343ac4ac39c3d6e23a5945e15, region_id=RegionOne) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:52.599484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfffb76-fc00-4b85-b339-f68da3e88d98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:52.601225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfffb76-fc00-4b85-b339-f68da3e88d98 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:52.609793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 397/778] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 16:21:52 2022] GET /identity/v3/endpoints?service_id=31e97ad343ac4ac39c3d6e23a5945e15&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:52.617443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfffb76-fc00-4b85-b339-f68da3e88d98 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:52.645544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202846c-24fd-4798-8aab-76f1aa9efdc9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:52.721017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a894a17-44d1-4bf9-b9ad-c1c6b241d33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:52.721774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a894a17-44d1-4bf9-b9ad-c1c6b241d33f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:52.722063 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a894a17-44d1-4bf9-b9ad-c1c6b241d33f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:52.722356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a894a17-44d1-4bf9-b9ad-c1c6b241d33f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:52.723202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a894a17-44d1-4bf9-b9ad-c1c6b241d33f None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=cf356c7ffa044fe39bb548320d2f5acb) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:52.723523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a894a17-44d1-4bf9-b9ad-c1c6b241d33f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:52.725042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a894a17-44d1-4bf9-b9ad-c1c6b241d33f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:52.747520 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 382/779] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:52 2022] GET /identity/v3/role_assignments?user.id=cf356c7ffa044fe39bb548320d2f5acb&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:52.794784 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:52.806013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfffb76-fc00-4b85-b339-f68da3e88d98 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:52.851850 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510efec-b9ce-4b18-9f23-edaba555ef3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:52.852498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510efec-b9ce-4b18-9f23-edaba555ef3f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:52.852790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510efec-b9ce-4b18-9f23-edaba555ef3f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:52.853072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510efec-b9ce-4b18-9f23-edaba555ef3f None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:52.853761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510efec-b9ce-4b18-9f23-edaba555ef3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:52.855202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510efec-b9ce-4b18-9f23-edaba555ef3f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:52.866847 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 398/780] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 16:21:52 2022] GET /identity/v3/services => generated 772 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:53.242476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb223a8-6c53-49d1-8cd8-ea29c7384bcf None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:53.243502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb223a8-6c53-49d1-8cd8-ea29c7384bcf None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:53.244035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb223a8-6c53-49d1-8cd8-ea29c7384bcf None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:53.245835 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 383/781] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:53.251244 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2ce0c-79e8-4b35-9f30-c6780152a0ac None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:53.252494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2ce0c-79e8-4b35-9f30-c6780152a0ac None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:53.252988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2ce0c-79e8-4b35-9f30-c6780152a0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:53.272517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8fb2ce0c-79e8-4b35-9f30-c6780152a0ac None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:53.274032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8fb2ce0c-79e8-4b35-9f30-c6780152a0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:53.350870 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 399/782] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:21:53.373494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb223a8-6c53-49d1-8cd8-ea29c7384bcf None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:53.478012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:53.504153 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb223a8-6c53-49d1-8cd8-ea29c7384bcf None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:53.555665 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102900e-c66f-4220-93de-714b50213689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:53.556351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102900e-c66f-4220-93de-714b50213689 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:53.556634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102900e-c66f-4220-93de-714b50213689 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:53.556906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102900e-c66f-4220-93de-714b50213689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:53.568772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102900e-c66f-4220-93de-714b50213689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-3102900e-c66f-4220-93de-714b50213689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:53.573745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:53.574684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:53.575527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:53.575527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:53.575527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:53.575527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:53.575527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:53.575527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:53.575527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:53.575527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:53.575527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:53.575527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:53.575527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:53.575527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:53.575527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 384/783] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:53.582584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2ce0c-79e8-4b35-9f30-c6780152a0ac None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:53.724101 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:53.738739 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2ce0c-79e8-4b35-9f30-c6780152a0ac None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:53.760811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4038926-4e69-4911-bfc1-bc3bc3da6ed5 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:53.761426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4038926-4e69-4911-bfc1-bc3bc3da6ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:53.761908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4038926-4e69-4911-bfc1-bc3bc3da6ed5 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:53.763447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 385/784] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:53.771419 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89683e7a-f4c7-4675-b6f1-46fafdc9d9a0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:53.771701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89683e7a-f4c7-4675-b6f1-46fafdc9d9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:53.772011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89683e7a-f4c7-4675-b6f1-46fafdc9d9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:53.798240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f766378-93c6-4531-ae74-e2aa13ae055c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:53.799212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f766378-93c6-4531-ae74-e2aa13ae055c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:53.799486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f766378-93c6-4531-ae74-e2aa13ae055c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:53.799763 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f766378-93c6-4531-ae74-e2aa13ae055c None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:53.800504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f766378-93c6-4531-ae74-e2aa13ae055c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:53.800809 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f766378-93c6-4531-ae74-e2aa13ae055c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:53.802167 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f766378-93c6-4531-ae74-e2aa13ae055c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:53.808219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-89683e7a-f4c7-4675-b6f1-46fafdc9d9a0 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:53.812256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-89683e7a-f4c7-4675-b6f1-46fafdc9d9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:53.823691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 400/785] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:53.831669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f766378-93c6-4531-ae74-e2aa13ae055c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:53.955997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 386/786] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:21:53.994683 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f766378-93c6-4531-ae74-e2aa13ae055c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:54.015961 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89683e7a-f4c7-4675-b6f1-46fafdc9d9a0 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:54.067348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0d239-1d27-4d77-8de7-d8b232e520e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:54.068023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0d239-1d27-4d77-8de7-d8b232e520e3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:54.068306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0d239-1d27-4d77-8de7-d8b232e520e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:54.068579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0d239-1d27-4d77-8de7-d8b232e520e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:54.083457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0d239-1d27-4d77-8de7-d8b232e520e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:54.084939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0d239-1d27-4d77-8de7-d8b232e520e3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:54.098901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-eec0d239-1d27-4d77-8de7-d8b232e520e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:54.110769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:54.112954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:54.113859 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:54.113859 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:54.113859 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:54.113859 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:54.113859 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 401/787] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:54.114165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492f77-f299-4336-a472-41ce1ace4dc3 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:54.114626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492f77-f299-4336-a472-41ce1ace4dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:54.114626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492f77-f299-4336-a472-41ce1ace4dc3 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:54.120458 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 402/788] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:54.121235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492f77-f299-4336-a472-41ce1ace4dc3 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:54.135827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89683e7a-f4c7-4675-b6f1-46fafdc9d9a0 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:54.144334 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:54.174640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45a1ff-dff7-4269-920b-fa21da2cba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:54.175357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a1ff-dff7-4269-920b-fa21da2cba0e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:54.175642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a1ff-dff7-4269-920b-fa21da2cba0e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:54.175948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45a1ff-dff7-4269-920b-fa21da2cba0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:54.187381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45a1ff-dff7-4269-920b-fa21da2cba0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-4c45a1ff-dff7-4269-920b-fa21da2cba0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:54.193034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:54.195202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:54.197227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:54.197227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:54.197227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:54.197227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:54.197227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:54.197227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:54.197227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:54.197227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:54.197227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:54.197227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:54.197227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:54.197227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:54.203955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 387/789] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:54.203955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c7c65-0c08-455a-9877-c608ead30832 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:54.203955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c7c65-0c08-455a-9877-c608ead30832 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:54.203955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c7c65-0c08-455a-9877-c608ead30832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:54.221562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f43c7c65-0c08-455a-9877-c608ead30832 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:54.222896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f43c7c65-0c08-455a-9877-c608ead30832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:54.228303 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492f77-f299-4336-a472-41ce1ace4dc3 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:54.264704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1063ad-1def-4638-8499-c62520f230b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:54.265328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1063ad-1def-4638-8499-c62520f230b1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:54.265609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1063ad-1def-4638-8499-c62520f230b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:54.265881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1063ad-1def-4638-8499-c62520f230b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:54.266625 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1063ad-1def-4638-8499-c62520f230b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:54.266875 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1063ad-1def-4638-8499-c62520f230b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:54.276967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1063ad-1def-4638-8499-c62520f230b1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:54.280712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 403/790] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:54.281516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1063ad-1def-4638-8499-c62520f230b1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:54.298945 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 388/791] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:21:54.300002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c7c65-0c08-455a-9877-c608ead30832 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:54.349465 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:54.370044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:54.389219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1063ad-1def-4638-8499-c62520f230b1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:54.417700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c7c65-0c08-455a-9877-c608ead30832 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:54.424328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa1bd-45e8-4a3c-a507-a36cac77d7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:54.424948 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa1bd-45e8-4a3c-a507-a36cac77d7ce None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:54.425230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa1bd-45e8-4a3c-a507-a36cac77d7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:54.425510 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa1bd-45e8-4a3c-a507-a36cac77d7ce None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:54.426226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aa1bd-45e8-4a3c-a507-a36cac77d7ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:54.426530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aa1bd-45e8-4a3c-a507-a36cac77d7ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:54.427926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aa1bd-45e8-4a3c-a507-a36cac77d7ce None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:54.436715 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 404/792] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:54.437536 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa1bd-45e8-4a3c-a507-a36cac77d7ce None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:54.461935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e6a0a-2ee4-482b-baed-88ddf0fdae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:54.462643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e6a0a-2ee4-482b-baed-88ddf0fdae6a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:54.462943 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e6a0a-2ee4-482b-baed-88ddf0fdae6a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:54.463346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e6a0a-2ee4-482b-baed-88ddf0fdae6a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:54.472713 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e6a0a-2ee4-482b-baed-88ddf0fdae6a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:54.474406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e6a0a-2ee4-482b-baed-88ddf0fdae6a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-bc3e6a0a-2ee4-482b-baed-88ddf0fdae6a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:54.487895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:54.490119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:54.492567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:54.492567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:54.492567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:54.492567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:54.492567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:54.492567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:54.492567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:54.492567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:54.492567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 16:21:54.492567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:54.492567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 389/793] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:54.492567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e6a0a-2ee4-482b-baed-88ddf0fdae6a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:54.547101 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa1bd-45e8-4a3c-a507-a36cac77d7ce None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:54.571313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:54.582403 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aae850-13a3-4577-9799-511034081690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:54.583160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae850-13a3-4577-9799-511034081690 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:54.583506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae850-13a3-4577-9799-511034081690 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:54.583846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae850-13a3-4577-9799-511034081690 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:54.584573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aae850-13a3-4577-9799-511034081690 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:54.585998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aae850-13a3-4577-9799-511034081690 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-16aae850-13a3-4577-9799-511034081690 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:54.597919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:54.599899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:54.601981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 405/794] 10.222.0.67 () {56 vars in 1129 bytes} [Wed Jul 27 16:21:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:54.612203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aae850-13a3-4577-9799-511034081690 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:54.612365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e6a0a-2ee4-482b-baed-88ddf0fdae6a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:54.628229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:54.646042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4aba68-1d07-4416-8e74-16a636fa4ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:54.647010 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4aba68-1d07-4416-8e74-16a636fa4ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:54.647490 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4aba68-1d07-4416-8e74-16a636fa4ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:54.648047 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4aba68-1d07-4416-8e74-16a636fa4ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:54.661853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4aba68-1d07-4416-8e74-16a636fa4ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:54.663494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4aba68-1d07-4416-8e74-16a636fa4ba9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-0d4aba68-1d07-4416-8e74-16a636fa4ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:54.679583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:54.680599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:54.681500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:54.681500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:54.681500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:54.681500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:54.688004 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 390/795] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:54.689843 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4aba68-1d07-4416-8e74-16a636fa4ba9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:54.707993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aae850-13a3-4577-9799-511034081690 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:54.742665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d03036-0bcf-4956-99f8-d6e9dc2fdce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:54.743286 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d03036-0bcf-4956-99f8-d6e9dc2fdce3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:54.743568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d03036-0bcf-4956-99f8-d6e9dc2fdce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:54.743844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d03036-0bcf-4956-99f8-d6e9dc2fdce3 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:54.744656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d03036-0bcf-4956-99f8-d6e9dc2fdce3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:54.744961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d03036-0bcf-4956-99f8-d6e9dc2fdce3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:54.746398 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d03036-0bcf-4956-99f8-d6e9dc2fdce3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:54.769932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 406/796] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 27 16:21:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:54.770801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d03036-0bcf-4956-99f8-d6e9dc2fdce3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:54.807448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4aba68-1d07-4416-8e74-16a636fa4ba9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:54.818128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:54.848025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d195244-5b63-4ee8-90f9-efad91a88ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:54.849037 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195244-5b63-4ee8-90f9-efad91a88ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:54.849571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195244-5b63-4ee8-90f9-efad91a88ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:54.850008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195244-5b63-4ee8-90f9-efad91a88ac5 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:54.850938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d195244-5b63-4ee8-90f9-efad91a88ac5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:54.851392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d195244-5b63-4ee8-90f9-efad91a88ac5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:54.852954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d195244-5b63-4ee8-90f9-efad91a88ac5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:54.858643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 391/797] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 27 16:21:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:54.859781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d195244-5b63-4ee8-90f9-efad91a88ac5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:54.875030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d03036-0bcf-4956-99f8-d6e9dc2fdce3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:54.900584 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:54.910393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258bb9b-e70c-450e-811a-054e6d8e95f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:54.910924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258bb9b-e70c-450e-811a-054e6d8e95f3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:54.911206 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258bb9b-e70c-450e-811a-054e6d8e95f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:54.911477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258bb9b-e70c-450e-811a-054e6d8e95f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:54.912192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258bb9b-e70c-450e-811a-054e6d8e95f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:54.912497 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258bb9b-e70c-450e-811a-054e6d8e95f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:54.913864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258bb9b-e70c-450e-811a-054e6d8e95f3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:54.927731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 407/798] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:54.928868 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258bb9b-e70c-450e-811a-054e6d8e95f3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:54.979113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d195244-5b63-4ee8-90f9-efad91a88ac5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:55.013369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04d912-bd3a-4446-bbef-b1ce47ebe8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:55.014009 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04d912-bd3a-4446-bbef-b1ce47ebe8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:55.014301 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04d912-bd3a-4446-bbef-b1ce47ebe8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:55.014584 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04d912-bd3a-4446-bbef-b1ce47ebe8e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:55.025556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04d912-bd3a-4446-bbef-b1ce47ebe8e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:55.027000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04d912-bd3a-4446-bbef-b1ce47ebe8e5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:55.034237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258bb9b-e70c-450e-811a-054e6d8e95f3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:55.041624 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-cd04d912-bd3a-4446-bbef-b1ce47ebe8e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:55.041762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:55.042773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:55.043847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:55.043847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:55.043847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:55.043847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:55.047942 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 392/799] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:55.049692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed7b43-04d8-4b6e-9042-6ad9365ca49c None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:55.049985 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed7b43-04d8-4b6e-9042-6ad9365ca49c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:55.050270 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed7b43-04d8-4b6e-9042-6ad9365ca49c None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:55.055834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 393/800] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:55.055834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed7b43-04d8-4b6e-9042-6ad9365ca49c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:55.078587 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccc527-ba6a-48fd-80a2-df72d14bb7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:55.079140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccc527-ba6a-48fd-80a2-df72d14bb7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:55.079428 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccc527-ba6a-48fd-80a2-df72d14bb7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:55.080263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccc527-ba6a-48fd-80a2-df72d14bb7f3 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:55.081031 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccc527-ba6a-48fd-80a2-df72d14bb7f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:55.081339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccc527-ba6a-48fd-80a2-df72d14bb7f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:55.082708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccc527-ba6a-48fd-80a2-df72d14bb7f3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:55.092109 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 408/801] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 27 16:21:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:55.092109 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccc527-ba6a-48fd-80a2-df72d14bb7f3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:55.155205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:55.172100 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed7b43-04d8-4b6e-9042-6ad9365ca49c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:55.193838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccc527-ba6a-48fd-80a2-df72d14bb7f3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:55.209831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cd83c-34b8-44a3-a334-f4ef5792e7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:55.210475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cd83c-34b8-44a3-a334-f4ef5792e7fd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:55.210757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cd83c-34b8-44a3-a334-f4ef5792e7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:55.211032 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cd83c-34b8-44a3-a334-f4ef5792e7fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:55.218326 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cd83c-34b8-44a3-a334-f4ef5792e7fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:55.220037 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cd83c-34b8-44a3-a334-f4ef5792e7fd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:55.229324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d37dd6-f04b-404d-89ed-4e0677bb563b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:55.229949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d37dd6-f04b-404d-89ed-4e0677bb563b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:55.230233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d37dd6-f04b-404d-89ed-4e0677bb563b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:55.230506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d37dd6-f04b-404d-89ed-4e0677bb563b None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:55.231187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d37dd6-f04b-404d-89ed-4e0677bb563b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:55.231491 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d37dd6-f04b-404d-89ed-4e0677bb563b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-939cd83c-34b8-44a3-a334-f4ef5792e7fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:55.232462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:55.233401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:55.239637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:55.239637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:55.239637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:55.239637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:55.239637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:55.239637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:55.239637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:55.239637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:55.239637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:21:55.239637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:55.240245 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d37dd6-f04b-404d-89ed-4e0677bb563b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:55.240319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 394/802] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 16:21:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:55.240319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ff88a-ffa7-416e-988a-79096dda356e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:55.240319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ff88a-ffa7-416e-988a-79096dda356e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:55.240319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ff88a-ffa7-416e-988a-79096dda356e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:55.256535 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 409/803] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:55.256535 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d37dd6-f04b-404d-89ed-4e0677bb563b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:55.256775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-df5ff88a-ffa7-416e-988a-79096dda356e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:55.256775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-df5ff88a-ffa7-416e-988a-79096dda356e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:55.288339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:55.332072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 395/804] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:21:55.333011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ff88a-ffa7-416e-988a-79096dda356e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:55.369988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d37dd6-f04b-404d-89ed-4e0677bb563b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:55.406727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfda28-a1bf-4356-8baa-9981ad6d2bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:55.407349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfda28-a1bf-4356-8baa-9981ad6d2bf3 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:55.407633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfda28-a1bf-4356-8baa-9981ad6d2bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:55.408598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfda28-a1bf-4356-8baa-9981ad6d2bf3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:55.409320 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfda28-a1bf-4356-8baa-9981ad6d2bf3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:55.410765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfda28-a1bf-4356-8baa-9981ad6d2bf3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:55.415087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:55.432430 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 410/805] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:21:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:21:55.441788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ff88a-ffa7-416e-988a-79096dda356e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:55.444903 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfda28-a1bf-4356-8baa-9981ad6d2bf3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:55.497154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331aa02-80e4-4725-8c9e-9ad19472ddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:55.498145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331aa02-80e4-4725-8c9e-9ad19472ddfb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:55.498620 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331aa02-80e4-4725-8c9e-9ad19472ddfb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:55.499075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331aa02-80e4-4725-8c9e-9ad19472ddfb None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:55.500111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331aa02-80e4-4725-8c9e-9ad19472ddfb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:55.500604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331aa02-80e4-4725-8c9e-9ad19472ddfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:55.502368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331aa02-80e4-4725-8c9e-9ad19472ddfb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:55.525681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 396/806] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 16:21:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:55.526996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331aa02-80e4-4725-8c9e-9ad19472ddfb None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:55.585774 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:55.608098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfda28-a1bf-4356-8baa-9981ad6d2bf3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:55.647879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4a999-bdd0-4be3-bdb5-ccaa62a121a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:55.648561 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a999-bdd0-4be3-bdb5-ccaa62a121a5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:55.648846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a999-bdd0-4be3-bdb5-ccaa62a121a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:55.649127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a999-bdd0-4be3-bdb5-ccaa62a121a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:55.649229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331aa02-80e4-4725-8c9e-9ad19472ddfb None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:55.656461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4a999-bdd0-4be3-bdb5-ccaa62a121a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:55.657953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4a999-bdd0-4be3-bdb5-ccaa62a121a5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-64f4a999-bdd0-4be3-bdb5-ccaa62a121a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:55.669671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:55.670585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:55.671508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:55.671508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:55.671508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:55.671508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:55.671508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:55.671508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:55.671508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:55.671508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:55.671508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 411/807] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:55.672049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4a999-bdd0-4be3-bdb5-ccaa62a121a5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:55.703191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:55.711381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f63f4c-f3e5-48ae-9c7f-4985c435b7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:55.712506 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63f4c-f3e5-48ae-9c7f-4985c435b7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:55.713116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63f4c-f3e5-48ae-9c7f-4985c435b7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:55.713533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63f4c-f3e5-48ae-9c7f-4985c435b7e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:55.727390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f63f4c-f3e5-48ae-9c7f-4985c435b7e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-22f63f4c-f3e5-48ae-9c7f-4985c435b7e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:55.732404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:55.733363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:55.734214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:55.734214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:55.734214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:55.734214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:55.734214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:55.734214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:55.734214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:55.734214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:55.734214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:55.734214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:55.734214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:21:55.734214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:55.734214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 397/808] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:21:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:55.735511 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bb6f8-0bea-47ba-a8ba-4f7a1aae5046 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:55.735615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bb6f8-0bea-47ba-a8ba-4f7a1aae5046 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:55.735851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bb6f8-0bea-47ba-a8ba-4f7a1aae5046 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:55.737440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 398/809] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:55.737994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bb6f8-0bea-47ba-a8ba-4f7a1aae5046 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:55.805459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4a999-bdd0-4be3-bdb5-ccaa62a121a5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:55.842101 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8604026-c96e-4757-822d-c32325d67073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:55.842650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8604026-c96e-4757-822d-c32325d67073 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:55.842933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8604026-c96e-4757-822d-c32325d67073 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:55.843210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8604026-c96e-4757-822d-c32325d67073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:55.859756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bb6f8-0bea-47ba-a8ba-4f7a1aae5046 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:55.860081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:55.897878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803b90d-396f-4a5a-802b-b6e4fc01e8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:55.898546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b90d-396f-4a5a-802b-b6e4fc01e8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:55.898818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b90d-396f-4a5a-802b-b6e4fc01e8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:55.899094 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b90d-396f-4a5a-802b-b6e4fc01e8c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:55.899843 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803b90d-396f-4a5a-802b-b6e4fc01e8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:55.900179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803b90d-396f-4a5a-802b-b6e4fc01e8c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:55.901609 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803b90d-396f-4a5a-802b-b6e4fc01e8c6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:55.913692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 399/810] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:55.914811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803b90d-396f-4a5a-802b-b6e4fc01e8c6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:55.928839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8604026-c96e-4757-822d-c32325d67073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:55.930439 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8604026-c96e-4757-822d-c32325d67073 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:55.975336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:56.028010 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803b90d-396f-4a5a-802b-b6e4fc01e8c6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:56.039948 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 412/811] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:21:56.045582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ce12-7a52-41e2-a46e-05c828923f7c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:56.045877 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ce12-7a52-41e2-a46e-05c828923f7c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:56.046156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ce12-7a52-41e2-a46e-05c828923f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:56.064671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1eb0ce12-7a52-41e2-a46e-05c828923f7c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:56.065011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976becd6-5edb-44f3-9f20-08359d08fb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:56.065636 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976becd6-5edb-44f3-9f20-08359d08fb1e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:56.065853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1eb0ce12-7a52-41e2-a46e-05c828923f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:56.065957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976becd6-5edb-44f3-9f20-08359d08fb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:56.066190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976becd6-5edb-44f3-9f20-08359d08fb1e None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:56.066930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976becd6-5edb-44f3-9f20-08359d08fb1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:56.067235 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976becd6-5edb-44f3-9f20-08359d08fb1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:56.068616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976becd6-5edb-44f3-9f20-08359d08fb1e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:56.076891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 400/812] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:21:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:56.077493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976becd6-5edb-44f3-9f20-08359d08fb1e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:56.116160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:56.144256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 413/813] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:21:56.145320 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0ce12-7a52-41e2-a46e-05c828923f7c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:56.193730 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976becd6-5edb-44f3-9f20-08359d08fb1e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:56.209397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:56.232364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fc76a-70bd-4d2c-9655-74291acc0c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:56.233047 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fc76a-70bd-4d2c-9655-74291acc0c99 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:56.233318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fc76a-70bd-4d2c-9655-74291acc0c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:56.233602 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fc76a-70bd-4d2c-9655-74291acc0c99 None admin] PATH_INFO: `/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/c48ede3f01be42c39a55c1beeeb85f26/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:56.235555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fc76a-70bd-4d2c-9655-74291acc0c99 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01ef9cd2ffc4edd94cbf0017a720a57, user_id=c48ede3f01be42c39a55c1beeeb85f26, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:56.237211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fc76a-70bd-4d2c-9655-74291acc0c99 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:56.255891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 401/814] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:21:56 2022] PUT /identity/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/c48ede3f01be42c39a55c1beeeb85f26/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:56.255891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fc76a-70bd-4d2c-9655-74291acc0c99 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:56.264055 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0ce12-7a52-41e2-a46e-05c828923f7c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:56.311621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388465c5-6df6-46d4-8d96-4041915c8e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:56.313119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388465c5-6df6-46d4-8d96-4041915c8e6e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:56.313950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388465c5-6df6-46d4-8d96-4041915c8e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:56.314977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388465c5-6df6-46d4-8d96-4041915c8e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:56.330565 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388465c5-6df6-46d4-8d96-4041915c8e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:56.333435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388465c5-6df6-46d4-8d96-4041915c8e6e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-388465c5-6df6-46d4-8d96-4041915c8e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:56.355524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:56.356544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:56.357494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:56.357494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:56.357494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:56.357494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:56.360234 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 414/815] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:56.361966 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388465c5-6df6-46d4-8d96-4041915c8e6e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:56.392887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fc76a-70bd-4d2c-9655-74291acc0c99 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:56.397334 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:56.445997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f8d34-d697-4cee-b88c-0b9630cc44e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:56.446752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f8d34-d697-4cee-b88c-0b9630cc44e4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:56.447102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f8d34-d697-4cee-b88c-0b9630cc44e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:56.447448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f8d34-d697-4cee-b88c-0b9630cc44e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:56.463684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f8d34-d697-4cee-b88c-0b9630cc44e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:56.465341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f8d34-d697-4cee-b88c-0b9630cc44e4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:56.481717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388465c5-6df6-46d4-8d96-4041915c8e6e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-369f8d34-d697-4cee-b88c-0b9630cc44e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:56.485204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:56.486839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:56.487974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:56.487974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:56.487974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:56.487974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:56.487974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 402/816] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:56.488300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f8d34-d697-4cee-b88c-0b9630cc44e4 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:56.525989 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:56.531171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d611c3-edc4-4ba0-8824-e100d8b3f156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:56.531827 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d611c3-edc4-4ba0-8824-e100d8b3f156 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:56.532157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d611c3-edc4-4ba0-8824-e100d8b3f156 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:56.532411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d611c3-edc4-4ba0-8824-e100d8b3f156 None admin] PATH_INFO: `/v3/services/network` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:56.533771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d611c3-edc4-4ba0-8824-e100d8b3f156 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:56.535290 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d611c3-edc4-4ba0-8824-e100d8b3f156 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-c0d611c3-edc4-4ba0-8824-e100d8b3f156 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:56.551926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:56.553037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 16:21:56.553884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:56.557050 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 415/817] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:56 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:56.562780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d611c3-edc4-4ba0-8824-e100d8b3f156 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:56.624806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f8d34-d697-4cee-b88c-0b9630cc44e4 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:56.670760 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1c122-28c7-452e-b5b3-26ebb84be10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:56.671699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1c122-28c7-452e-b5b3-26ebb84be10e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:56.672249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1c122-28c7-452e-b5b3-26ebb84be10e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:56.672735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1c122-28c7-452e-b5b3-26ebb84be10e None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:56.674490 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1c122-28c7-452e-b5b3-26ebb84be10e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:56.675016 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1c122-28c7-452e-b5b3-26ebb84be10e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:56.676984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1c122-28c7-452e-b5b3-26ebb84be10e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:56.695954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 403/818] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:56.696853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1c122-28c7-452e-b5b3-26ebb84be10e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:56.700102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:56.713489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d611c3-edc4-4ba0-8824-e100d8b3f156 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:56.760573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ae49f-264c-4b5c-9d27-f7032ad8418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:56.761198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ae49f-264c-4b5c-9d27-f7032ad8418f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:56.761480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ae49f-264c-4b5c-9d27-f7032ad8418f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:56.761760 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ae49f-264c-4b5c-9d27-f7032ad8418f None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:56.762513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ae49f-264c-4b5c-9d27-f7032ad8418f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:56.762752 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ae49f-264c-4b5c-9d27-f7032ad8418f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:56.764479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ae49f-264c-4b5c-9d27-f7032ad8418f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:56.781732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 416/819] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:56.783770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ae49f-264c-4b5c-9d27-f7032ad8418f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:56.803116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:56.825020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1c122-28c7-452e-b5b3-26ebb84be10e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:56.873608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5b1ac-64ac-4f48-8463-2ce950c3b2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:56.874228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b1ac-64ac-4f48-8463-2ce950c3b2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:56.874508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b1ac-64ac-4f48-8463-2ce950c3b2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:56.874778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b1ac-64ac-4f48-8463-2ce950c3b2c4 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:56.875669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5b1ac-64ac-4f48-8463-2ce950c3b2c4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:56.876017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5b1ac-64ac-4f48-8463-2ce950c3b2c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:56.877959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5b1ac-64ac-4f48-8463-2ce950c3b2c4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:56.887091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 404/820] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 16:21:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:56.887091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5b1ac-64ac-4f48-8463-2ce950c3b2c4 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:56.910541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ae49f-264c-4b5c-9d27-f7032ad8418f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:56.951637 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5414653-0621-497c-9b4a-b2885349c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:56.952446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5414653-0621-497c-9b4a-b2885349c0fb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:56.952664 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5414653-0621-497c-9b4a-b2885349c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:56.952939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5414653-0621-497c-9b4a-b2885349c0fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:56.960540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5414653-0621-497c-9b4a-b2885349c0fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:56.962061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5414653-0621-497c-9b4a-b2885349c0fb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e5414653-0621-497c-9b4a-b2885349c0fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:56.974670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:56.975658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:56.976611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:56.976611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:56.976611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:56.976611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:56.976611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:56.976611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:56.976611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:56.976611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:56.980195 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 417/821] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:56.981032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5414653-0621-497c-9b4a-b2885349c0fb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:56.997610 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:57.024839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5b1ac-64ac-4f48-8463-2ce950c3b2c4 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:57.072993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8fdb9-1983-4321-89e7-c7a38ea2cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:57.074660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8fdb9-1983-4321-89e7-c7a38ea2cf9a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:57.075175 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8fdb9-1983-4321-89e7-c7a38ea2cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:57.075659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8fdb9-1983-4321-89e7-c7a38ea2cf9a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:57.086884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8fdb9-1983-4321-89e7-c7a38ea2cf9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:57.089355 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8fdb9-1983-4321-89e7-c7a38ea2cf9a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:57.090430 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5414653-0621-497c-9b4a-b2885349c0fb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-cdb8fdb9-1983-4321-89e7-c7a38ea2cf9a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:57.105869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:57.106880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:57.107830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:57.107830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:57.107830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:57.107830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:57.107830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:57.107830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:57.107830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:57.107830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:57.107830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 16:21:57.107830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:57.114603 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 405/822] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 16:21:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:57.115671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8fdb9-1983-4321-89e7-c7a38ea2cf9a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:57.131759 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:57.132080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20214beb-9cb6-4231-9825-9f2d1e1f2555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:57.133082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20214beb-9cb6-4231-9825-9f2d1e1f2555 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:57.133376 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20214beb-9cb6-4231-9825-9f2d1e1f2555 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:57.133656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20214beb-9cb6-4231-9825-9f2d1e1f2555 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:57.134525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20214beb-9cb6-4231-9825-9f2d1e1f2555 None admin] RBAC: Adding query filter params (type=network) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:57.134787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20214beb-9cb6-4231-9825-9f2d1e1f2555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:57.136386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20214beb-9cb6-4231-9825-9f2d1e1f2555 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:57.147964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 418/823] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 16:21:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:57.147964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20214beb-9cb6-4231-9825-9f2d1e1f2555 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:57.232737 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8fdb9-1983-4321-89e7-c7a38ea2cf9a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:57.251002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:57.279461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20214beb-9cb6-4231-9825-9f2d1e1f2555 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:57.281117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9c6ee-556e-4964-80ca-2d4353bf3db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:57.283028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c6ee-556e-4964-80ca-2d4353bf3db3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:57.283558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c6ee-556e-4964-80ca-2d4353bf3db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:57.284061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c6ee-556e-4964-80ca-2d4353bf3db3 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:57.285023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9c6ee-556e-4964-80ca-2d4353bf3db3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:57.285539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9c6ee-556e-4964-80ca-2d4353bf3db3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:57.287725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9c6ee-556e-4964-80ca-2d4353bf3db3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:57.305849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 406/824] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:57.307043 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9c6ee-556e-4964-80ca-2d4353bf3db3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:57.322056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea496ff5-09bb-42f2-a25c-b5be52fb7bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:57.322710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea496ff5-09bb-42f2-a25c-b5be52fb7bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:57.323035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea496ff5-09bb-42f2-a25c-b5be52fb7bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:57.323534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea496ff5-09bb-42f2-a25c-b5be52fb7bb7 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:57.324210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea496ff5-09bb-42f2-a25c-b5be52fb7bb7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:57.324518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea496ff5-09bb-42f2-a25c-b5be52fb7bb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:57.326001 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea496ff5-09bb-42f2-a25c-b5be52fb7bb7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:57.351151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 419/825] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 27 16:21:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:57.352180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea496ff5-09bb-42f2-a25c-b5be52fb7bb7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:57.390547 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:57.425938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9c6ee-556e-4964-80ca-2d4353bf3db3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:57.462552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76ab6b-ff2c-494b-9fe2-1c1381bf3b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:57.463429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76ab6b-ff2c-494b-9fe2-1c1381bf3b15 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:57.463572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76ab6b-ff2c-494b-9fe2-1c1381bf3b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:57.463739 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76ab6b-ff2c-494b-9fe2-1c1381bf3b15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:57.464477 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76ab6b-ff2c-494b-9fe2-1c1381bf3b15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:57.465891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76ab6b-ff2c-494b-9fe2-1c1381bf3b15 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:57.486747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea496ff5-09bb-42f2-a25c-b5be52fb7bb7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:57.495906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 407/826] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:21:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:21:57.495906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76ab6b-ff2c-494b-9fe2-1c1381bf3b15 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:57.547006 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:57.560001 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b63e1-d8e2-429c-b1fc-f4ea5b673f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:57.560887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b63e1-d8e2-429c-b1fc-f4ea5b673f21 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:57.561349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b63e1-d8e2-429c-b1fc-f4ea5b673f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:57.561766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b63e1-d8e2-429c-b1fc-f4ea5b673f21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:57.562772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b63e1-d8e2-429c-b1fc-f4ea5b673f21 None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=9d5a8ef373ca4ed7bf31361e24e42e54) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:57.563232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b63e1-d8e2-429c-b1fc-f4ea5b673f21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:57.565536 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b63e1-d8e2-429c-b1fc-f4ea5b673f21 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:57.572650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 420/827] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:21:57 2022] GET /identity/v3/role_assignments?user.id=9d5a8ef373ca4ed7bf31361e24e42e54&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:57.574345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a570b1-7d8c-4539-b035-2d93152a17a8 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:57.574795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a570b1-7d8c-4539-b035-2d93152a17a8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:57.575217 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a570b1-7d8c-4539-b035-2d93152a17a8 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:57.582054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 421/828] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:57.584113 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485778c-e033-445d-8abe-2f0dfeecd6b0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:57.584580 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485778c-e033-445d-8abe-2f0dfeecd6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:57.585000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485778c-e033-445d-8abe-2f0dfeecd6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:57.604694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8485778c-e033-445d-8abe-2f0dfeecd6b0 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:57.606157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8485778c-e033-445d-8abe-2f0dfeecd6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:57.636754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76ab6b-ff2c-494b-9fe2-1c1381bf3b15 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:57.675384 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:57.689802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6cca7-db63-4b96-95d7-2688fe37ba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:57.691125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6cca7-db63-4b96-95d7-2688fe37ba23 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:57.693690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6cca7-db63-4b96-95d7-2688fe37ba23 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:57.694204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6cca7-db63-4b96-95d7-2688fe37ba23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:57.710804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6cca7-db63-4b96-95d7-2688fe37ba23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:57.711155 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 422/829] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:21:57.712734 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6cca7-db63-4b96-95d7-2688fe37ba23 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-e3f6cca7-db63-4b96-95d7-2688fe37ba23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:57.729426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:57.730532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:57.731436 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:57.731436 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:57.731436 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:57.731436 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:57.731660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485778c-e033-445d-8abe-2f0dfeecd6b0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:57.734206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 408/830] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:57.739602 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6cca7-db63-4b96-95d7-2688fe37ba23 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:57.864782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485778c-e033-445d-8abe-2f0dfeecd6b0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:57.877963 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6cca7-db63-4b96-95d7-2688fe37ba23 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:57.892701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:57.905846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384df6c0-cf5e-404e-8dfe-8b86bcf611f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:57.906495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384df6c0-cf5e-404e-8dfe-8b86bcf611f1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:57.906782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384df6c0-cf5e-404e-8dfe-8b86bcf611f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:57.907058 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384df6c0-cf5e-404e-8dfe-8b86bcf611f1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:57.908695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384df6c0-cf5e-404e-8dfe-8b86bcf611f1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:57.909813 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384df6c0-cf5e-404e-8dfe-8b86bcf611f1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:57.920145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332c956-e574-4734-b74f-ad9af296c69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:57.921016 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c956-e574-4734-b74f-ad9af296c69d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:57.921452 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c956-e574-4734-b74f-ad9af296c69d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:57.921889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c956-e574-4734-b74f-ad9af296c69d None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:57.922733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332c956-e574-4734-b74f-ad9af296c69d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:57.923714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332c956-e574-4734-b74f-ad9af296c69d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:57.925528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332c956-e574-4734-b74f-ad9af296c69d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-384df6c0-cf5e-404e-8dfe-8b86bcf611f1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:57.926135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:57.927411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:21:57.928420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 423/831] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:21:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:21:57.933782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384df6c0-cf5e-404e-8dfe-8b86bcf611f1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:57.944688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 409/832] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:57.949834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332c956-e574-4734-b74f-ad9af296c69d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:57.992470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:58.067564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384df6c0-cf5e-404e-8dfe-8b86bcf611f1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:58.078503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332c956-e574-4734-b74f-ad9af296c69d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:58.119322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023c7c7-da0d-4cb6-b984-e70fb74ed35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:58.119977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023c7c7-da0d-4cb6-b984-e70fb74ed35f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:58.120261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023c7c7-da0d-4cb6-b984-e70fb74ed35f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:58.120539 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023c7c7-da0d-4cb6-b984-e70fb74ed35f None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:58.121216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023c7c7-da0d-4cb6-b984-e70fb74ed35f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:58.121524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023c7c7-da0d-4cb6-b984-e70fb74ed35f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:58.121630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1a2ad-4b68-42c7-b6ac-d0ceef7f7d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:58.122495 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1a2ad-4b68-42c7-b6ac-d0ceef7f7d0a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:58.122889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023c7c7-da0d-4cb6-b984-e70fb74ed35f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:58.123212 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1a2ad-4b68-42c7-b6ac-d0ceef7f7d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:58.123777 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1a2ad-4b68-42c7-b6ac-d0ceef7f7d0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:58.128460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 424/833] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:21:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:58.132048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1a2ad-4b68-42c7-b6ac-d0ceef7f7d0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:58.133630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1a2ad-4b68-42c7-b6ac-d0ceef7f7d0a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:58.133765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023c7c7-da0d-4cb6-b984-e70fb74ed35f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-34f1a2ad-4b68-42c7-b6ac-d0ceef7f7d0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:21:58.147786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:58.148747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:58.149642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:21:58.149642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:21:58.149642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:21:58.149642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:21:58.149642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:21:58.149642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:21:58.149642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:21:58.149642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:58.151797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 410/834] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:21:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:58.158698 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1a2ad-4b68-42c7-b6ac-d0ceef7f7d0a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:58.196411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:58.249877 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023c7c7-da0d-4cb6-b984-e70fb74ed35f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:58.277882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:58.282127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1a2ad-4b68-42c7-b6ac-d0ceef7f7d0a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:58.296509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457372b-2339-4358-bd73-295fcc8ef6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:58.297136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457372b-2339-4358-bd73-295fcc8ef6eb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:58.297420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457372b-2339-4358-bd73-295fcc8ef6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:58.297695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457372b-2339-4358-bd73-295fcc8ef6eb None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:58.299075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457372b-2339-4358-bd73-295fcc8ef6eb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:58.299728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457372b-2339-4358-bd73-295fcc8ef6eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:58.300777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457372b-2339-4358-bd73-295fcc8ef6eb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:58.305922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 425/835] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:21:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:21:58.323127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90549f-3595-45a2-aba7-cb475a9078ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:58.324102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90549f-3595-45a2-aba7-cb475a9078ce None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:58.324535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90549f-3595-45a2-aba7-cb475a9078ce None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:58.324959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90549f-3595-45a2-aba7-cb475a9078ce None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:58.325889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90549f-3595-45a2-aba7-cb475a9078ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:58.326356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90549f-3595-45a2-aba7-cb475a9078ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:58.328036 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90549f-3595-45a2-aba7-cb475a9078ce None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:58.342682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 411/836] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:21:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:58.349560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457372b-2339-4358-bd73-295fcc8ef6eb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:58.403399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58f840-74e3-469e-a643-26bebb7fd9b0 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:58.403743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58f840-74e3-469e-a643-26bebb7fd9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:58.403999 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58f840-74e3-469e-a643-26bebb7fd9b0 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:58.405370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 412/837] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:58.412778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279266ca-79b0-4ea1-9fe8-cf8062c8f46b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:58.413082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279266ca-79b0-4ea1-9fe8-cf8062c8f46b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:58.413346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279266ca-79b0-4ea1-9fe8-cf8062c8f46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:58.434779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-279266ca-79b0-4ea1-9fe8-cf8062c8f46b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:58.436072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-279266ca-79b0-4ea1-9fe8-cf8062c8f46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:58.465426 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457372b-2339-4358-bd73-295fcc8ef6eb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:58.491244 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:58.508534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda130a6-352d-4b59-a55f-cf225dfb9025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:58.509630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda130a6-352d-4b59-a55f-cf225dfb9025 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:58.510068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda130a6-352d-4b59-a55f-cf225dfb9025 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:58.510468 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda130a6-352d-4b59-a55f-cf225dfb9025 None admin] PATH_INFO: `/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/cf356c7ffa044fe39bb548320d2f5acb/roles/93a2fa7fee0546bfb1e36487e6785cdd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:58.526010 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 413/838] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:21:58.528351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda130a6-352d-4b59-a55f-cf225dfb9025 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01ef9cd2ffc4edd94cbf0017a720a57, user_id=cf356c7ffa044fe39bb548320d2f5acb, role_id=93a2fa7fee0546bfb1e36487e6785cdd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:58.529809 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda130a6-352d-4b59-a55f-cf225dfb9025 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:58.543645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 426/839] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:21:58 2022] PUT /identity/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/cf356c7ffa044fe39bb548320d2f5acb/roles/93a2fa7fee0546bfb1e36487e6785cdd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:21:58.551191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279266ca-79b0-4ea1-9fe8-cf8062c8f46b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:58.655690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:58.669288 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279266ca-79b0-4ea1-9fe8-cf8062c8f46b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:58.708849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c691c3-eff5-45df-ac6e-707763097df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:58.709561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c691c3-eff5-45df-ac6e-707763097df6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:58.709850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c691c3-eff5-45df-ac6e-707763097df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:58.710126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c691c3-eff5-45df-ac6e-707763097df6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:58.721482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c691c3-eff5-45df-ac6e-707763097df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-e8c691c3-eff5-45df-ac6e-707763097df6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:21:58.726607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:58.727533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:58.728571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:58.728571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:58.728571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:58.728571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:58.728571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:21:58.728571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:21:58.728571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:21:58.728571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:21:58.728571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:21:58.728571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:21:58.728571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:21:58.728571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:58.728571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 414/840] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:58.734079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda130a6-352d-4b59-a55f-cf225dfb9025 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:58.843427 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda130a6-352d-4b59-a55f-cf225dfb9025 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:58.881836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dc97f-3cb0-4230-a9c8-b59851aa90e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:58.882459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dc97f-3cb0-4230-a9c8-b59851aa90e5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:58.882737 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dc97f-3cb0-4230-a9c8-b59851aa90e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:58.883008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dc97f-3cb0-4230-a9c8-b59851aa90e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:58.883721 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862dc97f-3cb0-4230-a9c8-b59851aa90e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:58.884054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862dc97f-3cb0-4230-a9c8-b59851aa90e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:58.885485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862dc97f-3cb0-4230-a9c8-b59851aa90e5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:58.895143 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 427/841] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:21:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:58.900386 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c691c3-eff5-45df-ac6e-707763097df6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:59.009231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c691c3-eff5-45df-ac6e-707763097df6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:59.051979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021be80-95d5-424b-ad0f-39fc09d1afe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:59.052642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021be80-95d5-424b-ad0f-39fc09d1afe2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:59.052932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021be80-95d5-424b-ad0f-39fc09d1afe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:59.053214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021be80-95d5-424b-ad0f-39fc09d1afe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:59.063437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021be80-95d5-424b-ad0f-39fc09d1afe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:59.065474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021be80-95d5-424b-ad0f-39fc09d1afe2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:59.074146 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-2021be80-95d5-424b-ad0f-39fc09d1afe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:21:59.081976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:59.083411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:59.084351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:21:59.084351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:21:59.084351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:21:59.084351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:59.084351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 415/842] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:59.089180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dc97f-3cb0-4230-a9c8-b59851aa90e5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:59.172338 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:59.195480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dc97f-3cb0-4230-a9c8-b59851aa90e5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:59.230477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a95d72-2d44-453d-94be-2faa05d2ea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:59.231456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a95d72-2d44-453d-94be-2faa05d2ea1f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:59.231993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a95d72-2d44-453d-94be-2faa05d2ea1f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:59.232493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a95d72-2d44-453d-94be-2faa05d2ea1f None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:59.233379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a95d72-2d44-453d-94be-2faa05d2ea1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:59.233904 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a95d72-2d44-453d-94be-2faa05d2ea1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:59.235472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a95d72-2d44-453d-94be-2faa05d2ea1f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:59.248741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 428/843] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:59.259890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021be80-95d5-424b-ad0f-39fc09d1afe2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:59.359712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021be80-95d5-424b-ad0f-39fc09d1afe2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:59.395769 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0a10-37f8-4d69-9f7d-c2927a31192e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:59.396448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0a10-37f8-4d69-9f7d-c2927a31192e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:59.396737 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0a10-37f8-4d69-9f7d-c2927a31192e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:59.397014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0a10-37f8-4d69-9f7d-c2927a31192e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:59.404803 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c0a10-37f8-4d69-9f7d-c2927a31192e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:59.406239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c0a10-37f8-4d69-9f7d-c2927a31192e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-604c0a10-37f8-4d69-9f7d-c2927a31192e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:21:59.418687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:21:59.419623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:21:59.420600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:21:59.420600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:21:59.420600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:21:59.420600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:21:59.420600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:21:59.420600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:21:59.420600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:21:59.420600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:21:59.420600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 16:21:59.420600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:21:59.424284 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 416/844] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:21:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:21:59.428956 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a95d72-2d44-453d-94be-2faa05d2ea1f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:59.529248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:59.543725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a95d72-2d44-453d-94be-2faa05d2ea1f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:59.580918 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6c636-04ea-451f-b44e-7f13d6c76914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:59.581838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6c636-04ea-451f-b44e-7f13d6c76914 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:59.582307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6c636-04ea-451f-b44e-7f13d6c76914 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:59.582765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6c636-04ea-451f-b44e-7f13d6c76914 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:59.583734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6c636-04ea-451f-b44e-7f13d6c76914 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:21:59.584279 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6c636-04ea-451f-b44e-7f13d6c76914 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:59.585888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6c636-04ea-451f-b44e-7f13d6c76914 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:59.604618 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 429/845] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 27 16:21:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:21:59.610275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0a10-37f8-4d69-9f7d-c2927a31192e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:21:59.676065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:59.720848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0a10-37f8-4d69-9f7d-c2927a31192e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:21:59.756417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed739a-81bd-4420-8313-c9360821e9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:21:59.757047 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed739a-81bd-4420-8313-c9360821e9bd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:59.757339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed739a-81bd-4420-8313-c9360821e9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:59.757665 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed739a-81bd-4420-8313-c9360821e9bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:59.831881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed739a-81bd-4420-8313-c9360821e9bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:21:59.833340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed739a-81bd-4420-8313-c9360821e9bd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:21:59.878426 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cb35d-1d22-4ce6-9ae9-9294da1f9459 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:59.878773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cb35d-1d22-4ce6-9ae9-9294da1f9459 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:59.878986 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cb35d-1d22-4ce6-9ae9-9294da1f9459 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:59.884730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 430/846] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:21:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:21:59.893897 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732f81e-7617-489e-8af9-ff2c2aa54e85 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:21:59.894635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732f81e-7617-489e-8af9-ff2c2aa54e85 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:21:59.895133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732f81e-7617-489e-8af9-ff2c2aa54e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:21:59.895920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:21:59.920562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7732f81e-7617-489e-8af9-ff2c2aa54e85 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:21:59.921773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7732f81e-7617-489e-8af9-ff2c2aa54e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:21:59.947242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 417/847] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:21:59 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:21:59.954068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed739a-81bd-4420-8313-c9360821e9bd None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:00.015454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 431/848] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:21:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:00.037596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732f81e-7617-489e-8af9-ff2c2aa54e85 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:00.074202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed739a-81bd-4420-8313-c9360821e9bd None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:00.108842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23b93c-83a4-49e9-b292-4a3b80a8b089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:00.109495 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23b93c-83a4-49e9-b292-4a3b80a8b089 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:00.109782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23b93c-83a4-49e9-b292-4a3b80a8b089 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:00.110062 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23b93c-83a4-49e9-b292-4a3b80a8b089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:00.118124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:00.122168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23b93c-83a4-49e9-b292-4a3b80a8b089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:00.123629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23b93c-83a4-49e9-b292-4a3b80a8b089 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5b23b93c-83a4-49e9-b292-4a3b80a8b089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:00.141026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:00.142561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:00.143466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:00.143466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:00.143466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:00.143466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:00.143710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732f81e-7617-489e-8af9-ff2c2aa54e85 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:00.147570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 418/849] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:00.148429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23b93c-83a4-49e9-b292-4a3b80a8b089 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:00.164748 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:00.180325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455b1bb-51e9-46fc-a56f-29b067897c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:00.180975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455b1bb-51e9-46fc-a56f-29b067897c40 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:00.181255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455b1bb-51e9-46fc-a56f-29b067897c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:00.181543 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455b1bb-51e9-46fc-a56f-29b067897c40 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:00.182158 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455b1bb-51e9-46fc-a56f-29b067897c40 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:00.183522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455b1bb-51e9-46fc-a56f-29b067897c40 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-d455b1bb-51e9-46fc-a56f-29b067897c40 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:00.193507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:00.195806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:00.198072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 432/850] 10.222.0.67 () {56 vars in 1132 bytes} [Wed Jul 27 16:22:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:00.206930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455b1bb-51e9-46fc-a56f-29b067897c40 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:00.289546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23b93c-83a4-49e9-b292-4a3b80a8b089 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:00.324599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455b1bb-51e9-46fc-a56f-29b067897c40 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:00.332329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a770414-8dab-45fa-8c51-5e0ec1992358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:00.333038 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a770414-8dab-45fa-8c51-5e0ec1992358 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:00.333395 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a770414-8dab-45fa-8c51-5e0ec1992358 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:00.333746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a770414-8dab-45fa-8c51-5e0ec1992358 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:00.334521 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a770414-8dab-45fa-8c51-5e0ec1992358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:00.334911 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a770414-8dab-45fa-8c51-5e0ec1992358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:00.336372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a770414-8dab-45fa-8c51-5e0ec1992358 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:00.351884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 419/851] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:00.357718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a770414-8dab-45fa-8c51-5e0ec1992358 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:00.369399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5e202-7374-4e0a-8aed-6b98ba281b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:00.370165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5e202-7374-4e0a-8aed-6b98ba281b35 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:00.370596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5e202-7374-4e0a-8aed-6b98ba281b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:00.370968 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5e202-7374-4e0a-8aed-6b98ba281b35 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:00.372258 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5e202-7374-4e0a-8aed-6b98ba281b35 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:00.372682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5e202-7374-4e0a-8aed-6b98ba281b35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:00.374869 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5e202-7374-4e0a-8aed-6b98ba281b35 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:00.381847 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 433/852] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 16:22:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:00.387267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5e202-7374-4e0a-8aed-6b98ba281b35 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:00.393222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:00.441926 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:00.474103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a770414-8dab-45fa-8c51-5e0ec1992358 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:00.505313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5e202-7374-4e0a-8aed-6b98ba281b35 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:00.509949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed8e7-ee32-4415-8532-fe7ee0cf234e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:00.510712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed8e7-ee32-4415-8532-fe7ee0cf234e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:00.511094 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed8e7-ee32-4415-8532-fe7ee0cf234e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:00.511463 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed8e7-ee32-4415-8532-fe7ee0cf234e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:00.518350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ed8e7-ee32-4415-8532-fe7ee0cf234e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:00.519924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ed8e7-ee32-4415-8532-fe7ee0cf234e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-403ed8e7-ee32-4415-8532-fe7ee0cf234e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:22:00.531312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:00.532967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:00.534117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:22:00.534117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:22:00.534117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:22:00.534117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:22:00.534117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:22:00.534117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:22:00.534117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:00.534117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:00.540377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 420/853] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:22:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:00.540377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1078af-7392-44e1-aaae-ea1f10a56faa None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:00.540377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1078af-7392-44e1-aaae-ea1f10a56faa None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:00.540377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1078af-7392-44e1-aaae-ea1f10a56faa None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:00.540377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 421/854] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:00.541162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1078af-7392-44e1-aaae-ea1f10a56faa None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:00.551038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641ffa4-95b4-4f38-adc4-adb470589ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:00.551666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641ffa4-95b4-4f38-adc4-adb470589ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:00.551978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641ffa4-95b4-4f38-adc4-adb470589ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:00.552259 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641ffa4-95b4-4f38-adc4-adb470589ee0 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:00.553099 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641ffa4-95b4-4f38-adc4-adb470589ee0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:00.553413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641ffa4-95b4-4f38-adc4-adb470589ee0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:00.555002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641ffa4-95b4-4f38-adc4-adb470589ee0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:00.560055 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 434/855] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 16:22:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:00.561208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454850a0-f9da-422a-81d9-6900d809576f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:00.561498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454850a0-f9da-422a-81d9-6900d809576f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:00.561780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454850a0-f9da-422a-81d9-6900d809576f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:00.582597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-454850a0-f9da-422a-81d9-6900d809576f None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:00.583909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-454850a0-f9da-422a-81d9-6900d809576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:00.677155 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:00.684006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1078af-7392-44e1-aaae-ea1f10a56faa None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:00.692384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 435/856] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:00.711132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454850a0-f9da-422a-81d9-6900d809576f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:00.722121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:00.729328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a6db9-bec9-4cb2-8f38-d6aa3d34561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:00.729891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a6db9-bec9-4cb2-8f38-d6aa3d34561c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:00.730183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a6db9-bec9-4cb2-8f38-d6aa3d34561c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:00.730885 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a6db9-bec9-4cb2-8f38-d6aa3d34561c None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:00.731797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a6db9-bec9-4cb2-8f38-d6aa3d34561c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:00.732300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a6db9-bec9-4cb2-8f38-d6aa3d34561c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:00.733897 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a6db9-bec9-4cb2-8f38-d6aa3d34561c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:00.747842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 422/857] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:22:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:00.756579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a6db9-bec9-4cb2-8f38-d6aa3d34561c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:00.830887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454850a0-f9da-422a-81d9-6900d809576f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:00.865929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a6db9-bec9-4cb2-8f38-d6aa3d34561c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:00.870390 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9437dad-a693-4042-9de7-b4b1b3de6fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:00.871186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9437dad-a693-4042-9de7-b4b1b3de6fc3 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:00.871618 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9437dad-a693-4042-9de7-b4b1b3de6fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:00.872069 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9437dad-a693-4042-9de7-b4b1b3de6fc3 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:00.872951 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9437dad-a693-4042-9de7-b4b1b3de6fc3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:00.874524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9437dad-a693-4042-9de7-b4b1b3de6fc3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:00.898673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 436/858] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:22:00 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:22:00.898673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731d8bc-8845-48d5-8c5e-314d0e86e094 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:00.898673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731d8bc-8845-48d5-8c5e-314d0e86e094 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:00.898673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731d8bc-8845-48d5-8c5e-314d0e86e094 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:00.899581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 437/859] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:00.905687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8916c5-dbd1-4660-86b7-cee0578f6974 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:00.906056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8916c5-dbd1-4660-86b7-cee0578f6974 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:00.906320 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8916c5-dbd1-4660-86b7-cee0578f6974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:00.920030 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe5c7b-7b4a-494b-b456-b8f5aa32cdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:00.921042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe5c7b-7b4a-494b-b456-b8f5aa32cdcf None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:00.921527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe5c7b-7b4a-494b-b456-b8f5aa32cdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:00.921991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe5c7b-7b4a-494b-b456-b8f5aa32cdcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:00.923657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe5c7b-7b4a-494b-b456-b8f5aa32cdcf None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=c48ede3f01be42c39a55c1beeeb85f26) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:00.924206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe5c7b-7b4a-494b-b456-b8f5aa32cdcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:00.925888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe5c7b-7b4a-494b-b456-b8f5aa32cdcf None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:00.927384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-4f8916c5-dbd1-4660-86b7-cee0578f6974 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:00.928650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4f8916c5-dbd1-4660-86b7-cee0578f6974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:00.933933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 423/860] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:22:00 2022] GET /identity/v3/role_assignments?user.id=c48ede3f01be42c39a55c1beeeb85f26&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:00.998853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:01.016232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 438/861] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:00 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:01.041486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe5c7b-7b4a-494b-b456-b8f5aa32cdcf None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:01.113125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:01.167367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe5c7b-7b4a-494b-b456-b8f5aa32cdcf None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:01.202999 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b16ff3-755f-4f41-a160-763636635861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:01.203641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b16ff3-755f-4f41-a160-763636635861 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:01.203944 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b16ff3-755f-4f41-a160-763636635861 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:01.204254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b16ff3-755f-4f41-a160-763636635861 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:01.214751 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b16ff3-755f-4f41-a160-763636635861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-59b16ff3-755f-4f41-a160-763636635861 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:22:01.220973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:01.221929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:01.222790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:01.222790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:01.222790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:01.222790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:01.222790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:22:01.222790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:22:01.222790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:22:01.222790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:22:01.222790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:22:01.222790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:22:01.222790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:22:01.222790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:01.222790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 424/862] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:22:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:01.230011 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8916c5-dbd1-4660-86b7-cee0578f6974 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:01.335975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8916c5-dbd1-4660-86b7-cee0578f6974 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:01.372679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0c98c-3900-4258-9087-5872543bacec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:01.373367 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0c98c-3900-4258-9087-5872543bacec None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:01.373718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0c98c-3900-4258-9087-5872543bacec None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:01.374000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0c98c-3900-4258-9087-5872543bacec None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:01.374771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0c98c-3900-4258-9087-5872543bacec None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:01.375086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0c98c-3900-4258-9087-5872543bacec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:01.377279 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0c98c-3900-4258-9087-5872543bacec None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:01.386433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 439/863] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:22:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:01.393739 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b16ff3-755f-4f41-a160-763636635861 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:01.500449 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b16ff3-755f-4f41-a160-763636635861 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:01.514593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:01.537151 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c445d-af88-46f7-9fa4-df06408d78e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:01.537797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c445d-af88-46f7-9fa4-df06408d78e9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:01.538084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c445d-af88-46f7-9fa4-df06408d78e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:01.538359 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c445d-af88-46f7-9fa4-df06408d78e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:01.549845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c445d-af88-46f7-9fa4-df06408d78e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:01.551282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c445d-af88-46f7-9fa4-df06408d78e9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-b11c445d-af88-46f7-9fa4-df06408d78e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:01.566421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:01.567501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:01.568745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:01.568745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:01.568745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:01.568745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:01.568745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 425/864] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:01.573475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0c98c-3900-4258-9087-5872543bacec None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:01.624726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:01.682117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0c98c-3900-4258-9087-5872543bacec None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:01.718043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9704c-a05d-4364-9065-93c4ae6e90ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:01.719071 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9704c-a05d-4364-9065-93c4ae6e90ae None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:01.719461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9704c-a05d-4364-9065-93c4ae6e90ae None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:01.719886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9704c-a05d-4364-9065-93c4ae6e90ae None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:01.720862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9704c-a05d-4364-9065-93c4ae6e90ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:01.721275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9704c-a05d-4364-9065-93c4ae6e90ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:01.722818 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9704c-a05d-4364-9065-93c4ae6e90ae None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:01.738099 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 440/865] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:01.743276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c445d-af88-46f7-9fa4-df06408d78e9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:01.860057 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c445d-af88-46f7-9fa4-df06408d78e9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:01.901824 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f77fde-7c13-4f42-919a-f7d4754e9128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:01.902398 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f77fde-7c13-4f42-919a-f7d4754e9128 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:01.902688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f77fde-7c13-4f42-919a-f7d4754e9128 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:01.902970 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f77fde-7c13-4f42-919a-f7d4754e9128 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:01.911453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f77fde-7c13-4f42-919a-f7d4754e9128 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:01.912915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f77fde-7c13-4f42-919a-f7d4754e9128 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d1f77fde-7c13-4f42-919a-f7d4754e9128 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:22:01.924978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:01.925929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:01.926874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:01.926874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:01.926874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:22:01.926874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:22:01.926874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:22:01.926874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:22:01.926874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:22:01.926874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:22:01.926874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 16:22:01.926874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:01.926874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 426/866] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 16:22:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:01.932029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9704c-a05d-4364-9065-93c4ae6e90ae None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:02.031329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9704c-a05d-4364-9065-93c4ae6e90ae None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:02.042714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:02.067191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9414ca2-232d-4df2-91a0-04818e886524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:02.067812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9414ca2-232d-4df2-91a0-04818e886524 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:02.068137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9414ca2-232d-4df2-91a0-04818e886524 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:02.068417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9414ca2-232d-4df2-91a0-04818e886524 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:02.069210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9414ca2-232d-4df2-91a0-04818e886524 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:02.069519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9414ca2-232d-4df2-91a0-04818e886524 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:02.070968 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9414ca2-232d-4df2-91a0-04818e886524 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:02.089020 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 441/867] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 27 16:22:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:02.099892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f77fde-7c13-4f42-919a-f7d4754e9128 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:02.124731 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:02.211766 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f77fde-7c13-4f42-919a-f7d4754e9128 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:02.248765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783bd38-a05e-4709-9dc5-586285cca45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:02.249395 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783bd38-a05e-4709-9dc5-586285cca45b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:02.249687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783bd38-a05e-4709-9dc5-586285cca45b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:02.249988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783bd38-a05e-4709-9dc5-586285cca45b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:02.322228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783bd38-a05e-4709-9dc5-586285cca45b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:02.323681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783bd38-a05e-4709-9dc5-586285cca45b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:02.349715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:02.432793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 427/868] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:22:02 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:22:02.438390 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9414ca2-232d-4df2-91a0-04818e886524 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:02.541243 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9414ca2-232d-4df2-91a0-04818e886524 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:02.581549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc86460-ebbe-4fda-a300-a53ba095eaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:02.582203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc86460-ebbe-4fda-a300-a53ba095eaea None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:02.582493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc86460-ebbe-4fda-a300-a53ba095eaea None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:02.582771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc86460-ebbe-4fda-a300-a53ba095eaea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:02.593268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc86460-ebbe-4fda-a300-a53ba095eaea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:02.595298 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc86460-ebbe-4fda-a300-a53ba095eaea None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-5cc86460-ebbe-4fda-a300-a53ba095eaea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:02.612053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:02.613008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:02.613930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:02.613930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:02.613930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:02.613930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:02.616175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 442/869] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:02.621507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783bd38-a05e-4709-9dc5-586285cca45b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:02.729092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783bd38-a05e-4709-9dc5-586285cca45b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:02.755572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:02.768632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658e84d-109f-4228-bd14-18152e48383b None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:02.768915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd99da-c579-4c49-a6b8-8f2286b3601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:02.769488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd99da-c579-4c49-a6b8-8f2286b3601b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:02.769599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658e84d-109f-4228-bd14-18152e48383b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:02.769824 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd99da-c579-4c49-a6b8-8f2286b3601b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:02.770107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd99da-c579-4c49-a6b8-8f2286b3601b None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:02.770503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658e84d-109f-4228-bd14-18152e48383b None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:02.770805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd99da-c579-4c49-a6b8-8f2286b3601b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:02.771114 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd99da-c579-4c49-a6b8-8f2286b3601b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:02.772624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd99da-c579-4c49-a6b8-8f2286b3601b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:02.773018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 443/870] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:22:02.779117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bcf18-9c35-42fc-81ac-42d89c0a7076 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:02.779411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bcf18-9c35-42fc-81ac-42d89c0a7076 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:02.779694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bcf18-9c35-42fc-81ac-42d89c0a7076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:02.788197 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 428/871] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:02.796678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd99da-c579-4c49-a6b8-8f2286b3601b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:02.802956 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-319bcf18-9c35-42fc-81ac-42d89c0a7076 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:02.804460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-319bcf18-9c35-42fc-81ac-42d89c0a7076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:02.825161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:02.891012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 444/872] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:02.914683 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bcf18-9c35-42fc-81ac-42d89c0a7076 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:02.917263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd99da-c579-4c49-a6b8-8f2286b3601b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:02.962682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884e11e-db21-4855-9187-0fa9b6aed2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:02.963617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884e11e-db21-4855-9187-0fa9b6aed2ae None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:02.963931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884e11e-db21-4855-9187-0fa9b6aed2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:02.964217 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884e11e-db21-4855-9187-0fa9b6aed2ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:02.974196 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884e11e-db21-4855-9187-0fa9b6aed2ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:02.976138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884e11e-db21-4855-9187-0fa9b6aed2ae None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-8884e11e-db21-4855-9187-0fa9b6aed2ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:22:02.997178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:02.998140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:02.999067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:22:02.999067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:22:02.999067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:22:02.999067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:22:02.999067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:22:02.999067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:22:02.999067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:02.999067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:02.999582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 429/873] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:22:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:03.007901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884e11e-db21-4855-9187-0fa9b6aed2ae None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:03.026340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bcf18-9c35-42fc-81ac-42d89c0a7076 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:03.059304 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:03.073201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320bc50-195d-49ac-a1d7-723695a06506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:03.073959 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320bc50-195d-49ac-a1d7-723695a06506 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:03.074256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320bc50-195d-49ac-a1d7-723695a06506 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:03.074787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320bc50-195d-49ac-a1d7-723695a06506 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:03.075938 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320bc50-195d-49ac-a1d7-723695a06506 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:03.077862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320bc50-195d-49ac-a1d7-723695a06506 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:03.096868 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 445/874] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:22:02 2022] POST /identity/v3/services => generated 269 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:22:03.098142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c6054-75a5-4f18-884d-84fa717d223c None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:03.098437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c6054-75a5-4f18-884d-84fa717d223c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:03.098718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c6054-75a5-4f18-884d-84fa717d223c None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:03.103906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 446/875] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:03.105772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9cbbc-bd71-4d00-971b-73b8cce8072d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:03.106065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9cbbc-bd71-4d00-971b-73b8cce8072d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:03.106317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9cbbc-bd71-4d00-971b-73b8cce8072d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:03.135122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7fc9cbbc-bd71-4d00-971b-73b8cce8072d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:03.135777 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884e11e-db21-4855-9187-0fa9b6aed2ae None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:03.137048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7fc9cbbc-bd71-4d00-971b-73b8cce8072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:03.142584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:03.182812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8391f-ea76-4e41-94a2-bf321aca9b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:03.183445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8391f-ea76-4e41-94a2-bf321aca9b8b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:03.183734 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8391f-ea76-4e41-94a2-bf321aca9b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:03.184045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8391f-ea76-4e41-94a2-bf321aca9b8b None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:03.184805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8391f-ea76-4e41-94a2-bf321aca9b8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:03.185118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8391f-ea76-4e41-94a2-bf321aca9b8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:03.187302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8391f-ea76-4e41-94a2-bf321aca9b8b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:03.206282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 430/876] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:22:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:03.206282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dea6f-d4ee-49fc-9c31-9cacfd9b790c None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:03.206282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dea6f-d4ee-49fc-9c31-9cacfd9b790c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:03.206282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dea6f-d4ee-49fc-9c31-9cacfd9b790c None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:03.206282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 431/877] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:03.209382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dea6f-d4ee-49fc-9c31-9cacfd9b790c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:03.229803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 447/878] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:03.240165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15738-1bfb-4170-b08d-207d28a6336b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:03.240165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15738-1bfb-4170-b08d-207d28a6336b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:03.240165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15738-1bfb-4170-b08d-207d28a6336b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:03.256959 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-04a15738-1bfb-4170-b08d-207d28a6336b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:03.258144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-04a15738-1bfb-4170-b08d-207d28a6336b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:03.335735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:03.336908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 448/879] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:03.337702 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a15738-1bfb-4170-b08d-207d28a6336b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:03.350364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dea6f-d4ee-49fc-9c31-9cacfd9b790c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:03.390872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da744c-63ba-480e-aaa9-8ba02cadc17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:03.391505 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da744c-63ba-480e-aaa9-8ba02cadc17f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:03.392765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da744c-63ba-480e-aaa9-8ba02cadc17f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:03.392765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da744c-63ba-480e-aaa9-8ba02cadc17f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:03.393077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da744c-63ba-480e-aaa9-8ba02cadc17f None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=cf356c7ffa044fe39bb548320d2f5acb) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:03.393390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da744c-63ba-480e-aaa9-8ba02cadc17f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:03.394810 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da744c-63ba-480e-aaa9-8ba02cadc17f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:03.401053 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 432/880] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:22:03 2022] GET /identity/v3/role_assignments?user.id=cf356c7ffa044fe39bb548320d2f5acb&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:03.401676 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da744c-63ba-480e-aaa9-8ba02cadc17f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:03.424202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:03.466563 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a15738-1bfb-4170-b08d-207d28a6336b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:03.509188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a461f60-bdf7-4937-9c85-7dcc273bb9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:03.510710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461f60-bdf7-4937-9c85-7dcc273bb9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:03.511657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461f60-bdf7-4937-9c85-7dcc273bb9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:03.512411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461f60-bdf7-4937-9c85-7dcc273bb9f9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:03.513316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a461f60-bdf7-4937-9c85-7dcc273bb9f9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:03.515676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a461f60-bdf7-4937-9c85-7dcc273bb9f9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-8a461f60-bdf7-4937-9c85-7dcc273bb9f9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:03.529000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:03.530267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:22:03.531296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:03.535316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 449/881] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:22:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:03.543933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da744c-63ba-480e-aaa9-8ba02cadc17f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:03.544171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a461f60-bdf7-4937-9c85-7dcc273bb9f9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:03.579728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2fa7a-8e53-43fe-9c8e-b2cf6228df8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:03.580426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2fa7a-8e53-43fe-9c8e-b2cf6228df8b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:03.580713 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2fa7a-8e53-43fe-9c8e-b2cf6228df8b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:03.581300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2fa7a-8e53-43fe-9c8e-b2cf6228df8b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:03.582321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2fa7a-8e53-43fe-9c8e-b2cf6228df8b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:03.583495 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2fa7a-8e53-43fe-9c8e-b2cf6228df8b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-f3f2fa7a-8e53-43fe-9c8e-b2cf6228df8b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:03.594617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:03.596526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:03.597431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:03.598197 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 433/882] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 16:22:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:03.603119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2fa7a-8e53-43fe-9c8e-b2cf6228df8b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:03.640044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:03.681957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a461f60-bdf7-4937-9c85-7dcc273bb9f9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:03.722957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf397b-d8fc-4dd7-9cee-f41423c860fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:03.723551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf397b-d8fc-4dd7-9cee-f41423c860fc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:03.723832 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf397b-d8fc-4dd7-9cee-f41423c860fc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:03.724132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf397b-d8fc-4dd7-9cee-f41423c860fc None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:03.724801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf397b-d8fc-4dd7-9cee-f41423c860fc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:03.725106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf397b-d8fc-4dd7-9cee-f41423c860fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:03.727294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf397b-d8fc-4dd7-9cee-f41423c860fc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:03.727739 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:03.731482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2fa7a-8e53-43fe-9c8e-b2cf6228df8b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:03.737601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 450/883] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:22:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:03.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf397b-d8fc-4dd7-9cee-f41423c860fc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:03.775552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e9f7f-a5cd-4284-9fdd-995e37c1d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:03.776256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e9f7f-a5cd-4284-9fdd-995e37c1d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:03.776536 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e9f7f-a5cd-4284-9fdd-995e37c1d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:03.776871 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e9f7f-a5cd-4284-9fdd-995e37c1d0d6 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:03.777555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e9f7f-a5cd-4284-9fdd-995e37c1d0d6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:03.777864 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e9f7f-a5cd-4284-9fdd-995e37c1d0d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:03.779468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e9f7f-a5cd-4284-9fdd-995e37c1d0d6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:03.784920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 434/884] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 16:22:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:03.790215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e9f7f-a5cd-4284-9fdd-995e37c1d0d6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:03.878370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf397b-d8fc-4dd7-9cee-f41423c860fc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:03.903064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:03.913394 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e9f7f-a5cd-4284-9fdd-995e37c1d0d6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:03.919681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07714aa4-cc76-426f-8bc1-526d51c037c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:03.920663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714aa4-cc76-426f-8bc1-526d51c037c1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:03.921222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714aa4-cc76-426f-8bc1-526d51c037c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:03.921704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714aa4-cc76-426f-8bc1-526d51c037c1 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:03.922591 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07714aa4-cc76-426f-8bc1-526d51c037c1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:03.923362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07714aa4-cc76-426f-8bc1-526d51c037c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:03.924998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07714aa4-cc76-426f-8bc1-526d51c037c1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:03.930623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 451/885] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:22:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:03.936054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07714aa4-cc76-426f-8bc1-526d51c037c1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:03.955120 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eae94-bd39-4ff6-9d5e-7e1143f08b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:03.955943 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eae94-bd39-4ff6-9d5e-7e1143f08b39 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:03.956239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eae94-bd39-4ff6-9d5e-7e1143f08b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:03.956523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eae94-bd39-4ff6-9d5e-7e1143f08b39 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:03.957211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eae94-bd39-4ff6-9d5e-7e1143f08b39 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:03.957542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eae94-bd39-4ff6-9d5e-7e1143f08b39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:03.959114 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eae94-bd39-4ff6-9d5e-7e1143f08b39 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:03.963893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 435/886] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 16:22:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:04.018971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:04.064813 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07714aa4-cc76-426f-8bc1-526d51c037c1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:04.102851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad93c03-bf45-4878-b760-d5d32092b027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:04.103490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad93c03-bf45-4878-b760-d5d32092b027 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:04.103777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad93c03-bf45-4878-b760-d5d32092b027 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:04.104102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad93c03-bf45-4878-b760-d5d32092b027 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:04.104874 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad93c03-bf45-4878-b760-d5d32092b027 None admin] RBAC: Adding query filter params (interface=public, service_id=ff8008c312404e44a183103da913e464, region_id=RegionOne) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:04.105191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad93c03-bf45-4878-b760-d5d32092b027 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:04.106599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad93c03-bf45-4878-b760-d5d32092b027 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:04.113436 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 452/887] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 16:22:03 2022] GET /identity/v3/endpoints?service_id=ff8008c312404e44a183103da913e464&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:04.119013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eae94-bd39-4ff6-9d5e-7e1143f08b39 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:04.231390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eae94-bd39-4ff6-9d5e-7e1143f08b39 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:04.268420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce96775-e0b7-4c99-93bd-518a66eaf079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:04.269168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce96775-e0b7-4c99-93bd-518a66eaf079 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:04.269452 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce96775-e0b7-4c99-93bd-518a66eaf079 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:04.269728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce96775-e0b7-4c99-93bd-518a66eaf079 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:04.270405 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce96775-e0b7-4c99-93bd-518a66eaf079 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:04.271838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce96775-e0b7-4c99-93bd-518a66eaf079 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:04.278858 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 436/888] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 16:22:04 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:22:05.173948 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fbdc9-6747-49e4-88b8-b30b238459da None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:05.174862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fbdc9-6747-49e4-88b8-b30b238459da None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:05.175292 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fbdc9-6747-49e4-88b8-b30b238459da None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:05.177049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 453/889] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:05.182579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e288fa-0878-4675-bb6c-2242ec41de0e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:05.183423 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e288fa-0878-4675-bb6c-2242ec41de0e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:05.183956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e288fa-0878-4675-bb6c-2242ec41de0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:05.203218 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f2e288fa-0878-4675-bb6c-2242ec41de0e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:05.205008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f2e288fa-0878-4675-bb6c-2242ec41de0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:05.219562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:05.279530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 437/890] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:05.302176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fbdc9-6747-49e4-88b8-b30b238459da None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:05.417278 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fbdc9-6747-49e4-88b8-b30b238459da None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:05.444931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:05.456288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc462e-e97e-4a41-908a-5e81ede3bcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:05.457128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc462e-e97e-4a41-908a-5e81ede3bcb9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:05.457556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc462e-e97e-4a41-908a-5e81ede3bcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:05.458045 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc462e-e97e-4a41-908a-5e81ede3bcb9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:05.458811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc462e-e97e-4a41-908a-5e81ede3bcb9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:05.460412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc462e-e97e-4a41-908a-5e81ede3bcb9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-dddc462e-e97e-4a41-908a-5e81ede3bcb9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:05.471161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:05.472359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:22:05.473404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:05.475942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 454/891] 10.222.0.67 () {56 vars in 1132 bytes} [Wed Jul 27 16:22:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:05.487885 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e288fa-0878-4675-bb6c-2242ec41de0e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:05.583389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e288fa-0878-4675-bb6c-2242ec41de0e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:05.618520 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91e275-9200-4db5-a430-4af145afb3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:05.619145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91e275-9200-4db5-a430-4af145afb3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:05.619429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91e275-9200-4db5-a430-4af145afb3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:05.619705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91e275-9200-4db5-a430-4af145afb3b2 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:05.620412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91e275-9200-4db5-a430-4af145afb3b2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:05.620719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91e275-9200-4db5-a430-4af145afb3b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:05.622075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91e275-9200-4db5-a430-4af145afb3b2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:05.627071 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 438/892] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 16:22:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:05.635015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc462e-e97e-4a41-908a-5e81ede3bcb9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:05.677034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc05462-ae18-4d6b-9cfa-d41aeb3b9e93 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:05.677034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc05462-ae18-4d6b-9cfa-d41aeb3b9e93 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:05.677034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc05462-ae18-4d6b-9cfa-d41aeb3b9e93 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:05.678534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 439/893] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:22:05.683354 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffb6e5-87ca-48f6-bb24-0b799c27deab None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:05.683645 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffb6e5-87ca-48f6-bb24-0b799c27deab None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:05.683947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffb6e5-87ca-48f6-bb24-0b799c27deab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:05.702621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-65ffb6e5-87ca-48f6-bb24-0b799c27deab None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:05.703687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-65ffb6e5-87ca-48f6-bb24-0b799c27deab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:05.718625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:05.754957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc462e-e97e-4a41-908a-5e81ede3bcb9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:05.782946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 440/894] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:05.795357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b84cff-748c-4e58-b756-11926f1241fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:05.796019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b84cff-748c-4e58-b756-11926f1241fa None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:05.796306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b84cff-748c-4e58-b756-11926f1241fa None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:05.796584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b84cff-748c-4e58-b756-11926f1241fa None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:05.797323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b84cff-748c-4e58-b756-11926f1241fa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:05.797628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b84cff-748c-4e58-b756-11926f1241fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:05.800420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b84cff-748c-4e58-b756-11926f1241fa None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:05.806036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 455/895] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 16:22:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:05.809925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffb6e5-87ca-48f6-bb24-0b799c27deab None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:05.812853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b84cff-748c-4e58-b756-11926f1241fa None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:05.886678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:05.920448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffb6e5-87ca-48f6-bb24-0b799c27deab None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:05.937669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b84cff-748c-4e58-b756-11926f1241fa None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:05.957650 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d125b0-2975-4177-909a-9b47d050396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:05.958607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d125b0-2975-4177-909a-9b47d050396f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:05.958898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d125b0-2975-4177-909a-9b47d050396f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:05.959175 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d125b0-2975-4177-909a-9b47d050396f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:05.974597 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d125b0-2975-4177-909a-9b47d050396f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:22:05.977578 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21cdd-fe85-43ce-97cb-568b1839f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:05.978406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21cdd-fe85-43ce-97cb-568b1839f41d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:05.978892 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21cdd-fe85-43ce-97cb-568b1839f41d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:05.979348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21cdd-fe85-43ce-97cb-568b1839f41d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d9d125b0-2975-4177-909a-9b47d050396f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:22:05.979567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:05.980528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:05.981364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:05.981364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:05.981364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:05.981364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:05.981364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:22:05.981364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:22:05.981364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:22:05.981364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:22:05.981364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:22:05.981364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:22:05.981364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 16:22:05.981364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:05.981364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 441/896] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 27 16:22:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:05.988342 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f21cdd-fe85-43ce-97cb-568b1839f41d None admin] RBAC: Adding query filter params (interface=public, service_id=d625cd53c5d84a2d87e6b1e5618d55ec, region_id=RegionOne) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:05.988342 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f21cdd-fe85-43ce-97cb-568b1839f41d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:05.988342 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f21cdd-fe85-43ce-97cb-568b1839f41d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:05.988897 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d125b0-2975-4177-909a-9b47d050396f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:05.995053 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:06.002083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 456/897] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 16:22:05 2022] GET /identity/v3/endpoints?service_id=d625cd53c5d84a2d87e6b1e5618d55ec&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:06.003147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21cdd-fe85-43ce-97cb-568b1839f41d None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:06.117013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d125b0-2975-4177-909a-9b47d050396f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:06.123763 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21cdd-fe85-43ce-97cb-568b1839f41d None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:06.148599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:06.152027 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5902b-184e-4783-9cae-28d040fab45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:06.152660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5902b-184e-4783-9cae-28d040fab45d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:06.152945 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5902b-184e-4783-9cae-28d040fab45d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:06.153223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5902b-184e-4783-9cae-28d040fab45d None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:06.153936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5902b-184e-4783-9cae-28d040fab45d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:06.154242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5902b-184e-4783-9cae-28d040fab45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:06.155607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5902b-184e-4783-9cae-28d040fab45d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:06.169005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 442/898] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 16:22:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:06.169005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c90539-f2d5-487e-82d6-5ecd92461415 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:06.169005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c90539-f2d5-487e-82d6-5ecd92461415 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:06.169005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c90539-f2d5-487e-82d6-5ecd92461415 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:06.169005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 443/899] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:06.170464 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c90539-f2d5-487e-82d6-5ecd92461415 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:06.175675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7720e-a8b6-48c6-9f8c-de82631fc6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:06.176179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7720e-a8b6-48c6-9f8c-de82631fc6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:06.176179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7720e-a8b6-48c6-9f8c-de82631fc6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:06.176447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7720e-a8b6-48c6-9f8c-de82631fc6d9 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:06.177092 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7720e-a8b6-48c6-9f8c-de82631fc6d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:06.178461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7720e-a8b6-48c6-9f8c-de82631fc6d9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:06.184612 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 457/900] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 16:22:06 2022] GET /identity/v3/services => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:22:06.193440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573a5ac-8c68-426a-b952-94a039afa67d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:06.193770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573a5ac-8c68-426a-b952-94a039afa67d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:06.194004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573a5ac-8c68-426a-b952-94a039afa67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:06.218291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3573a5ac-8c68-426a-b952-94a039afa67d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:06.220325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3573a5ac-8c68-426a-b952-94a039afa67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:06.261118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:06.302532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 458/901] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:06.313517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c90539-f2d5-487e-82d6-5ecd92461415 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:06.326492 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573a5ac-8c68-426a-b952-94a039afa67d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:06.355763 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fca88-1e13-475e-ab57-13894a823f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:06.356576 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fca88-1e13-475e-ab57-13894a823f8e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:06.356866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fca88-1e13-475e-ab57-13894a823f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:06.357144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fca88-1e13-475e-ab57-13894a823f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:06.370311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fca88-1e13-475e-ab57-13894a823f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:06.371770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fca88-1e13-475e-ab57-13894a823f8e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-180fca88-1e13-475e-ab57-13894a823f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:06.388617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:06.389804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:06.391068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:06.391068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:06.391068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:06.391068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:06.391068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 444/902] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:06.391350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64eeb49-7861-43bf-8551-e07e413b67bb None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:06.392174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64eeb49-7861-43bf-8551-e07e413b67bb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:06.392602 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64eeb49-7861-43bf-8551-e07e413b67bb None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:06.393849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 445/903] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:06.397030 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64eeb49-7861-43bf-8551-e07e413b67bb None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:06.443953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573a5ac-8c68-426a-b952-94a039afa67d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:06.459059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:06.482737 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25422e-84e0-41a9-b3ec-4c9f0317c786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:06.483357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25422e-84e0-41a9-b3ec-4c9f0317c786 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:06.483641 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25422e-84e0-41a9-b3ec-4c9f0317c786 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:06.483939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25422e-84e0-41a9-b3ec-4c9f0317c786 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:06.484632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25422e-84e0-41a9-b3ec-4c9f0317c786 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:06.486205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25422e-84e0-41a9-b3ec-4c9f0317c786 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:06.502413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 459/904] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:22:06 2022] POST /identity/v3/services => generated 241 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:22:06.503624 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7e93d-d8b6-42ae-99f0-95a2c72f4956 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:06.503949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7e93d-d8b6-42ae-99f0-95a2c72f4956 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:06.504226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7e93d-d8b6-42ae-99f0-95a2c72f4956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:06.525338 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-65e7e93d-d8b6-42ae-99f0-95a2c72f4956 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:06.526619 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-65e7e93d-d8b6-42ae-99f0-95a2c72f4956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:06.530854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64eeb49-7861-43bf-8551-e07e413b67bb None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:06.552293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:06.580003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7671b-b0db-4ce5-b864-ac6402f9492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:06.580723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7671b-b0db-4ce5-b864-ac6402f9492b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:06.581011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7671b-b0db-4ce5-b864-ac6402f9492b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:06.581286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7671b-b0db-4ce5-b864-ac6402f9492b None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:06.581993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7671b-b0db-4ce5-b864-ac6402f9492b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:06.582301 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7671b-b0db-4ce5-b864-ac6402f9492b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:06.583827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7671b-b0db-4ce5-b864-ac6402f9492b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:06.597434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 446/905] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:06.602596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7671b-b0db-4ce5-b864-ac6402f9492b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:06.623090 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 460/906] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:06.648963 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7e93d-d8b6-42ae-99f0-95a2c72f4956 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:06.743631 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7671b-b0db-4ce5-b864-ac6402f9492b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:06.781039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7e93d-d8b6-42ae-99f0-95a2c72f4956 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:06.783076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:06.790803 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41054da2-7eb4-4862-a466-88562daa951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:06.791465 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41054da2-7eb4-4862-a466-88562daa951c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:06.791746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41054da2-7eb4-4862-a466-88562daa951c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:06.792055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41054da2-7eb4-4862-a466-88562daa951c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:06.804079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41054da2-7eb4-4862-a466-88562daa951c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:06.805554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41054da2-7eb4-4862-a466-88562daa951c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-41054da2-7eb4-4862-a466-88562daa951c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:22:06.819367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:06.820408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:06.821356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:06.821356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:06.821356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:22:06.821356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:22:06.821356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:22:06.821356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:22:06.821356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:22:06.821356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:22:06.821356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 16:22:06.821356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:06.821356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 447/907] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 16:22:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:06.826101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41054da2-7eb4-4862-a466-88562daa951c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:06.831957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cdfe8-0663-4376-99f9-a67df83aa67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:06.832895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cdfe8-0663-4376-99f9-a67df83aa67c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:06.833386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cdfe8-0663-4376-99f9-a67df83aa67c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:06.833891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cdfe8-0663-4376-99f9-a67df83aa67c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:06.834737 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cdfe8-0663-4376-99f9-a67df83aa67c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:06.836900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cdfe8-0663-4376-99f9-a67df83aa67c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-855cdfe8-0663-4376-99f9-a67df83aa67c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:06.850800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:06.851840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 16:22:06.852727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:06.853501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 461/908] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:22:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:06.859496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cdfe8-0663-4376-99f9-a67df83aa67c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:06.866409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:06.959637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41054da2-7eb4-4862-a466-88562daa951c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:06.980233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cdfe8-0663-4376-99f9-a67df83aa67c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:06.996480 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9c2db-a125-45cd-94b2-203e9b61a666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:06.997026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9c2db-a125-45cd-94b2-203e9b61a666 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:06.997316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9c2db-a125-45cd-94b2-203e9b61a666 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:06.997599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9c2db-a125-45cd-94b2-203e9b61a666 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:06.998395 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9c2db-a125-45cd-94b2-203e9b61a666 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:06.998707 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9c2db-a125-45cd-94b2-203e9b61a666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:07.000171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9c2db-a125-45cd-94b2-203e9b61a666 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:07.023844 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 448/909] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 27 16:22:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:07.024786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9c2db-a125-45cd-94b2-203e9b61a666 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:07.027603 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44163a-5bd9-491a-aa93-a874cd388f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:07.029391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44163a-5bd9-491a-aa93-a874cd388f8c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:07.029906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44163a-5bd9-491a-aa93-a874cd388f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:07.030412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44163a-5bd9-491a-aa93-a874cd388f8c None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:07.031299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44163a-5bd9-491a-aa93-a874cd388f8c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:07.031823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44163a-5bd9-491a-aa93-a874cd388f8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:07.033520 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44163a-5bd9-491a-aa93-a874cd388f8c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:07.041357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 462/910] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:22:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:07.046211 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44163a-5bd9-491a-aa93-a874cd388f8c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:07.086661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:07.137477 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:07.154119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9c2db-a125-45cd-94b2-203e9b61a666 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:07.177575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44163a-5bd9-491a-aa93-a874cd388f8c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:07.192968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b844069-f6f0-4433-818d-1e5d7124d551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:07.193697 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b844069-f6f0-4433-818d-1e5d7124d551 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:07.193979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b844069-f6f0-4433-818d-1e5d7124d551 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:07.194264 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b844069-f6f0-4433-818d-1e5d7124d551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:07.214633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5633a54-1365-4df6-b4ad-c7551eb055a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:07.215600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5633a54-1365-4df6-b4ad-c7551eb055a9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:07.216134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5633a54-1365-4df6-b4ad-c7551eb055a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:07.216691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5633a54-1365-4df6-b4ad-c7551eb055a9 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:07.217629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5633a54-1365-4df6-b4ad-c7551eb055a9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:07.218136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5633a54-1365-4df6-b4ad-c7551eb055a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:07.220761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5633a54-1365-4df6-b4ad-c7551eb055a9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:07.226467 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 463/911] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 16:22:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:07.231598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5633a54-1365-4df6-b4ad-c7551eb055a9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:07.269884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b844069-f6f0-4433-818d-1e5d7124d551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:07.271256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b844069-f6f0-4433-818d-1e5d7124d551 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:07.330435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:07.338429 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5633a54-1365-4df6-b4ad-c7551eb055a9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:07.375199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:07.378607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa83f70-3488-40a6-8cb4-a8647faa5cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:07.379511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa83f70-3488-40a6-8cb4-a8647faa5cbc None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:07.380033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa83f70-3488-40a6-8cb4-a8647faa5cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:07.380703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa83f70-3488-40a6-8cb4-a8647faa5cbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:07.381626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa83f70-3488-40a6-8cb4-a8647faa5cbc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:07.383343 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa83f70-3488-40a6-8cb4-a8647faa5cbc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:07.391702 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 449/912] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:22:07 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:22:07.393107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b844069-f6f0-4433-818d-1e5d7124d551 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:07.409446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 464/913] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:22:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:22:07.507798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b844069-f6f0-4433-818d-1e5d7124d551 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:07.552708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4316494-3399-4e40-b59e-f40f09ecb061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:07.553285 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4316494-3399-4e40-b59e-f40f09ecb061 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:07.553570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4316494-3399-4e40-b59e-f40f09ecb061 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:07.553846 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4316494-3399-4e40-b59e-f40f09ecb061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:07.565293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4316494-3399-4e40-b59e-f40f09ecb061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:07.566748 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4316494-3399-4e40-b59e-f40f09ecb061 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-d4316494-3399-4e40-b59e-f40f09ecb061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:07.583514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:07.584488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:07.585391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:07.585391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:07.585391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:07.585391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:07.585391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 450/914] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:07.590607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa83f70-3488-40a6-8cb4-a8647faa5cbc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:07.696649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa83f70-3488-40a6-8cb4-a8647faa5cbc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:07.732212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b71f1-6a9a-4936-9198-1056670a0f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:07.732846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b71f1-6a9a-4936-9198-1056670a0f61 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:07.733132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b71f1-6a9a-4936-9198-1056670a0f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:07.733469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b71f1-6a9a-4936-9198-1056670a0f61 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:07.734174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b71f1-6a9a-4936-9198-1056670a0f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:07.734484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b71f1-6a9a-4936-9198-1056670a0f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:07.736693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b71f1-6a9a-4936-9198-1056670a0f61 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:07.750212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 465/915] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:07.756199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4316494-3399-4e40-b59e-f40f09ecb061 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:07.803227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:07.864286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4316494-3399-4e40-b59e-f40f09ecb061 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:07.899476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b71021-5bf0-40f3-a7db-e943f73d38d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:07.900156 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b71021-5bf0-40f3-a7db-e943f73d38d6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:07.900574 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b71021-5bf0-40f3-a7db-e943f73d38d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:07.900852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b71021-5bf0-40f3-a7db-e943f73d38d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:07.907753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b71021-5bf0-40f3-a7db-e943f73d38d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:07.909262 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b71021-5bf0-40f3-a7db-e943f73d38d6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-75b71021-5bf0-40f3-a7db-e943f73d38d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:22:07.920767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:07.921680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:07.922583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:22:07.922583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:22:07.922583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:22:07.922583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:22:07.922583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:22:07.922583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:22:07.922583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:07.922583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:07.922583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 451/916] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:22:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:07.928217 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b71f1-6a9a-4936-9198-1056670a0f61 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:07.944224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:08.037675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b71f1-6a9a-4936-9198-1056670a0f61 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:08.073748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83124a0-7124-4e70-a4eb-6771c598ee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:08.074659 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83124a0-7124-4e70-a4eb-6771c598ee1c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:08.075109 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83124a0-7124-4e70-a4eb-6771c598ee1c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:08.075542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83124a0-7124-4e70-a4eb-6771c598ee1c None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:08.076478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83124a0-7124-4e70-a4eb-6771c598ee1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:08.076954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83124a0-7124-4e70-a4eb-6771c598ee1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:08.078547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83124a0-7124-4e70-a4eb-6771c598ee1c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:08.091071 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 466/917] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:22:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:08.097706 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b71021-5bf0-40f3-a7db-e943f73d38d6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:08.198607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:08.204599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b71021-5bf0-40f3-a7db-e943f73d38d6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:08.243193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca2b08-296c-4591-8af8-29c8db203bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:08.243819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca2b08-296c-4591-8af8-29c8db203bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:08.244131 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca2b08-296c-4591-8af8-29c8db203bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:08.244413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca2b08-296c-4591-8af8-29c8db203bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:08.245202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca2b08-296c-4591-8af8-29c8db203bd3 None admin] RBAC: Adding query filter params (role.id=a6830cba40be4a629a151ed45e6a7f13, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=cf356c7ffa044fe39bb548320d2f5acb) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:08.245513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca2b08-296c-4591-8af8-29c8db203bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:08.246931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca2b08-296c-4591-8af8-29c8db203bd3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:08.253101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 452/918] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:22:08 2022] GET /identity/v3/role_assignments?user.id=cf356c7ffa044fe39bb548320d2f5acb&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=a6830cba40be4a629a151ed45e6a7f13 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:08.310871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d121-d58b-4a34-b298-95a004e6adbf None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:08.311909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d121-d58b-4a34-b298-95a004e6adbf None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:08.312416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d121-d58b-4a34-b298-95a004e6adbf None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:08.314519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 467/919] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:08.320576 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403b0bc-c7a1-45ef-be87-881ae0c92368 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:08.321570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403b0bc-c7a1-45ef-be87-881ae0c92368 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:08.322068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403b0bc-c7a1-45ef-be87-881ae0c92368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:08.342528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5403b0bc-c7a1-45ef-be87-881ae0c92368 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:08.344382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5403b0bc-c7a1-45ef-be87-881ae0c92368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:08.426119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 453/920] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:08.445924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6d121-d58b-4a34-b298-95a004e6adbf None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:08.524857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:08.558317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6d121-d58b-4a34-b298-95a004e6adbf None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:08.594142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670dd77b-864d-41dc-a36d-0c1fad09a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:08.594745 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dd77b-864d-41dc-a36d-0c1fad09a67d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:08.595032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dd77b-864d-41dc-a36d-0c1fad09a67d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:08.595312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dd77b-864d-41dc-a36d-0c1fad09a67d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:08.595973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dd77b-864d-41dc-a36d-0c1fad09a67d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:08.597352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dd77b-864d-41dc-a36d-0c1fad09a67d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-670dd77b-864d-41dc-a36d-0c1fad09a67d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:08.606636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:08.607722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:08.608708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 468/921] 10.222.0.67 () {56 vars in 1132 bytes} [Wed Jul 27 16:22:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:08.615632 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403b0bc-c7a1-45ef-be87-881ae0c92368 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:08.708722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe505f23-38f2-41dd-ba64-e5f70710b9f1 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:08.709074 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe505f23-38f2-41dd-ba64-e5f70710b9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:08.709301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe505f23-38f2-41dd-ba64-e5f70710b9f1 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:08.710947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 469/922] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:08.715665 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:08.715789 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618877-0f86-4e91-9905-a412f4687521 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:08.716111 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618877-0f86-4e91-9905-a412f4687521 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:08.716556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618877-0f86-4e91-9905-a412f4687521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:08.725561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403b0bc-c7a1-45ef-be87-881ae0c92368 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:08.737045 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-87618877-0f86-4e91-9905-a412f4687521 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:08.738266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-87618877-0f86-4e91-9905-a412f4687521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:08.769848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d56548-98d8-49e8-b992-f855ecf6cc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:08.771003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d56548-98d8-49e8-b992-f855ecf6cc59 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:08.771841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d56548-98d8-49e8-b992-f855ecf6cc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:08.772325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d56548-98d8-49e8-b992-f855ecf6cc59 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:08.773407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d56548-98d8-49e8-b992-f855ecf6cc59 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:08.774130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d56548-98d8-49e8-b992-f855ecf6cc59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:08.776541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d56548-98d8-49e8-b992-f855ecf6cc59 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:08.788441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 454/923] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 16:22:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:08.791388 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d56548-98d8-49e8-b992-f855ecf6cc59 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:08.832108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 470/924] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:08.849692 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618877-0f86-4e91-9905-a412f4687521 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:08.917511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:08.928500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d56548-98d8-49e8-b992-f855ecf6cc59 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:08.960055 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618877-0f86-4e91-9905-a412f4687521 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:08.974287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca59b-79c9-47dc-8bf4-3766db2c7e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:08.975402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca59b-79c9-47dc-8bf4-3766db2c7e96 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:08.976229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca59b-79c9-47dc-8bf4-3766db2c7e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:08.976806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca59b-79c9-47dc-8bf4-3766db2c7e96 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:08.977779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cca59b-79c9-47dc-8bf4-3766db2c7e96 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:08.978262 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cca59b-79c9-47dc-8bf4-3766db2c7e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:08.980239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cca59b-79c9-47dc-8bf4-3766db2c7e96 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:08.992107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 455/925] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 16:22:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:08.994180 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca59b-79c9-47dc-8bf4-3766db2c7e96 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:09.006149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54dcae-d4c9-45b9-9d25-bdc81c739a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:09.007115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54dcae-d4c9-45b9-9d25-bdc81c739a27 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:09.007115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54dcae-d4c9-45b9-9d25-bdc81c739a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:09.007402 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54dcae-d4c9-45b9-9d25-bdc81c739a27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:09.008054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54dcae-d4c9-45b9-9d25-bdc81c739a27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:09.009768 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54dcae-d4c9-45b9-9d25-bdc81c739a27 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-5d54dcae-d4c9-45b9-9d25-bdc81c739a27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:09.019724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:09.021038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:09.022084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:09.029003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 471/926] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 16:22:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:09.029390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:09.030115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54dcae-d4c9-45b9-9d25-bdc81c739a27 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:09.134288 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca59b-79c9-47dc-8bf4-3766db2c7e96 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:09.144645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54dcae-d4c9-45b9-9d25-bdc81c739a27 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:09.174124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:09.182570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5c138-c455-4a78-a9d8-1b7b2414d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:09.183422 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5c138-c455-4a78-a9d8-1b7b2414d859 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:09.184025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5c138-c455-4a78-a9d8-1b7b2414d859 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:09.184474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5c138-c455-4a78-a9d8-1b7b2414d859 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:09.184590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710269a-c389-46a7-b7c3-8ecfd466f564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:09.185294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710269a-c389-46a7-b7c3-8ecfd466f564 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:09.185623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5c138-c455-4a78-a9d8-1b7b2414d859 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:09.185742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710269a-c389-46a7-b7c3-8ecfd466f564 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:09.186104 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710269a-c389-46a7-b7c3-8ecfd466f564 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:09.186883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710269a-c389-46a7-b7c3-8ecfd466f564 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:09.187299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710269a-c389-46a7-b7c3-8ecfd466f564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:09.187749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5c138-c455-4a78-a9d8-1b7b2414d859 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:09.189525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710269a-c389-46a7-b7c3-8ecfd466f564 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:09.200129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 472/927] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 16:22:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:09.201103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710269a-c389-46a7-b7c3-8ecfd466f564 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:09.224120 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 456/928] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:22:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:22:09.323091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710269a-c389-46a7-b7c3-8ecfd466f564 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:09.367365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9b423-f644-4fa3-86b6-22229366bb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:09.368027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9b423-f644-4fa3-86b6-22229366bb31 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:09.368305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9b423-f644-4fa3-86b6-22229366bb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:09.368587 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9b423-f644-4fa3-86b6-22229366bb31 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:09.369267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9b423-f644-4fa3-86b6-22229366bb31 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:09.369575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9b423-f644-4fa3-86b6-22229366bb31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:09.371076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9b423-f644-4fa3-86b6-22229366bb31 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:09.377222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 473/929] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 16:22:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:09.383249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5c138-c455-4a78-a9d8-1b7b2414d859 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:09.476686 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:09.502102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5c138-c455-4a78-a9d8-1b7b2414d859 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:09.537432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40061511-4d8a-4f01-8835-18acd2d31661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:09.538064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40061511-4d8a-4f01-8835-18acd2d31661 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:09.538348 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40061511-4d8a-4f01-8835-18acd2d31661 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:09.538625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40061511-4d8a-4f01-8835-18acd2d31661 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:09.539376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40061511-4d8a-4f01-8835-18acd2d31661 None admin] RBAC: Adding query filter params (interface=public, service_id=5175777aa9424858a831c3c0795b7b1a, region_id=RegionOne) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:09.539688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40061511-4d8a-4f01-8835-18acd2d31661 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:09.541273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40061511-4d8a-4f01-8835-18acd2d31661 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:09.549471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70981b85-1556-48d2-a569-eeff9fdcd4a3 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:09.549761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70981b85-1556-48d2-a569-eeff9fdcd4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:09.550041 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70981b85-1556-48d2-a569-eeff9fdcd4a3 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:09.550919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 457/930] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 16:22:09 2022] GET /identity/v3/endpoints?service_id=5175777aa9424858a831c3c0795b7b1a&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:09.551618 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 474/931] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:22:09.556382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3272-4728-4b02-9668-e7daf43790eb None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:09.556679 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3272-4728-4b02-9668-e7daf43790eb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:09.556960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3272-4728-4b02-9668-e7daf43790eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:09.560437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70981b85-1556-48d2-a569-eeff9fdcd4a3 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:09.576437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-db7c3272-4728-4b02-9668-e7daf43790eb None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:09.577941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-db7c3272-4728-4b02-9668-e7daf43790eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:09.620359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:09.663905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 458/932] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:09.682984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c3272-4728-4b02-9668-e7daf43790eb None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:09.697186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70981b85-1556-48d2-a569-eeff9fdcd4a3 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:09.740914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbf5de-cf33-4112-8042-81bdbec2ac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:09.741560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf5de-cf33-4112-8042-81bdbec2ac2b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:09.741920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf5de-cf33-4112-8042-81bdbec2ac2b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:09.742505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbf5de-cf33-4112-8042-81bdbec2ac2b None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:09.743290 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbf5de-cf33-4112-8042-81bdbec2ac2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:09.745499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbf5de-cf33-4112-8042-81bdbec2ac2b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:09.753523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 475/933] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 16:22:09 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:22:09.779911 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:09.816113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c3272-4728-4b02-9668-e7daf43790eb None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:09.855332 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd88ab4-c551-43e1-9a61-286cf502a0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:09.856002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd88ab4-c551-43e1-9a61-286cf502a0bd None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:09.856292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd88ab4-c551-43e1-9a61-286cf502a0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:09.856571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd88ab4-c551-43e1-9a61-286cf502a0bd None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:09.857287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd88ab4-c551-43e1-9a61-286cf502a0bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:09.858739 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd88ab4-c551-43e1-9a61-286cf502a0bd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:09.862143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: WARNING keystone.server.flask.common [None req-6bd88ab4-c551-43e1-9a61-286cf502a0bd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 16:22:09.882522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.sql.core [None req-6bd88ab4-c551-43e1-9a61-286cf502a0bd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 16:22:09.882522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 16:22:09.882522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [parameters: {'id': '9ac90782f2014d89919bbe4901c70242', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 16:22:09.882522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80206) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 16:22:09.908657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-6bd88ab4-c551-43e1-9a61-286cf502a0bd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9ac90782f2014d89919bbe4901c70242.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9ac90782f2014d89919bbe4901c70242. Jul 27 16:22:09.908657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:09.908657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 16:22:09.908657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 16:22:09.908657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 16:22:09.908657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 16:22:09.908657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 16:22:09.908657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 16:22:09.908657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 16:22:09.908657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application conn.query(q) Jul 27 16:22:09.908657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 16:22:09.908657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 16:22:09.908657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application result.read() Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 16:22:09.909567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application next(self.gen) Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application yield resource Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application next(self.gen) Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise self.value Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application session.commit() Jul 27 16:22:09.910527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self.session.flush() Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application compat.raise_( Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 16:22:09.911417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 16:22:09.912352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application conn.query(q) Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application result.read() Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 16:22:09.913136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [parameters: {'id': '9ac90782f2014d89919bbe4901c70242', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:09.914088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:09.914881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:09.915820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:09.915820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 16:22:09.915820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 16:22:09.915820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:09.915820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:09.915820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 16:22:09.915820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 16:22:09.915820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9ac90782f2014d89919bbe4901c70242. Jul 27 16:22:09.915820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:09.915820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 459/934] 10.222.0.67 () {60 vars in 1140 bytes} [Wed Jul 27 16:22:09 2022] POST /identity/v3/projects => generated 262 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:09.925391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbf5de-cf33-4112-8042-81bdbec2ac2b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:10.037727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbf5de-cf33-4112-8042-81bdbec2ac2b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:10.060389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:10.074370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f81034-8d73-470a-ba33-e9c037c02533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:10.075073 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81034-8d73-470a-ba33-e9c037c02533 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:10.075360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81034-8d73-470a-ba33-e9c037c02533 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:10.075637 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81034-8d73-470a-ba33-e9c037c02533 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:10.083314 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f81034-8d73-470a-ba33-e9c037c02533 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:10.084890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f81034-8d73-470a-ba33-e9c037c02533 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-05f81034-8d73-470a-ba33-e9c037c02533 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:22:10.098171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:10.099102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:10.100053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:22:10.100053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:22:10.100053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:22:10.100053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:22:10.100053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:22:10.100053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:22:10.100053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:10.100053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:10.100053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 476/935] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:22:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:10.105648 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd88ab4-c551-43e1-9a61-286cf502a0bd None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:10.212751 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd88ab4-c551-43e1-9a61-286cf502a0bd None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:10.241013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:10.249043 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa865b-fb5c-499c-a529-8d15f3b49324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:10.249675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa865b-fb5c-499c-a529-8d15f3b49324 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:10.249962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa865b-fb5c-499c-a529-8d15f3b49324 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:10.250240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa865b-fb5c-499c-a529-8d15f3b49324 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:10.251726 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa865b-fb5c-499c-a529-8d15f3b49324 None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:10.252079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa865b-fb5c-499c-a529-8d15f3b49324 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:10.253717 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa865b-fb5c-499c-a529-8d15f3b49324 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:10.274855 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 460/936] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 16:22:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:10.334767 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0daaa5-77c4-4ae1-b37d-6174a041b5b9 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:10.335272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0daaa5-77c4-4ae1-b37d-6174a041b5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:10.335272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0daaa5-77c4-4ae1-b37d-6174a041b5b9 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:10.336906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 477/937] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:10.342573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ad191-3ce6-4360-9dfb-69705d6d7ddb None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:10.342879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ad191-3ce6-4360-9dfb-69705d6d7ddb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:10.343148 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ad191-3ce6-4360-9dfb-69705d6d7ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:10.365223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-448ad191-3ce6-4360-9dfb-69705d6d7ddb None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:10.366949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-448ad191-3ce6-4360-9dfb-69705d6d7ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:10.444864 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 461/938] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:10.471239 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0daaa5-77c4-4ae1-b37d-6174a041b5b9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:10.581591 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0daaa5-77c4-4ae1-b37d-6174a041b5b9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:10.617634 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cee7b-123f-4fbd-baf2-feec6db6e892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:10.618594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cee7b-123f-4fbd-baf2-feec6db6e892 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:10.619073 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cee7b-123f-4fbd-baf2-feec6db6e892 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:10.619531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cee7b-123f-4fbd-baf2-feec6db6e892 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:10.630959 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cee7b-123f-4fbd-baf2-feec6db6e892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-920cee7b-123f-4fbd-baf2-feec6db6e892 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:22:10.636348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:10.637340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:10.638232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:10.638232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:10.638232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:10.638232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:10.638232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:22:10.638232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:22:10.638232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:22:10.638232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:22:10.638232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:22:10.638232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:22:10.638232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 16:22:10.638232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:10.640814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 478/939] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 27 16:22:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:10.647688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ad191-3ce6-4360-9dfb-69705d6d7ddb None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:10.760845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ad191-3ce6-4360-9dfb-69705d6d7ddb None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:10.779666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:10.801339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8961439-e2e1-40de-bf7e-1f1711900c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:10.802020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8961439-e2e1-40de-bf7e-1f1711900c1d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:10.802300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8961439-e2e1-40de-bf7e-1f1711900c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:10.802569 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8961439-e2e1-40de-bf7e-1f1711900c1d None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:10.803336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8961439-e2e1-40de-bf7e-1f1711900c1d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:10.803637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8961439-e2e1-40de-bf7e-1f1711900c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:10.805133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8961439-e2e1-40de-bf7e-1f1711900c1d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:10.814183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 462/940] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 16:22:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:10.819620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cee7b-123f-4fbd-baf2-feec6db6e892 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:10.868701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:10.924924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cee7b-123f-4fbd-baf2-feec6db6e892 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:10.959951 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba3670-e899-4663-88ab-21943d772a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:10.960605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba3670-e899-4663-88ab-21943d772a72 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:10.960889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba3670-e899-4663-88ab-21943d772a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:10.961166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba3670-e899-4663-88ab-21943d772a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:10.973385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba3670-e899-4663-88ab-21943d772a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:10.974843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba3670-e899-4663-88ab-21943d772a72 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-d5ba3670-e899-4663-88ab-21943d772a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:10.989978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:10.990946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:10.991933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:10.991933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:10.991933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:10.991933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:10.991933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 479/941] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:10.997102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8961439-e2e1-40de-bf7e-1f1711900c1d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:11.114050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8961439-e2e1-40de-bf7e-1f1711900c1d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:11.148648 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff80619-2e60-4f31-9f06-014b562b5cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:11.149186 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff80619-2e60-4f31-9f06-014b562b5cae None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:11.149466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff80619-2e60-4f31-9f06-014b562b5cae None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:11.149743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff80619-2e60-4f31-9f06-014b562b5cae None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:11.150427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff80619-2e60-4f31-9f06-014b562b5cae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:11.150730 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff80619-2e60-4f31-9f06-014b562b5cae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:11.152101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff80619-2e60-4f31-9f06-014b562b5cae None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:11.165103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 463/942] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:11.170365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba3670-e899-4663-88ab-21943d772a72 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:11.276268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:11.278598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba3670-e899-4663-88ab-21943d772a72 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:11.314274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56cb6e-04ea-4ae1-8049-b10beb2c57e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:11.314921 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56cb6e-04ea-4ae1-8049-b10beb2c57e9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:11.315208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56cb6e-04ea-4ae1-8049-b10beb2c57e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:11.315489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56cb6e-04ea-4ae1-8049-b10beb2c57e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:11.323199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56cb6e-04ea-4ae1-8049-b10beb2c57e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:11.324666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56cb6e-04ea-4ae1-8049-b10beb2c57e9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-fd56cb6e-04ea-4ae1-8049-b10beb2c57e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:22:11.336804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:11.339420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:11.341742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:11.341742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:11.341742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:22:11.341742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:22:11.341742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:22:11.341742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:22:11.341742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:22:11.341742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:22:11.341742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 16:22:11.341742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:11.341742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 480/943] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 16:22:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:11.347924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff80619-2e60-4f31-9f06-014b562b5cae None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:11.394713 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:11.406247 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079466e9-8d51-4252-88a1-6ea5fa943c2d None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:11.406598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079466e9-8d51-4252-88a1-6ea5fa943c2d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:11.407012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079466e9-8d51-4252-88a1-6ea5fa943c2d None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:11.408905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 481/944] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:11.413872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa2ad6-061a-4ad6-ba7a-0cebdbdf6bb0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:11.414180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa2ad6-061a-4ad6-ba7a-0cebdbdf6bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:11.414583 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa2ad6-061a-4ad6-ba7a-0cebdbdf6bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:11.434536 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7efa2ad6-061a-4ad6-ba7a-0cebdbdf6bb0 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:11.436094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7efa2ad6-061a-4ad6-ba7a-0cebdbdf6bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:11.460191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff80619-2e60-4f31-9f06-014b562b5cae None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:11.499831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b49c28-d2d4-4c6c-a2f9-a3d9da011c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:11.500794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b49c28-d2d4-4c6c-a2f9-a3d9da011c21 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:11.501215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b49c28-d2d4-4c6c-a2f9-a3d9da011c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:11.501593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b49c28-d2d4-4c6c-a2f9-a3d9da011c21 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:11.502523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b49c28-d2d4-4c6c-a2f9-a3d9da011c21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:11.502936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b49c28-d2d4-4c6c-a2f9-a3d9da011c21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:11.504466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b49c28-d2d4-4c6c-a2f9-a3d9da011c21 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:11.512234 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 482/945] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:11.535010 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 464/946] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 27 16:22:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:11.538692 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa2ad6-061a-4ad6-ba7a-0cebdbdf6bb0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:11.542735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b49c28-d2d4-4c6c-a2f9-a3d9da011c21 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:11.628488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:11.648821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa2ad6-061a-4ad6-ba7a-0cebdbdf6bb0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:11.657676 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:11.662517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b49c28-d2d4-4c6c-a2f9-a3d9da011c21 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:11.690794 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090d526-915b-4285-9b1c-0edd9f33dc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:11.691647 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090d526-915b-4285-9b1c-0edd9f33dc80 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:11.691988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090d526-915b-4285-9b1c-0edd9f33dc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:11.692272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090d526-915b-4285-9b1c-0edd9f33dc80 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:11.692913 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090d526-915b-4285-9b1c-0edd9f33dc80 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:11.694921 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090d526-915b-4285-9b1c-0edd9f33dc80 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:11.701400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026da02-3feb-42aa-af83-95ea9ae57aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:11.702340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026da02-3feb-42aa-af83-95ea9ae57aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:11.702830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026da02-3feb-42aa-af83-95ea9ae57aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:11.703321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026da02-3feb-42aa-af83-95ea9ae57aa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-d090d526-915b-4285-9b1c-0edd9f33dc80 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:11.705462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:11.706462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:11.707328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 483/947] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:22:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:11.713788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090d526-915b-4285-9b1c-0edd9f33dc80 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:11.720421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026da02-3feb-42aa-af83-95ea9ae57aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:11.721875 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026da02-3feb-42aa-af83-95ea9ae57aa5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-a026da02-3feb-42aa-af83-95ea9ae57aa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:11.741127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:11.742064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:11.742969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:11.742969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:11.742969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:11.742969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:11.742969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 465/948] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:11.749112 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026da02-3feb-42aa-af83-95ea9ae57aa5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:11.847720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090d526-915b-4285-9b1c-0edd9f33dc80 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:11.860590 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026da02-3feb-42aa-af83-95ea9ae57aa5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:11.893674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fac45-bc24-4a67-86a4-db88dd0cba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:11.894580 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fac45-bc24-4a67-86a4-db88dd0cba3f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:11.894874 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fac45-bc24-4a67-86a4-db88dd0cba3f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:11.895154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fac45-bc24-4a67-86a4-db88dd0cba3f None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:11.895835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fac45-bc24-4a67-86a4-db88dd0cba3f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:11.896193 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fac45-bc24-4a67-86a4-db88dd0cba3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:11.897615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fac45-bc24-4a67-86a4-db88dd0cba3f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:11.899604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dc3ea-518a-4d2a-8471-d1a753314fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:11.900521 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dc3ea-518a-4d2a-8471-d1a753314fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:11.901011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dc3ea-518a-4d2a-8471-d1a753314fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:11.901504 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dc3ea-518a-4d2a-8471-d1a753314fb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:11.902412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dc3ea-518a-4d2a-8471-d1a753314fb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:11.907976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dc3ea-518a-4d2a-8471-d1a753314fb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:11.908122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 484/949] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 16:22:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:11.909119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fac45-bc24-4a67-86a4-db88dd0cba3f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:11.909928 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dc3ea-518a-4d2a-8471-d1a753314fb2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:11.928402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 466/950] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:11.928829 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:11.929494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dc3ea-518a-4d2a-8471-d1a753314fb2 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:11.944939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:12.022490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fac45-bc24-4a67-86a4-db88dd0cba3f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:12.042046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dc3ea-518a-4d2a-8471-d1a753314fb2 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:12.057884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679264d-21f3-4b6a-8cd9-65531fa7ee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:12.058511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679264d-21f3-4b6a-8cd9-65531fa7ee31 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:12.058798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679264d-21f3-4b6a-8cd9-65531fa7ee31 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:12.059077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679264d-21f3-4b6a-8cd9-65531fa7ee31 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:12.059752 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679264d-21f3-4b6a-8cd9-65531fa7ee31 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:12.060101 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679264d-21f3-4b6a-8cd9-65531fa7ee31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:12.061468 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679264d-21f3-4b6a-8cd9-65531fa7ee31 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:12.066478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 485/951] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 16:22:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:12.067763 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238fc23-16dd-4fd9-9a4a-1c8fe17495a4 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:12.068082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238fc23-16dd-4fd9-9a4a-1c8fe17495a4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:12.068366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238fc23-16dd-4fd9-9a4a-1c8fe17495a4 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:12.071896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 486/952] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:12.075327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b48fa-a3ac-4445-805c-be98385862f1 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:12.075894 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b48fa-a3ac-4445-805c-be98385862f1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:12.076382 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b48fa-a3ac-4445-805c-be98385862f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:12.089914 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e086a6-6088-474f-b8ce-087f1e889cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:12.092946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e086a6-6088-474f-b8ce-087f1e889cce None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:12.093323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e086a6-6088-474f-b8ce-087f1e889cce None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:12.093919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e086a6-6088-474f-b8ce-087f1e889cce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:12.097481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-9b7b48fa-a3ac-4445-805c-be98385862f1 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:12.099029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9b7b48fa-a3ac-4445-805c-be98385862f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:12.103635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e086a6-6088-474f-b8ce-087f1e889cce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:12.105230 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e086a6-6088-474f-b8ce-087f1e889cce None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-e2e086a6-6088-474f-b8ce-087f1e889cce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:22:12.118561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:12.119543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:12.120667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:22:12.120667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:22:12.120667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:22:12.120667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:22:12.120667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:22:12.120667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:22:12.120667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:12.120667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:12.123017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 467/953] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:22:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:12.129695 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e086a6-6088-474f-b8ce-087f1e889cce None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:12.176955 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:12.187460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 487/954] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:12.205755 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b48fa-a3ac-4445-805c-be98385862f1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:12.219715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:12.253611 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e086a6-6088-474f-b8ce-087f1e889cce None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:12.303133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af1af2-14d8-4881-a88e-c41187809818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:12.304185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1af2-14d8-4881-a88e-c41187809818 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:12.304575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1af2-14d8-4881-a88e-c41187809818 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:12.305063 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1af2-14d8-4881-a88e-c41187809818 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:12.306018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af1af2-14d8-4881-a88e-c41187809818 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:12.306566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af1af2-14d8-4881-a88e-c41187809818 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:12.308107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af1af2-14d8-4881-a88e-c41187809818 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:12.321326 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 468/955] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:22:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:12.324520 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b48fa-a3ac-4445-805c-be98385862f1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:12.327566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af1af2-14d8-4881-a88e-c41187809818 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:12.374757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef5237-1f9c-4d43-86e3-1bcd91ceebbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:12.376709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef5237-1f9c-4d43-86e3-1bcd91ceebbe None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:12.377212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef5237-1f9c-4d43-86e3-1bcd91ceebbe None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:12.377705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef5237-1f9c-4d43-86e3-1bcd91ceebbe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:12.378972 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef5237-1f9c-4d43-86e3-1bcd91ceebbe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:12.381331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef5237-1f9c-4d43-86e3-1bcd91ceebbe None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-beef5237-1f9c-4d43-86e3-1bcd91ceebbe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:12.395061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:12.396270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:12.397305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:12.398059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 488/956] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 16:22:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:12.403072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef5237-1f9c-4d43-86e3-1bcd91ceebbe None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:12.457760 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af1af2-14d8-4881-a88e-c41187809818 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:12.470981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:12.496438 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:12.504853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75ad49-debb-4429-a2f2-6d95e2c71896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:12.506121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ad49-debb-4429-a2f2-6d95e2c71896 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:12.506427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ad49-debb-4429-a2f2-6d95e2c71896 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:12.506704 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ad49-debb-4429-a2f2-6d95e2c71896 None admin] PATH_INFO: `/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/cf356c7ffa044fe39bb548320d2f5acb/roles/a6830cba40be4a629a151ed45e6a7f13` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:12.509776 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75ad49-debb-4429-a2f2-6d95e2c71896 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01ef9cd2ffc4edd94cbf0017a720a57, user_id=cf356c7ffa044fe39bb548320d2f5acb, role_id=a6830cba40be4a629a151ed45e6a7f13)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:12.512156 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75ad49-debb-4429-a2f2-6d95e2c71896 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:12.513805 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef5237-1f9c-4d43-86e3-1bcd91ceebbe None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:12.525625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 469/957] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:22:12 2022] PUT /identity/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/cf356c7ffa044fe39bb548320d2f5acb/roles/a6830cba40be4a629a151ed45e6a7f13 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:22:12.537378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae518a-05b1-4cef-9c69-e6e9c9153478 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:12.537725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae518a-05b1-4cef-9c69-e6e9c9153478 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:12.537955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae518a-05b1-4cef-9c69-e6e9c9153478 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:12.540036 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 470/958] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:12 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:12.549635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee458c-774b-41ec-a4b3-4d609b14bb7e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:12.549993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee458c-774b-41ec-a4b3-4d609b14bb7e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:12.550275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee458c-774b-41ec-a4b3-4d609b14bb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:12.562301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bf90a-fcf7-4641-afa7-ef60ed6c6183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:12.562950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bf90a-fcf7-4641-afa7-ef60ed6c6183 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:12.563456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bf90a-fcf7-4641-afa7-ef60ed6c6183 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:12.563842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bf90a-fcf7-4641-afa7-ef60ed6c6183 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:12.565592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bf90a-fcf7-4641-afa7-ef60ed6c6183 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:12.565910 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bf90a-fcf7-4641-afa7-ef60ed6c6183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:12.567354 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bf90a-fcf7-4641-afa7-ef60ed6c6183 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:12.573269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 489/959] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 16:22:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:12.579936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-12ee458c-774b-41ec-a4b3-4d609b14bb7e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:12.580921 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bf90a-fcf7-4641-afa7-ef60ed6c6183 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:12.581643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-12ee458c-774b-41ec-a4b3-4d609b14bb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:12.665049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 471/960] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:12.694348 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee458c-774b-41ec-a4b3-4d609b14bb7e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:12.711961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bf90a-fcf7-4641-afa7-ef60ed6c6183 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:12.746305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:12.759518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47374bc-0acc-4fc6-8add-7395d5b51792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:12.760189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47374bc-0acc-4fc6-8add-7395d5b51792 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:12.760478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47374bc-0acc-4fc6-8add-7395d5b51792 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:12.760762 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47374bc-0acc-4fc6-8add-7395d5b51792 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:12.761922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47374bc-0acc-4fc6-8add-7395d5b51792 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:12.762370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47374bc-0acc-4fc6-8add-7395d5b51792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:12.764083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47374bc-0acc-4fc6-8add-7395d5b51792 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:12.772609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 490/961] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 16:22:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:12.779573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47374bc-0acc-4fc6-8add-7395d5b51792 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:12.818611 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee458c-774b-41ec-a4b3-4d609b14bb7e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:12.842341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:12.859453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994f1a6-e2db-4786-941d-3a70ac405e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:12.861048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994f1a6-e2db-4786-941d-3a70ac405e33 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:12.861561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994f1a6-e2db-4786-941d-3a70ac405e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:12.862028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994f1a6-e2db-4786-941d-3a70ac405e33 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:12.862860 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994f1a6-e2db-4786-941d-3a70ac405e33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:12.864706 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994f1a6-e2db-4786-941d-3a70ac405e33 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:12.879969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.sql.core [None req-2994f1a6-e2db-4786-941d-3a70ac405e33 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 16:22:12.879969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 16:22:12.879969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [parameters: {'user_id': '02b057a61aae40d0acff7ce033ffd418', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 16:22:12.879969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80206) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-2994f1a6-e2db-4786-941d-3a70ac405e33 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application conn.query(q) Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application result.read() Jul 27 16:22:12.887172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 16:22:12.888145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application next(self.gen) Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application yield resource Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application next(self.gen) Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise self.value Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application session.commit() Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 16:22:12.889372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self.session.flush() Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application compat.raise_( Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 16:22:12.890427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 16:22:12.891939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application conn.query(q) Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application result.read() Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 16:22:12.892838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [parameters: {'user_id': '02b057a61aae40d0acff7ce033ffd418', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:12.893719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 16:22:12.894554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 16:22:12.895497 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 16:22:12.895497 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 16:22:12.895497 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 16:22:12.895497 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 16:22:12.895497 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 16:22:12.895497 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:12.895497 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 472/962] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 27 16:22:12 2022] POST /identity/v3/users => generated 160 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:12.896274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994f1a6-e2db-4786-941d-3a70ac405e33 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:12.924714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47374bc-0acc-4fc6-8add-7395d5b51792 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:12.979391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6a214-8f9a-4770-bc32-3143940ad1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:12.980588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6a214-8f9a-4770-bc32-3143940ad1a9 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:12.981024 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6a214-8f9a-4770-bc32-3143940ad1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:12.982367 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6a214-8f9a-4770-bc32-3143940ad1a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:12.983281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6a214-8f9a-4770-bc32-3143940ad1a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:12.984878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6a214-8f9a-4770-bc32-3143940ad1a9 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:13.018172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 491/963] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:22:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:22:13.022633 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994f1a6-e2db-4786-941d-3a70ac405e33 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:13.075257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09a165-a35d-4284-a2f9-fe1bea147692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:13.075951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09a165-a35d-4284-a2f9-fe1bea147692 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:13.076241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09a165-a35d-4284-a2f9-fe1bea147692 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:13.076518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09a165-a35d-4284-a2f9-fe1bea147692 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:13.090494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09a165-a35d-4284-a2f9-fe1bea147692 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:13.092127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09a165-a35d-4284-a2f9-fe1bea147692 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-6d09a165-a35d-4284-a2f9-fe1bea147692 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:22:13.108242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:13.109275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:13.110340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:13.110340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:13.110340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:22:13.110340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:22:13.110340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:22:13.110340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:22:13.110340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:22:13.110340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:22:13.110340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 16:22:13.110340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:13.111425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 473/964] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:22:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:13.116837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6a214-8f9a-4770-bc32-3143940ad1a9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:13.172323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:13.229525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6a214-8f9a-4770-bc32-3143940ad1a9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:13.268428 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52915d-1e6c-4e81-a4d7-cfa791260f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:13.269067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52915d-1e6c-4e81-a4d7-cfa791260f05 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:13.269352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52915d-1e6c-4e81-a4d7-cfa791260f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:13.269624 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52915d-1e6c-4e81-a4d7-cfa791260f05 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:13.270396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52915d-1e6c-4e81-a4d7-cfa791260f05 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:13.270702 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52915d-1e6c-4e81-a4d7-cfa791260f05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:13.272177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52915d-1e6c-4e81-a4d7-cfa791260f05 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:13.316004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 492/965] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 16:22:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:14.158172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ce056-8675-4274-a70d-f41bbbef8ffa None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:14.158699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ce056-8675-4274-a70d-f41bbbef8ffa None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:14.158699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ce056-8675-4274-a70d-f41bbbef8ffa None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:14.160236 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 474/966] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:14.165166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdb5e2-f07e-4946-9171-b058a134a14b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:14.165617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdb5e2-f07e-4946-9171-b058a134a14b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:14.165741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdb5e2-f07e-4946-9171-b058a134a14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:14.183940 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f3fdb5e2-f07e-4946-9171-b058a134a14b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:14.185131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f3fdb5e2-f07e-4946-9171-b058a134a14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:14.255787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 493/967] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:14.277788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ce056-8675-4274-a70d-f41bbbef8ffa None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:14.319075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:14.383070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ce056-8675-4274-a70d-f41bbbef8ffa None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:14.417364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef55d6-50a8-4755-a152-27006b3c2584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:14.417890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef55d6-50a8-4755-a152-27006b3c2584 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:14.418176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef55d6-50a8-4755-a152-27006b3c2584 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:14.418451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef55d6-50a8-4755-a152-27006b3c2584 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:14.419144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef55d6-50a8-4755-a152-27006b3c2584 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:14.420543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef55d6-50a8-4755-a152-27006b3c2584 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:14.436929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 475/968] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:22:14 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:22:14.657380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae49469-6a4b-4a70-90f3-a03c4a421d2e None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:14.657764 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae49469-6a4b-4a70-90f3-a03c4a421d2e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:14.658121 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae49469-6a4b-4a70-90f3-a03c4a421d2e None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:14.659714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 494/969] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:14.664747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ad24-f3c0-4c06-892e-53da16435171 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:14.665045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ad24-f3c0-4c06-892e-53da16435171 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:14.665325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ad24-f3c0-4c06-892e-53da16435171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:14.684055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-cdc2ad24-f3c0-4c06-892e-53da16435171 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:14.685513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cdc2ad24-f3c0-4c06-892e-53da16435171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:14.761855 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 476/970] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:14.785133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae49469-6a4b-4a70-90f3-a03c4a421d2e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:14.822340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:14.890182 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae49469-6a4b-4a70-90f3-a03c4a421d2e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:14.926833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ac9cf-5e9a-4cb0-9dcf-98ee49f5426c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:14.927479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ac9cf-5e9a-4cb0-9dcf-98ee49f5426c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:14.927770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ac9cf-5e9a-4cb0-9dcf-98ee49f5426c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:14.928086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ac9cf-5e9a-4cb0-9dcf-98ee49f5426c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:14.938294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ac9cf-5e9a-4cb0-9dcf-98ee49f5426c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-a05ac9cf-5e9a-4cb0-9dcf-98ee49f5426c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:22:14.943144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:14.944316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:14.945219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:14.945219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:14.945219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:14.945219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:14.945219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:22:14.945219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:22:14.945219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:22:14.945219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:22:14.945219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:22:14.945219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:22:14.945219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 16:22:14.945219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:14.948181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 495/971] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 27 16:22:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:14.950254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ad24-f3c0-4c06-892e-53da16435171 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:14.976089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:15.053082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ad24-f3c0-4c06-892e-53da16435171 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:15.087656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bbc60-c033-4abc-ad0e-a0679486678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:15.088321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bbc60-c033-4abc-ad0e-a0679486678b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.088612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bbc60-c033-4abc-ad0e-a0679486678b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.088893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bbc60-c033-4abc-ad0e-a0679486678b None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.089616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bbc60-c033-4abc-ad0e-a0679486678b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:15.089926 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bbc60-c033-4abc-ad0e-a0679486678b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:15.091293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bbc60-c033-4abc-ad0e-a0679486678b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:15.105095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 477/972] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 16:22:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:15.106553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ac9cf-5e9a-4cb0-9dcf-98ee49f5426c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:15.155291 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67fdea-97da-47e6-89a2-59e796a1c789 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.155585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67fdea-97da-47e6-89a2-59e796a1c789 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.155893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67fdea-97da-47e6-89a2-59e796a1c789 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.158230 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 478/973] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:22:15.163303 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6e486-c921-4fa1-8660-12512fe5bf35 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.163844 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6e486-c921-4fa1-8660-12512fe5bf35 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.164372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6e486-c921-4fa1-8660-12512fe5bf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.184514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2dc6e486-c921-4fa1-8660-12512fe5bf35 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:15.186067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2dc6e486-c921-4fa1-8660-12512fe5bf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:15.211002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:15.217217 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ac9cf-5e9a-4cb0-9dcf-98ee49f5426c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:15.252569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81580b32-a247-4548-b7cd-92da207396d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:15.253202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580b32-a247-4548-b7cd-92da207396d7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.253725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580b32-a247-4548-b7cd-92da207396d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.253725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580b32-a247-4548-b7cd-92da207396d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.264267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81580b32-a247-4548-b7cd-92da207396d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:15.265113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 479/974] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:15.272719 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81580b32-a247-4548-b7cd-92da207396d7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-81580b32-a247-4548-b7cd-92da207396d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:15.287908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:15.288841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:15.289757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:15.289757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:15.289757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:15.289757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:15.290077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6e486-c921-4fa1-8660-12512fe5bf35 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:15.292198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 496/975] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:15.294444 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81580b32-a247-4548-b7cd-92da207396d7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:15.306746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:15.397138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6e486-c921-4fa1-8660-12512fe5bf35 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:15.410749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81580b32-a247-4548-b7cd-92da207396d7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:15.435403 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7432993-5413-4f13-8e16-6a933f9cd320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:15.436087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7432993-5413-4f13-8e16-6a933f9cd320 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.436375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7432993-5413-4f13-8e16-6a933f9cd320 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.436652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7432993-5413-4f13-8e16-6a933f9cd320 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.437285 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7432993-5413-4f13-8e16-6a933f9cd320 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:15.439409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7432993-5413-4f13-8e16-6a933f9cd320 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:15.447196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef64705-895b-409b-a35f-e733e440f0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:15.448137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef64705-895b-409b-a35f-e733e440f0dd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.448655 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef64705-895b-409b-a35f-e733e440f0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-e7432993-5413-4f13-8e16-6a933f9cd320 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:15.448765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:15.449700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:15.450580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 480/976] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 16:22:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:15.451418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef64705-895b-409b-a35f-e733e440f0dd None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.451697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef64705-895b-409b-a35f-e733e440f0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:15.452051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef64705-895b-409b-a35f-e733e440f0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:15.453421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef64705-895b-409b-a35f-e733e440f0dd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:15.455797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7432993-5413-4f13-8e16-6a933f9cd320 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:15.467746 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 497/977] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:15.474035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef64705-895b-409b-a35f-e733e440f0dd None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:15.485393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:15.550299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:15.577240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7432993-5413-4f13-8e16-6a933f9cd320 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:15.586268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef64705-895b-409b-a35f-e733e440f0dd None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:15.618521 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc8854-d94f-48ff-886a-03e9b6260555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:15.619254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc8854-d94f-48ff-886a-03e9b6260555 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.619635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc8854-d94f-48ff-886a-03e9b6260555 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.619947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc8854-d94f-48ff-886a-03e9b6260555 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.620629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc8854-d94f-48ff-886a-03e9b6260555 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:15.621038 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc8854-d94f-48ff-886a-03e9b6260555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:15.621424 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06798c94-8222-45d9-ba39-61f6186f9751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:15.622074 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798c94-8222-45d9-ba39-61f6186f9751 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.622362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798c94-8222-45d9-ba39-61f6186f9751 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.622458 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc8854-d94f-48ff-886a-03e9b6260555 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:15.622644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798c94-8222-45d9-ba39-61f6186f9751 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.633061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 481/978] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 16:22:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:15.633227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06798c94-8222-45d9-ba39-61f6186f9751 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:15.633227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06798c94-8222-45d9-ba39-61f6186f9751 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:15.634219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc8854-d94f-48ff-886a-03e9b6260555 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-06798c94-8222-45d9-ba39-61f6186f9751 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:22:15.644498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:15.645526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:15.646852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:15.646852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:15.646852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:22:15.646852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:22:15.646852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:22:15.646852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:22:15.646852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:22:15.646852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:22:15.646852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 16:22:15.646852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:15.646852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 498/979] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 16:22:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:15.651159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06798c94-8222-45d9-ba39-61f6186f9751 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:15.723457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:15.746876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc8854-d94f-48ff-886a-03e9b6260555 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:15.759027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06798c94-8222-45d9-ba39-61f6186f9751 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:15.782649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb844e80-9c01-4c25-9191-efe0bf3df106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:15.783351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb844e80-9c01-4c25-9191-efe0bf3df106 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.783706 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb844e80-9c01-4c25-9191-efe0bf3df106 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.784076 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb844e80-9c01-4c25-9191-efe0bf3df106 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.784830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb844e80-9c01-4c25-9191-efe0bf3df106 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:15.785232 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb844e80-9c01-4c25-9191-efe0bf3df106 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:15.786665 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb844e80-9c01-4c25-9191-efe0bf3df106 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:15.796661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 482/980] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 16:22:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:15.798188 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb844e80-9c01-4c25-9191-efe0bf3df106 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:15.798757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46549e56-bcae-4f85-b97d-9b9a42a84631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:15.799384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46549e56-bcae-4f85-b97d-9b9a42a84631 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.799669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46549e56-bcae-4f85-b97d-9b9a42a84631 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.799974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46549e56-bcae-4f85-b97d-9b9a42a84631 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.800781 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46549e56-bcae-4f85-b97d-9b9a42a84631 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:15.801135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46549e56-bcae-4f85-b97d-9b9a42a84631 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:15.802531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46549e56-bcae-4f85-b97d-9b9a42a84631 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:15.812912 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:15.822300 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 499/981] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 27 16:22:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:15.827880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46549e56-bcae-4f85-b97d-9b9a42a84631 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:15.914937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb844e80-9c01-4c25-9191-efe0bf3df106 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:15.934591 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46549e56-bcae-4f85-b97d-9b9a42a84631 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:15.958295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727b64e-fc1e-4d6a-b0dc-1a881f5cf82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:15.959089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727b64e-fc1e-4d6a-b0dc-1a881f5cf82b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.959375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727b64e-fc1e-4d6a-b0dc-1a881f5cf82b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.959984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727b64e-fc1e-4d6a-b0dc-1a881f5cf82b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:15.961020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727b64e-fc1e-4d6a-b0dc-1a881f5cf82b None admin] RBAC: Adding query filter params (interface=admin, service_id=5175777aa9424858a831c3c0795b7b1a, region_id=RegionOne) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:15.961343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727b64e-fc1e-4d6a-b0dc-1a881f5cf82b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:15.962173 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:15.963086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727b64e-fc1e-4d6a-b0dc-1a881f5cf82b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:15.975268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 483/982] 10.222.0.67 () {56 vars in 1249 bytes} [Wed Jul 27 16:22:15 2022] GET /identity/v3/endpoints?service_id=5175777aa9424858a831c3c0795b7b1a&interface=admin®ion_id=RegionOne => generated 193 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:15.976656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727b64e-fc1e-4d6a-b0dc-1a881f5cf82b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:15.978034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3357d02-d687-4e8c-a6a0-d761eb77161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:15.978900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3357d02-d687-4e8c-a6a0-d761eb77161a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:15.979264 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3357d02-d687-4e8c-a6a0-d761eb77161a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:15.979621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3357d02-d687-4e8c-a6a0-d761eb77161a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:16.051249 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3357d02-d687-4e8c-a6a0-d761eb77161a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:16.052909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3357d02-d687-4e8c-a6a0-d761eb77161a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:16.063843 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:16.099183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727b64e-fc1e-4d6a-b0dc-1a881f5cf82b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:16.132893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5f234-4469-4d4c-accd-739de635f5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:16.133698 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5f234-4469-4d4c-accd-739de635f5ff None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:16.134088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5f234-4469-4d4c-accd-739de635f5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:16.134383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5f234-4469-4d4c-accd-739de635f5ff None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:16.135033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5f234-4469-4d4c-accd-739de635f5ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:16.136441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5f234-4469-4d4c-accd-739de635f5ff None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:16.143618 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 484/983] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 16:22:15 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:22:16.163851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 500/984] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:22:15 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 16:22:16.164933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5f234-4469-4d4c-accd-739de635f5ff None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:16.278324 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5f234-4469-4d4c-accd-739de635f5ff None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:16.319423 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73695d15-ba39-4066-b310-1e46557caf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:16.320178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73695d15-ba39-4066-b310-1e46557caf5c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:16.320470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73695d15-ba39-4066-b310-1e46557caf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:16.320752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73695d15-ba39-4066-b310-1e46557caf5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:16.324018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:16.333398 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73695d15-ba39-4066-b310-1e46557caf5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:16.334855 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73695d15-ba39-4066-b310-1e46557caf5c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-73695d15-ba39-4066-b310-1e46557caf5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:16.350613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:16.351534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:16.353169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:16.353169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:16.353169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:16.353169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:16.353169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 485/985] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:16.357674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3357d02-d687-4e8c-a6a0-d761eb77161a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:16.388235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:16.456884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c18e7-8b37-4d06-b026-696b3a52e39f None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:16.457173 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c18e7-8b37-4d06-b026-696b3a52e39f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:16.457451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c18e7-8b37-4d06-b026-696b3a52e39f None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:16.458816 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 486/986] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:16.464017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76e5ef-56b9-4be8-b119-cdde33ab54ea None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:16.464299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76e5ef-56b9-4be8-b119-cdde33ab54ea None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:16.464567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76e5ef-56b9-4be8-b119-cdde33ab54ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:16.465178 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3357d02-d687-4e8c-a6a0-d761eb77161a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:16.482798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2e76e5ef-56b9-4be8-b119-cdde33ab54ea None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:16.484459 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2e76e5ef-56b9-4be8-b119-cdde33ab54ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:16.502490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324bc66-bf78-4e7b-b6a9-e44ca05ca08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:16.503129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324bc66-bf78-4e7b-b6a9-e44ca05ca08c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:16.503419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324bc66-bf78-4e7b-b6a9-e44ca05ca08c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:16.503963 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324bc66-bf78-4e7b-b6a9-e44ca05ca08c None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:16.504426 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324bc66-bf78-4e7b-b6a9-e44ca05ca08c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:16.504736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324bc66-bf78-4e7b-b6a9-e44ca05ca08c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:16.506118 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324bc66-bf78-4e7b-b6a9-e44ca05ca08c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:16.522746 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 501/987] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:16.523499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324bc66-bf78-4e7b-b6a9-e44ca05ca08c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:16.560132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 487/988] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:16.578364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76e5ef-56b9-4be8-b119-cdde33ab54ea None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:16.615950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:16.634218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324bc66-bf78-4e7b-b6a9-e44ca05ca08c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:16.677660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf34f2-0ce9-4247-88df-b7d296f6b77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:16.678416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf34f2-0ce9-4247-88df-b7d296f6b77a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:16.678763 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf34f2-0ce9-4247-88df-b7d296f6b77a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:16.679112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf34f2-0ce9-4247-88df-b7d296f6b77a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:16.685848 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf34f2-0ce9-4247-88df-b7d296f6b77a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:16.685984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76e5ef-56b9-4be8-b119-cdde33ab54ea None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:16.687276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf34f2-0ce9-4247-88df-b7d296f6b77a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-cdcf34f2-0ce9-4247-88df-b7d296f6b77a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:22:16.699019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:16.700028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:16.700952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:22:16.700952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:22:16.700952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:22:16.700952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:22:16.700952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:22:16.700952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:22:16.700952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:16.700952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:16.700952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 502/989] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:22:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:16.706444 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf34f2-0ce9-4247-88df-b7d296f6b77a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:16.707972 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:16.726793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e684d0-2c4b-4b71-9ef1-94995d10a91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:16.727438 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e684d0-2c4b-4b71-9ef1-94995d10a91c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:16.727720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e684d0-2c4b-4b71-9ef1-94995d10a91c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:16.728026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e684d0-2c4b-4b71-9ef1-94995d10a91c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:16.728644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e684d0-2c4b-4b71-9ef1-94995d10a91c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:16.729998 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e684d0-2c4b-4b71-9ef1-94995d10a91c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-c3e684d0-2c4b-4b71-9ef1-94995d10a91c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:16.739849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:16.740873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:16.741719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 488/990] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:22:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:16.746889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e684d0-2c4b-4b71-9ef1-94995d10a91c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:16.813825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf34f2-0ce9-4247-88df-b7d296f6b77a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:16.848382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e684d0-2c4b-4b71-9ef1-94995d10a91c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:16.855099 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebfe69-b627-4e2c-a500-48962e9f727b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:16.856133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebfe69-b627-4e2c-a500-48962e9f727b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:16.856446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebfe69-b627-4e2c-a500-48962e9f727b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:16.856698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebfe69-b627-4e2c-a500-48962e9f727b None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:16.857791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebfe69-b627-4e2c-a500-48962e9f727b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:16.858108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebfe69-b627-4e2c-a500-48962e9f727b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:16.860690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebfe69-b627-4e2c-a500-48962e9f727b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:16.874117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 503/991] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:22:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:16.881109 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebfe69-b627-4e2c-a500-48962e9f727b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:16.884968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7d906-4e0a-4e08-b3d7-a254ccd5524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:16.885604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7d906-4e0a-4e08-b3d7-a254ccd5524f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:16.885894 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7d906-4e0a-4e08-b3d7-a254ccd5524f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:16.886182 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7d906-4e0a-4e08-b3d7-a254ccd5524f None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:16.886865 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7d906-4e0a-4e08-b3d7-a254ccd5524f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:16.887177 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7d906-4e0a-4e08-b3d7-a254ccd5524f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:16.888570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7d906-4e0a-4e08-b3d7-a254ccd5524f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:16.889735 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:16.898873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 489/992] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 16:22:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:16.900361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7d906-4e0a-4e08-b3d7-a254ccd5524f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:16.955371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:16.981675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebfe69-b627-4e2c-a500-48962e9f727b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:17.013471 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7d906-4e0a-4e08-b3d7-a254ccd5524f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:17.015260 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcce89-0656-4b63-94cd-aef949831ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:17.015899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcce89-0656-4b63-94cd-aef949831ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:17.016418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcce89-0656-4b63-94cd-aef949831ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:17.016701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcce89-0656-4b63-94cd-aef949831ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:17.017477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcce89-0656-4b63-94cd-aef949831ce0 None admin] RBAC: Adding query filter params (role.id=a6830cba40be4a629a151ed45e6a7f13, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=cf356c7ffa044fe39bb548320d2f5acb) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:17.017783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcce89-0656-4b63-94cd-aef949831ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:17.019213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcce89-0656-4b63-94cd-aef949831ce0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:17.025077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 504/993] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:22:16 2022] GET /identity/v3/role_assignments?user.id=cf356c7ffa044fe39bb548320d2f5acb&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=a6830cba40be4a629a151ed45e6a7f13 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:17.050562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e66a-be87-4c2b-b374-975479349fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:17.051475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e66a-be87-4c2b-b374-975479349fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:17.051970 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e66a-be87-4c2b-b374-975479349fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:17.052391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e66a-be87-4c2b-b374-975479349fc7 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:17.053244 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782e66a-be87-4c2b-b374-975479349fc7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:17.053723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782e66a-be87-4c2b-b374-975479349fc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:17.055269 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782e66a-be87-4c2b-b374-975479349fc7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:17.061153 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 490/994] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 16:22:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:17.068077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcce89-0656-4b63-94cd-aef949831ce0 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:17.145027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:17.183023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcce89-0656-4b63-94cd-aef949831ce0 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:17.220328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e24c12-35cd-4a6c-838c-cf7eb2dfffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:17.221527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e24c12-35cd-4a6c-838c-cf7eb2dfffe5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:17.222222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e24c12-35cd-4a6c-838c-cf7eb2dfffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:17.222500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e24c12-35cd-4a6c-838c-cf7eb2dfffe5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:17.223254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e24c12-35cd-4a6c-838c-cf7eb2dfffe5 None admin] RBAC: Adding query filter params (interface=public, service_id=87c89d1fcc784a1abe3b5bcdf4ebeb55, region_id=RegionOne) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:17.223564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e24c12-35cd-4a6c-838c-cf7eb2dfffe5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:17.224978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e24c12-35cd-4a6c-838c-cf7eb2dfffe5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:17.232897 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 505/995] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 16:22:17 2022] GET /identity/v3/endpoints?service_id=87c89d1fcc784a1abe3b5bcdf4ebeb55&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:17.238479 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e66a-be87-4c2b-b374-975479349fc7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:17.344217 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e66a-be87-4c2b-b374-975479349fc7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:17.354699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:17.380686 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e2d79-1866-4d7a-9ab0-f2295f31484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:17.381568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e2d79-1866-4d7a-9ab0-f2295f31484d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:17.382003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e2d79-1866-4d7a-9ab0-f2295f31484d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:17.382429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e2d79-1866-4d7a-9ab0-f2295f31484d None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:17.383222 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e2d79-1866-4d7a-9ab0-f2295f31484d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:17.384757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e2d79-1866-4d7a-9ab0-f2295f31484d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:17.391533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 491/996] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 16:22:17 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:22:18.164241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72040558-ee26-4a9f-b7ef-e03130462529 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:18.164816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72040558-ee26-4a9f-b7ef-e03130462529 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:18.164816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72040558-ee26-4a9f-b7ef-e03130462529 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:18.166349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 506/997] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:18.172658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56739e-9b38-4084-b14c-7ecc54d331c2 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:18.173029 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56739e-9b38-4084-b14c-7ecc54d331c2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:18.173243 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56739e-9b38-4084-b14c-7ecc54d331c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:18.191591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0c56739e-9b38-4084-b14c-7ecc54d331c2 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:18.192804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0c56739e-9b38-4084-b14c-7ecc54d331c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:18.261576 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 492/998] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:18.284182 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72040558-ee26-4a9f-b7ef-e03130462529 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:18.386679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72040558-ee26-4a9f-b7ef-e03130462529 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:18.420847 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2ffc6-96a6-4f35-80b9-cc10309b94fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:18.421406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2ffc6-96a6-4f35-80b9-cc10309b94fb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:18.421689 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2ffc6-96a6-4f35-80b9-cc10309b94fb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:18.421966 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2ffc6-96a6-4f35-80b9-cc10309b94fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:18.423346 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2ffc6-96a6-4f35-80b9-cc10309b94fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:18.424728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2ffc6-96a6-4f35-80b9-cc10309b94fb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:18.426502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-62d2ffc6-96a6-4f35-80b9-cc10309b94fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:18.435384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:18.436589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 16:22:18.437455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:18.440207 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 507/999] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 16:22:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:18.442853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56739e-9b38-4084-b14c-7ecc54d331c2 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:18.545204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56739e-9b38-4084-b14c-7ecc54d331c2 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:18.548269 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:18.580994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2e0ef-9ba0-420a-a624-487df7fd48b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:18.581770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2e0ef-9ba0-420a-a624-487df7fd48b7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:18.582154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2e0ef-9ba0-420a-a624-487df7fd48b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:18.582527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2e0ef-9ba0-420a-a624-487df7fd48b7 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:18.583321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2e0ef-9ba0-420a-a624-487df7fd48b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:18.583728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2e0ef-9ba0-420a-a624-487df7fd48b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:18.585208 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2e0ef-9ba0-420a-a624-487df7fd48b7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:18.596115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 493/1000] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 16:22:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:18.597576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2ffc6-96a6-4f35-80b9-cc10309b94fb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:18.708802 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2ffc6-96a6-4f35-80b9-cc10309b94fb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:18.742812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5d13c-ed57-4d96-9e66-eb7f069f6a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:18.743431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5d13c-ed57-4d96-9e66-eb7f069f6a14 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:18.743717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5d13c-ed57-4d96-9e66-eb7f069f6a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:18.744035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5d13c-ed57-4d96-9e66-eb7f069f6a14 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:18.744710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5d13c-ed57-4d96-9e66-eb7f069f6a14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:18.745017 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5d13c-ed57-4d96-9e66-eb7f069f6a14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:18.746378 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5d13c-ed57-4d96-9e66-eb7f069f6a14 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:18.756412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 508/1001] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 16:22:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:18.758153 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2e0ef-9ba0-420a-a624-487df7fd48b7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:18.860677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2e0ef-9ba0-420a-a624-487df7fd48b7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:18.894249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc2d6d-a6f1-403f-b612-4a996dd9b7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:18.894862 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc2d6d-a6f1-403f-b612-4a996dd9b7a0 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:18.895142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc2d6d-a6f1-403f-b612-4a996dd9b7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:18.895414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc2d6d-a6f1-403f-b612-4a996dd9b7a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:18.896142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc2d6d-a6f1-403f-b612-4a996dd9b7a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:18.897493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc2d6d-a6f1-403f-b612-4a996dd9b7a0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:18.913307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 494/1002] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:22:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:22:19.079706 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c5357-795e-463c-9dc8-5892ec82a421 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:19.080035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c5357-795e-463c-9dc8-5892ec82a421 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:19.080317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c5357-795e-463c-9dc8-5892ec82a421 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:19.081675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 509/1003] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:19.087196 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cef06-fbd5-4f1b-9863-c0ee1de9af27 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:19.087492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cef06-fbd5-4f1b-9863-c0ee1de9af27 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:19.087775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cef06-fbd5-4f1b-9863-c0ee1de9af27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:19.107324 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b01cef06-fbd5-4f1b-9863-c0ee1de9af27 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:19.108565 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b01cef06-fbd5-4f1b-9863-c0ee1de9af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:19.132864 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:19.186303 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 495/1004] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:19.209011 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c5357-795e-463c-9dc8-5892ec82a421 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:19.273037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:19.314862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c5357-795e-463c-9dc8-5892ec82a421 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:19.349582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bc3c5-5136-41a1-a436-7b99a45b52d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:19.350153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bc3c5-5136-41a1-a436-7b99a45b52d7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:19.350441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bc3c5-5136-41a1-a436-7b99a45b52d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:19.350723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bc3c5-5136-41a1-a436-7b99a45b52d7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:19.351352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1bc3c5-5136-41a1-a436-7b99a45b52d7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:19.352754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1bc3c5-5136-41a1-a436-7b99a45b52d7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-cb1bc3c5-5136-41a1-a436-7b99a45b52d7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:19.361736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:19.362750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:22:19.363614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:19.371147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 510/1005] 10.222.0.67 () {56 vars in 1105 bytes} [Wed Jul 27 16:22:19 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:19.371293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cef06-fbd5-4f1b-9863-c0ee1de9af27 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:19.420814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364476b9-1233-47fd-8565-8bfffadf83f9 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:19.421100 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364476b9-1233-47fd-8565-8bfffadf83f9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:19.421384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364476b9-1233-47fd-8565-8bfffadf83f9 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:19.423076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 511/1006] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:19.427823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158fc23-b477-44bf-94db-6aace1830e1e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:19.428149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158fc23-b477-44bf-94db-6aace1830e1e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:19.428432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158fc23-b477-44bf-94db-6aace1830e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:19.448576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2158fc23-b477-44bf-94db-6aace1830e1e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:19.449779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2158fc23-b477-44bf-94db-6aace1830e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:19.486406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cef06-fbd5-4f1b-9863-c0ee1de9af27 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:19.520062 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 512/1007] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:19.530372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d32ae0-23fe-4c97-91ec-12ad7e5b6c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:19.531000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d32ae0-23fe-4c97-91ec-12ad7e5b6c5a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:19.531288 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d32ae0-23fe-4c97-91ec-12ad7e5b6c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:19.531599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d32ae0-23fe-4c97-91ec-12ad7e5b6c5a None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:19.532424 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d32ae0-23fe-4c97-91ec-12ad7e5b6c5a None admin] RBAC: Adding query filter params (name=image) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:19.532739 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d32ae0-23fe-4c97-91ec-12ad7e5b6c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:19.534104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d32ae0-23fe-4c97-91ec-12ad7e5b6c5a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:19.539234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 496/1008] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:19.542273 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158fc23-b477-44bf-94db-6aace1830e1e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:19.544487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d32ae0-23fe-4c97-91ec-12ad7e5b6c5a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:19.565867 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:19.606040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:19.657255 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d32ae0-23fe-4c97-91ec-12ad7e5b6c5a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:19.665270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158fc23-b477-44bf-94db-6aace1830e1e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:19.696404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d8295-0a9c-42cb-98d2-844274861e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:19.697054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8295-0a9c-42cb-98d2-844274861e93 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:19.697311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8295-0a9c-42cb-98d2-844274861e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:19.697589 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8295-0a9c-42cb-98d2-844274861e93 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:19.698322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d8295-0a9c-42cb-98d2-844274861e93 None admin] RBAC: Adding query filter params (type=image) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:19.698571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d8295-0a9c-42cb-98d2-844274861e93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:19.699962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d8295-0a9c-42cb-98d2-844274861e93 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:19.703308 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98383afe-8a79-4170-83d1-1a8f20ec7b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:19.704084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98383afe-8a79-4170-83d1-1a8f20ec7b49 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:19.704704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98383afe-8a79-4170-83d1-1a8f20ec7b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:19.704830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 497/1009] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:19.704956 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98383afe-8a79-4170-83d1-1a8f20ec7b49 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:19.705740 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98383afe-8a79-4170-83d1-1a8f20ec7b49 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:19.707193 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98383afe-8a79-4170-83d1-1a8f20ec7b49 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-98383afe-8a79-4170-83d1-1a8f20ec7b49 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:19.717168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:19.718262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:19.725421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 513/1010] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:22:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:19.726247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d8295-0a9c-42cb-98d2-844274861e93 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:19.818169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:19.838641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d8295-0a9c-42cb-98d2-844274861e93 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:19.879530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99eb8e4-4fa7-44d5-ae33-74bc12d76d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:19.880101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eb8e4-4fa7-44d5-ae33-74bc12d76d2a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:19.880383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eb8e4-4fa7-44d5-ae33-74bc12d76d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:19.880655 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eb8e4-4fa7-44d5-ae33-74bc12d76d2a None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:19.881326 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99eb8e4-4fa7-44d5-ae33-74bc12d76d2a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:19.881630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99eb8e4-4fa7-44d5-ae33-74bc12d76d2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:19.883002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99eb8e4-4fa7-44d5-ae33-74bc12d76d2a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:19.888211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 498/1011] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 16:22:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:19.894466 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98383afe-8a79-4170-83d1-1a8f20ec7b49 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:19.995229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98383afe-8a79-4170-83d1-1a8f20ec7b49 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:20.016418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:20.032111 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb560d-bfc1-46f7-a9aa-6ed473d98862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:20.032739 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb560d-bfc1-46f7-a9aa-6ed473d98862 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:20.033023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb560d-bfc1-46f7-a9aa-6ed473d98862 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:20.033299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb560d-bfc1-46f7-a9aa-6ed473d98862 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:20.033987 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb560d-bfc1-46f7-a9aa-6ed473d98862 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:20.034293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb560d-bfc1-46f7-a9aa-6ed473d98862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:20.035698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb560d-bfc1-46f7-a9aa-6ed473d98862 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:20.041389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 514/1012] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 16:22:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:20.047727 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99eb8e4-4fa7-44d5-ae33-74bc12d76d2a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:20.152963 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99eb8e4-4fa7-44d5-ae33-74bc12d76d2a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:20.186639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ee94e-ac43-48f8-84aa-88d1b93f8cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:20.187272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ee94e-ac43-48f8-84aa-88d1b93f8cd9 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:20.187556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ee94e-ac43-48f8-84aa-88d1b93f8cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:20.188400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ee94e-ac43-48f8-84aa-88d1b93f8cd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:20.189222 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ee94e-ac43-48f8-84aa-88d1b93f8cd9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:20.190579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ee94e-ac43-48f8-84aa-88d1b93f8cd9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:20.215899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 499/1013] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:22:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:22:20.941861 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99824730-ea7b-4449-901a-6bbea1c32adf None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:20.942385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99824730-ea7b-4449-901a-6bbea1c32adf None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:20.942385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99824730-ea7b-4449-901a-6bbea1c32adf None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:20.943840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 515/1014] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:20.948825 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d72fd-b443-431d-bf18-62b0bcae77b4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:20.949204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d72fd-b443-431d-bf18-62b0bcae77b4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:20.949382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d72fd-b443-431d-bf18-62b0bcae77b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:20.955781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:20.970316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ce7d72fd-b443-431d-bf18-62b0bcae77b4 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:20.971501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ce7d72fd-b443-431d-bf18-62b0bcae77b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:21.044109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 500/1015] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:20 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:21.066666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99824730-ea7b-4449-901a-6bbea1c32adf None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:21.170382 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99824730-ea7b-4449-901a-6bbea1c32adf None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:21.204865 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19601b9-f82c-4396-b09d-36bb29913f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:21.205427 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19601b9-f82c-4396-b09d-36bb29913f31 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:21.205708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19601b9-f82c-4396-b09d-36bb29913f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:21.205983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19601b9-f82c-4396-b09d-36bb29913f31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:21.207119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19601b9-f82c-4396-b09d-36bb29913f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:21.208566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19601b9-f82c-4396-b09d-36bb29913f31 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:21.210304 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 516/1016] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:21.215970 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d72fd-b443-431d-bf18-62b0bcae77b4 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:21.316316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d72fd-b443-431d-bf18-62b0bcae77b4 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:21.342170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:21.351101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efbe3f-04c3-4250-97e2-cd093c9f37d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:21.351726 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efbe3f-04c3-4250-97e2-cd093c9f37d7 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:21.352040 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efbe3f-04c3-4250-97e2-cd093c9f37d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:21.352318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efbe3f-04c3-4250-97e2-cd093c9f37d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:21.353009 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efbe3f-04c3-4250-97e2-cd093c9f37d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:21.354428 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efbe3f-04c3-4250-97e2-cd093c9f37d7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:21.387890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 501/1017] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:22:21 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:22:21.737526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d5c4-3a1b-47a4-aa04-20c5401e8716 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:21.737871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d5c4-3a1b-47a4-aa04-20c5401e8716 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:21.738098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04d5c4-3a1b-47a4-aa04-20c5401e8716 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:21.739596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 517/1018] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:21.744643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8aeb-aa8e-4a96-8044-c622a4b16745 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:21.744947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8aeb-aa8e-4a96-8044-c622a4b16745 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:21.745232 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8aeb-aa8e-4a96-8044-c622a4b16745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:21.763911 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d4de8aeb-aa8e-4a96-8044-c622a4b16745 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:21.765109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d4de8aeb-aa8e-4a96-8044-c622a4b16745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:21.835902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 502/1019] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:21 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:21.858373 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04d5c4-3a1b-47a4-aa04-20c5401e8716 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:21.916741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:21.966913 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04d5c4-3a1b-47a4-aa04-20c5401e8716 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:22.001291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb347cf0-5eef-425f-a0f7-48703fccaa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:22.001914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347cf0-5eef-425f-a0f7-48703fccaa5d None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:22.002201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347cf0-5eef-425f-a0f7-48703fccaa5d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:22.002478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347cf0-5eef-425f-a0f7-48703fccaa5d None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:22.003177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb347cf0-5eef-425f-a0f7-48703fccaa5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:22.004574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb347cf0-5eef-425f-a0f7-48703fccaa5d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:22.023893 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 518/1020] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:22:21 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:22:22.327457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f994e-0af8-4d2e-9ef0-ac282fe089f4 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:22.328007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f994e-0af8-4d2e-9ef0-ac282fe089f4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:22.328118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f994e-0af8-4d2e-9ef0-ac282fe089f4 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:22.329882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 503/1021] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:22.334798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e54f80-6bf3-4bbb-b4f1-8950a61d13f1 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:22.335088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e54f80-6bf3-4bbb-b4f1-8950a61d13f1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:22.335366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e54f80-6bf3-4bbb-b4f1-8950a61d13f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:22.353999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-74e54f80-6bf3-4bbb-b4f1-8950a61d13f1 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:22.355166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-74e54f80-6bf3-4bbb-b4f1-8950a61d13f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:22.430143 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 519/1022] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:22.452607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f994e-0af8-4d2e-9ef0-ac282fe089f4 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:22.560441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f994e-0af8-4d2e-9ef0-ac282fe089f4 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:22.572061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:22.598135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a239f-e383-40e3-a5fc-a7b031d774ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:22.598993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a239f-e383-40e3-a5fc-a7b031d774ec None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:22.599422 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a239f-e383-40e3-a5fc-a7b031d774ec None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:22.599841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a239f-e383-40e3-a5fc-a7b031d774ec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:22.610943 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a239f-e383-40e3-a5fc-a7b031d774ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-4a6a239f-e383-40e3-a5fc-a7b031d774ec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:22:22.616215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:22.617305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:22.618364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:22.618364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:22.618364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:22.618364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:22.618364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:22:22.618364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:22:22.618364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:22:22.618364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:22:22.618364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:22:22.618364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:22:22.618364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 16:22:22.618364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:22.620435 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 504/1023] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 27 16:22:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:22.627176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e54f80-6bf3-4bbb-b4f1-8950a61d13f1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:22.669238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:22.733648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e54f80-6bf3-4bbb-b4f1-8950a61d13f1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:22.769534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c72207-af6f-4970-95ff-434e12119abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:22.770152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c72207-af6f-4970-95ff-434e12119abf None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:22.770434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c72207-af6f-4970-95ff-434e12119abf None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:22.770709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c72207-af6f-4970-95ff-434e12119abf None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:22.771417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c72207-af6f-4970-95ff-434e12119abf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:22.771718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c72207-af6f-4970-95ff-434e12119abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:22.773109 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c72207-af6f-4970-95ff-434e12119abf None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:22.785710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 520/1024] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 16:22:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:22.786986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a239f-e383-40e3-a5fc-a7b031d774ec None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:22.891389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a239f-e383-40e3-a5fc-a7b031d774ec None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:22.925527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb6fb4-d1cf-4204-be3a-5481397e3638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:22.926169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb6fb4-d1cf-4204-be3a-5481397e3638 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:22.926454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb6fb4-d1cf-4204-be3a-5481397e3638 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:22.926732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb6fb4-d1cf-4204-be3a-5481397e3638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:22.936793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb6fb4-d1cf-4204-be3a-5481397e3638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:22.938755 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb6fb4-d1cf-4204-be3a-5481397e3638 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-23fb6fb4-d1cf-4204-be3a-5481397e3638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:22.953898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:22.954988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:22.956399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:22.956399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:22.956399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:22.956399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:22.957023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 505/1025] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:22.960927 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c72207-af6f-4970-95ff-434e12119abf None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:23.061721 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:23.066774 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c72207-af6f-4970-95ff-434e12119abf None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:23.102965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ecbbc-6d2e-4d11-b97e-624b98c5e1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:23.103498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ecbbc-6d2e-4d11-b97e-624b98c5e1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:23.103796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ecbbc-6d2e-4d11-b97e-624b98c5e1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:23.104443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ecbbc-6d2e-4d11-b97e-624b98c5e1d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:23.105219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ecbbc-6d2e-4d11-b97e-624b98c5e1d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:23.105532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ecbbc-6d2e-4d11-b97e-624b98c5e1d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:23.106899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ecbbc-6d2e-4d11-b97e-624b98c5e1d7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:23.123901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 521/1026] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:23.125235 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb6fb4-d1cf-4204-be3a-5481397e3638 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:23.153404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:23.232672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb6fb4-d1cf-4204-be3a-5481397e3638 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:23.266920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc7603-4d2d-4194-bfc4-e2d9c050e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:23.267561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc7603-4d2d-4194-bfc4-e2d9c050e7ca None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:23.267848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc7603-4d2d-4194-bfc4-e2d9c050e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:23.268149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc7603-4d2d-4194-bfc4-e2d9c050e7ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:23.275532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc7603-4d2d-4194-bfc4-e2d9c050e7ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:23.277001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc7603-4d2d-4194-bfc4-e2d9c050e7ca None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-c1cc7603-4d2d-4194-bfc4-e2d9c050e7ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:22:23.289058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:23.290075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:23.291025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:23.291025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:23.291025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:22:23.291025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:22:23.291025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:22:23.291025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:22:23.291025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:22:23.291025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:22:23.291025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:22:23.291025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:23.291025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 506/1027] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 16:22:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:23.297830 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ecbbc-6d2e-4d11-b97e-624b98c5e1d7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:23.399867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ecbbc-6d2e-4d11-b97e-624b98c5e1d7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:23.434329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a09609-95ff-4041-98e9-a802d68a0681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:23.434879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a09609-95ff-4041-98e9-a802d68a0681 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:23.435168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a09609-95ff-4041-98e9-a802d68a0681 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:23.435446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a09609-95ff-4041-98e9-a802d68a0681 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:23.436263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a09609-95ff-4041-98e9-a802d68a0681 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:23.436575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a09609-95ff-4041-98e9-a802d68a0681 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:23.438046 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a09609-95ff-4041-98e9-a802d68a0681 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:23.441792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec5bca-3ac5-41a4-832a-4c680d433bf1 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:23.442245 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec5bca-3ac5-41a4-832a-4c680d433bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:23.442341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec5bca-3ac5-41a4-832a-4c680d433bf1 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:23.443814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 507/1028] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:22:23.448385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe991e35-3aa5-4714-a3cf-504e438394b9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:23.448673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe991e35-3aa5-4714-a3cf-504e438394b9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:23.448948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe991e35-3aa5-4714-a3cf-504e438394b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:23.461529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 522/1029] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 16:22:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:23.462517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a09609-95ff-4041-98e9-a802d68a0681 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:23.473302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-fe991e35-3aa5-4714-a3cf-504e438394b9 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:23.474583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fe991e35-3aa5-4714-a3cf-504e438394b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:23.482400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:23.547582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 508/1030] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:23.571732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a09609-95ff-4041-98e9-a802d68a0681 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:23.571956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe991e35-3aa5-4714-a3cf-504e438394b9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:23.585965 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:23.612020 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5eaa4-9653-418c-88a3-fb2bf44e0b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:23.613054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5eaa4-9653-418c-88a3-fb2bf44e0b67 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:23.613409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5eaa4-9653-418c-88a3-fb2bf44e0b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:23.613688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5eaa4-9653-418c-88a3-fb2bf44e0b67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:23.685506 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe991e35-3aa5-4714-a3cf-504e438394b9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:23.690611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5eaa4-9653-418c-88a3-fb2bf44e0b67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:23.692117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5eaa4-9653-418c-88a3-fb2bf44e0b67 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:23.711366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:23.723383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95c4e9-930e-4516-ac32-5c9a9767b58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:23.724150 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95c4e9-930e-4516-ac32-5c9a9767b58a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:23.724340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95c4e9-930e-4516-ac32-5c9a9767b58a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:23.724616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95c4e9-930e-4516-ac32-5c9a9767b58a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:23.725773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95c4e9-930e-4516-ac32-5c9a9767b58a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:23.727190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95c4e9-930e-4516-ac32-5c9a9767b58a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:23.733943 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 509/1031] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:23.734718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95c4e9-930e-4516-ac32-5c9a9767b58a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:23.799910 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 523/1032] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:22:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 16:22:23.804733 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5eaa4-9653-418c-88a3-fb2bf44e0b67 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:23.824046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:23.846274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95c4e9-930e-4516-ac32-5c9a9767b58a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:23.882745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccd4c0-efae-4fb4-ad67-1d06218c250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:23.883398 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccd4c0-efae-4fb4-ad67-1d06218c250e None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:23.883686 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccd4c0-efae-4fb4-ad67-1d06218c250e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:23.884003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccd4c0-efae-4fb4-ad67-1d06218c250e None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:23.884682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccd4c0-efae-4fb4-ad67-1d06218c250e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:23.886115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccd4c0-efae-4fb4-ad67-1d06218c250e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:23.910632 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 510/1033] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:22:23 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:22:23.924112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5eaa4-9653-418c-88a3-fb2bf44e0b67 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:23.946184 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:23.966238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad1fb2-10b2-4136-8a16-0b28487e6d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:23.966919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad1fb2-10b2-4136-8a16-0b28487e6d9f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:23.967199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad1fb2-10b2-4136-8a16-0b28487e6d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:23.967471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad1fb2-10b2-4136-8a16-0b28487e6d9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:23.980495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad1fb2-10b2-4136-8a16-0b28487e6d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:23.981984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad1fb2-10b2-4136-8a16-0b28487e6d9f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-90ad1fb2-10b2-4136-8a16-0b28487e6d9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:23.998469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:23.999469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:24.001365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:24.001365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:24.001365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:24.001365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:24.004218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 524/1034] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:24.006164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccd4c0-efae-4fb4-ad67-1d06218c250e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:24.045751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4f8fe-ef23-42e6-80fb-a78e35009f92 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.046085 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4f8fe-ef23-42e6-80fb-a78e35009f92 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.046307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4f8fe-ef23-42e6-80fb-a78e35009f92 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.048673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 525/1035] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:22:24.053930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066a602-1326-4019-8e72-cb98b5294ae1 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.054229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066a602-1326-4019-8e72-cb98b5294ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.054511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066a602-1326-4019-8e72-cb98b5294ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.076223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3066a602-1326-4019-8e72-cb98b5294ae1 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:24.077419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3066a602-1326-4019-8e72-cb98b5294ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:24.134185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccd4c0-efae-4fb4-ad67-1d06218c250e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:24.159423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 526/1036] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:24.170732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ac6d0-dd72-4a4d-a758-19e8e07d7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:24.171596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ac6d0-dd72-4a4d-a758-19e8e07d7d53 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.172847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ac6d0-dd72-4a4d-a758-19e8e07d7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.173335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ac6d0-dd72-4a4d-a758-19e8e07d7d53 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.174221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ac6d0-dd72-4a4d-a758-19e8e07d7d53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:24.174724 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ac6d0-dd72-4a4d-a758-19e8e07d7d53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:24.176336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ac6d0-dd72-4a4d-a758-19e8e07d7d53 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:24.179684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:24.182430 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066a602-1326-4019-8e72-cb98b5294ae1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:24.197439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 511/1037] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:24.198517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ac6d0-dd72-4a4d-a758-19e8e07d7d53 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:24.293635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:24.298239 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066a602-1326-4019-8e72-cb98b5294ae1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:24.305897 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ac6d0-dd72-4a4d-a758-19e8e07d7d53 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:24.336635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9f277-a4cb-4c73-8692-0f45a28daa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:24.337290 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9f277-a4cb-4c73-8692-0f45a28daa9b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.337579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9f277-a4cb-4c73-8692-0f45a28daa9b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.337862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9f277-a4cb-4c73-8692-0f45a28daa9b None admin] PATH_INFO: `/v3/services/image` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.338490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9f277-a4cb-4c73-8692-0f45a28daa9b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:24.339914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9f277-a4cb-4c73-8692-0f45a28daa9b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:24.342743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee7a95-2a3b-4c54-8af2-69f5e23e5829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:24.343379 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee7a95-2a3b-4c54-8af2-69f5e23e5829 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.343995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee7a95-2a3b-4c54-8af2-69f5e23e5829 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.344272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee7a95-2a3b-4c54-8af2-69f5e23e5829 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-42f9f277-a4cb-4c73-8692-0f45a28daa9b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:24.349433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:24.350421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:24.351271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 527/1038] 10.222.0.67 () {56 vars in 1105 bytes} [Wed Jul 27 16:22:24 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:24.353803 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee7a95-2a3b-4c54-8af2-69f5e23e5829 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:24.355429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee7a95-2a3b-4c54-8af2-69f5e23e5829 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:24.356305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9f277-a4cb-4c73-8692-0f45a28daa9b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-40ee7a95-2a3b-4c54-8af2-69f5e23e5829 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:22:24.368596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:24.369587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:24.370500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:22:24.370500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:22:24.370500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:22:24.370500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:22:24.370500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:22:24.370500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:22:24.370500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:24.370500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:24.370500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 512/1039] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:22:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:24.375973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee7a95-2a3b-4c54-8af2-69f5e23e5829 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:24.436152 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:24.464936 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9f277-a4cb-4c73-8692-0f45a28daa9b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:24.480550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee7a95-2a3b-4c54-8af2-69f5e23e5829 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:24.501752 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0551ef-1922-41fb-b9be-3f6816630dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:24.502540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0551ef-1922-41fb-b9be-3f6816630dcd None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.502833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0551ef-1922-41fb-b9be-3f6816630dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.503112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0551ef-1922-41fb-b9be-3f6816630dcd None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.503792 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0551ef-1922-41fb-b9be-3f6816630dcd None admin] RBAC: Adding query filter params (name=image) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:24.504133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0551ef-1922-41fb-b9be-3f6816630dcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:24.505508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0551ef-1922-41fb-b9be-3f6816630dcd None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:24.510542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 528/1040] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:24.515427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90255c-930c-4eb3-9490-b7a2216baa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:24.516236 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0551ef-1922-41fb-b9be-3f6816630dcd None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:24.516551 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90255c-930c-4eb3-9490-b7a2216baa46 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.516994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90255c-930c-4eb3-9490-b7a2216baa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.517425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90255c-930c-4eb3-9490-b7a2216baa46 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.518313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90255c-930c-4eb3-9490-b7a2216baa46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:24.518887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90255c-930c-4eb3-9490-b7a2216baa46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:24.520597 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90255c-930c-4eb3-9490-b7a2216baa46 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:24.534125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 513/1041] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:22:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:24.539954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90255c-930c-4eb3-9490-b7a2216baa46 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:24.547983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:24.625005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0551ef-1922-41fb-b9be-3f6816630dcd None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:24.645223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90255c-930c-4eb3-9490-b7a2216baa46 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:24.665418 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:24.671405 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b85c26-5d7c-45f7-84bd-b7b129371340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:24.672978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85c26-5d7c-45f7-84bd-b7b129371340 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.673450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85c26-5d7c-45f7-84bd-b7b129371340 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.673876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85c26-5d7c-45f7-84bd-b7b129371340 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.674698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b85c26-5d7c-45f7-84bd-b7b129371340 None admin] RBAC: Adding query filter params (type=image) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:24.675175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b85c26-5d7c-45f7-84bd-b7b129371340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:24.676728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b85c26-5d7c-45f7-84bd-b7b129371340 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:24.682121 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 529/1042] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:24.685494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed3c67-c9e4-4795-aacb-14a7d4177f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:24.686116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed3c67-c9e4-4795-aacb-14a7d4177f0e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.686404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed3c67-c9e4-4795-aacb-14a7d4177f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.686918 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed3c67-c9e4-4795-aacb-14a7d4177f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.687674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed3c67-c9e4-4795-aacb-14a7d4177f0e None admin] RBAC: Adding query filter params (role.id=a6830cba40be4a629a151ed45e6a7f13, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=9d5a8ef373ca4ed7bf31361e24e42e54) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:24.688015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed3c67-c9e4-4795-aacb-14a7d4177f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:24.688266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b85c26-5d7c-45f7-84bd-b7b129371340 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:24.689432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed3c67-c9e4-4795-aacb-14a7d4177f0e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:24.695667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 514/1043] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:22:24 2022] GET /identity/v3/role_assignments?user.id=9d5a8ef373ca4ed7bf31361e24e42e54&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=a6830cba40be4a629a151ed45e6a7f13 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:24.793610 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:24.803511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b85c26-5d7c-45f7-84bd-b7b129371340 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:24.839292 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634f2b4-b520-4a53-9960-d696a4e1e099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:24.839946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634f2b4-b520-4a53-9960-d696a4e1e099 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.840240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634f2b4-b520-4a53-9960-d696a4e1e099 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.840514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634f2b4-b520-4a53-9960-d696a4e1e099 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.841275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634f2b4-b520-4a53-9960-d696a4e1e099 None admin] RBAC: Adding query filter params (interface=public, service_id=2593c6b0f6a84e52b11a602291c0f2c2, region_id=RegionOne) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:24.841587 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634f2b4-b520-4a53-9960-d696a4e1e099 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:24.842963 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634f2b4-b520-4a53-9960-d696a4e1e099 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:24.850450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 530/1044] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 16:22:24 2022] GET /identity/v3/endpoints?service_id=2593c6b0f6a84e52b11a602291c0f2c2&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:24.855988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed3c67-c9e4-4795-aacb-14a7d4177f0e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:24.957658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed3c67-c9e4-4795-aacb-14a7d4177f0e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:24.991069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d542dd7-0fdd-46a5-bf4c-2d911fb06684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:24.991688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d542dd7-0fdd-46a5-bf4c-2d911fb06684 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:24.991996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d542dd7-0fdd-46a5-bf4c-2d911fb06684 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:24.992269 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d542dd7-0fdd-46a5-bf4c-2d911fb06684 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:24.992915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d542dd7-0fdd-46a5-bf4c-2d911fb06684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:24.994277 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d542dd7-0fdd-46a5-bf4c-2d911fb06684 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:25.001804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 515/1045] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 16:22:24 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:22:25.985087 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b14601-061f-46c3-a310-54e98b394074 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:25.985618 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b14601-061f-46c3-a310-54e98b394074 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:25.985714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b14601-061f-46c3-a310-54e98b394074 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:25.987145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 531/1046] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:25.992105 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e5465-b366-41bb-9ae5-da963bc24666 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:25.992499 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e5465-b366-41bb-9ae5-da963bc24666 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:25.992683 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e5465-b366-41bb-9ae5-da963bc24666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:26.011077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-092e5465-b366-41bb-9ae5-da963bc24666 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:26.012287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-092e5465-b366-41bb-9ae5-da963bc24666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:26.052903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:26.084006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 516/1047] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:26.104989 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b14601-061f-46c3-a310-54e98b394074 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:26.210648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b14601-061f-46c3-a310-54e98b394074 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:26.244018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b667ba-3107-45a5-b2d8-e6792219f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:26.244585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b667ba-3107-45a5-b2d8-e6792219f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:26.244868 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b667ba-3107-45a5-b2d8-e6792219f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:26.245145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b667ba-3107-45a5-b2d8-e6792219f9d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:26.256212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b667ba-3107-45a5-b2d8-e6792219f9d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-80b667ba-3107-45a5-b2d8-e6792219f9d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:22:26.261103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:26.262047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:26.263185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:26.263185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:26.263185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:26.263185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:26.263185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:22:26.263185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:22:26.263185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:22:26.263185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:22:26.263185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:22:26.263185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:22:26.263185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:22:26.263185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:26.263185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 532/1048] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:22:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:26.268392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e5465-b366-41bb-9ae5-da963bc24666 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:26.366900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e5465-b366-41bb-9ae5-da963bc24666 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:26.401369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86f0a3-aa2b-42b6-84c7-89360ed7418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:26.401995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86f0a3-aa2b-42b6-84c7-89360ed7418e None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:26.402283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86f0a3-aa2b-42b6-84c7-89360ed7418e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:26.402560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86f0a3-aa2b-42b6-84c7-89360ed7418e None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:26.403279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86f0a3-aa2b-42b6-84c7-89360ed7418e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:26.403591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86f0a3-aa2b-42b6-84c7-89360ed7418e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:26.404978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86f0a3-aa2b-42b6-84c7-89360ed7418e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:26.418162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 517/1049] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:22:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:26.419832 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b667ba-3107-45a5-b2d8-e6792219f9d5 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:26.439984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:26.526438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b667ba-3107-45a5-b2d8-e6792219f9d5 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:26.559947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f1a3f-cc57-47d7-84f3-4a70878819ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:26.560592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f1a3f-cc57-47d7-84f3-4a70878819ae None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:26.560879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f1a3f-cc57-47d7-84f3-4a70878819ae None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:26.561160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f1a3f-cc57-47d7-84f3-4a70878819ae None admin] PATH_INFO: `/v3/users/da124068ad6f4d10b15d2776f436a673` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:26.574874 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f1a3f-cc57-47d7-84f3-4a70878819ae None admin] RBAC: Authorizing `identity:get_user(user_id=da124068ad6f4d10b15d2776f436a673)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:26.576383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f1a3f-cc57-47d7-84f3-4a70878819ae None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:26.583503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 533/1050] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:22:26 2022] GET /identity/v3/users/da124068ad6f4d10b15d2776f436a673 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:26.584983 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86f0a3-aa2b-42b6-84c7-89360ed7418e None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:26.623041 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:26.696045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86f0a3-aa2b-42b6-84c7-89360ed7418e None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:26.710847 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6eb5-34fb-4603-b2e0-c8f0929a4c5c None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:26.711140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6eb5-34fb-4603-b2e0-c8f0929a4c5c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:26.711424 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6eb5-34fb-4603-b2e0-c8f0929a4c5c None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:26.712934 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 534/1051] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:26.717718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f9ca6-3465-479c-8411-90b07dd29883 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:26.718007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f9ca6-3465-479c-8411-90b07dd29883 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:26.718288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f9ca6-3465-479c-8411-90b07dd29883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:26.733445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb3a6c-12f7-47dd-959a-b307b18560f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:26.734066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb3a6c-12f7-47dd-959a-b307b18560f5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:26.734404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb3a6c-12f7-47dd-959a-b307b18560f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:26.735052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb3a6c-12f7-47dd-959a-b307b18560f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:26.737131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ee3f9ca6-3465-479c-8411-90b07dd29883 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:26.738320 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ee3f9ca6-3465-479c-8411-90b07dd29883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:26.811951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb3a6c-12f7-47dd-959a-b307b18560f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:26.813769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 535/1052] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:26.816322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb3a6c-12f7-47dd-959a-b307b18560f5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:26.836136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f9ca6-3465-479c-8411-90b07dd29883 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:26.840383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:26.854349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:26.932744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 518/1053] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:22:26 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 16:22:26.939095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb3a6c-12f7-47dd-959a-b307b18560f5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:26.951524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f9ca6-3465-479c-8411-90b07dd29883 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:26.988186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2836-011d-43ba-a895-ba5e4523719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:26.988821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2836-011d-43ba-a895-ba5e4523719a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:26.989103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2836-011d-43ba-a895-ba5e4523719a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:26.989378 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2836-011d-43ba-a895-ba5e4523719a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:26.999697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb2836-011d-43ba-a895-ba5e4523719a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-39cb2836-011d-43ba-a895-ba5e4523719a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:22:27.005146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:27.006123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:27.007202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:27.007202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:27.007202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:27.007202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:27.007202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:22:27.007202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:22:27.007202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:22:27.007202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:22:27.007202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:22:27.007202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:22:27.007202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 16:22:27.007202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:27.007202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 536/1054] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 27 16:22:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:27.012170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2836-011d-43ba-a895-ba5e4523719a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:27.045369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb3a6c-12f7-47dd-959a-b307b18560f5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:27.079628 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786b19f-10ca-4a8d-8206-49926fcdd1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:27.080228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786b19f-10ca-4a8d-8206-49926fcdd1ea None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.080518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786b19f-10ca-4a8d-8206-49926fcdd1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.080793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786b19f-10ca-4a8d-8206-49926fcdd1ea None admin] PATH_INFO: `/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.081732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:27.081955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786b19f-10ca-4a8d-8206-49926fcdd1ea None admin] RBAC: Authorizing `identity:get_project(project_id=fb41f9a776c6454f90bcd6dd00a5bd1b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:27.083551 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786b19f-10ca-4a8d-8206-49926fcdd1ea None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:27.085379 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 519/1055] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:22:26 2022] GET /identity/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:27.086600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dca5b-b700-4884-857b-49c11605ec74 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.086891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dca5b-b700-4884-857b-49c11605ec74 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.087252 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dca5b-b700-4884-857b-49c11605ec74 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.088646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 520/1056] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:27.093864 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ea02e-aba0-4614-919b-b2edffa0044e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.094255 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ea02e-aba0-4614-919b-b2edffa0044e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.094542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ea02e-aba0-4614-919b-b2edffa0044e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.101583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:27.113568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d07ea02e-aba0-4614-919b-b2edffa0044e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:27.114750 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d07ea02e-aba0-4614-919b-b2edffa0044e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:27.137602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2836-011d-43ba-a895-ba5e4523719a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:27.173052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f4e79-63bb-49ae-9efa-5dae0bfa3c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:27.173751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f4e79-63bb-49ae-9efa-5dae0bfa3c7a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.174105 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f4e79-63bb-49ae-9efa-5dae0bfa3c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.174391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f4e79-63bb-49ae-9efa-5dae0bfa3c7a None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.175109 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f4e79-63bb-49ae-9efa-5dae0bfa3c7a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:27.175416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f4e79-63bb-49ae-9efa-5dae0bfa3c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:27.176825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f4e79-63bb-49ae-9efa-5dae0bfa3c7a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:27.180113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 521/1057] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:27.180944 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ea02e-aba0-4614-919b-b2edffa0044e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:27.184946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 537/1058] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 16:22:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:27.191778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f4e79-63bb-49ae-9efa-5dae0bfa3c7a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:27.285661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ea02e-aba0-4614-919b-b2edffa0044e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:27.294879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f4e79-63bb-49ae-9efa-5dae0bfa3c7a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:27.320522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:27.320808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c027c58-5dce-41bb-86f7-cf04b9565325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:27.321484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c027c58-5dce-41bb-86f7-cf04b9565325 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.321902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c027c58-5dce-41bb-86f7-cf04b9565325 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.322019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c027c58-5dce-41bb-86f7-cf04b9565325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.322727 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c027c58-5dce-41bb-86f7-cf04b9565325 None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=fb41f9a776c6454f90bcd6dd00a5bd1b, user.id=da124068ad6f4d10b15d2776f436a673) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:27.323034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c027c58-5dce-41bb-86f7-cf04b9565325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:27.324542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c027c58-5dce-41bb-86f7-cf04b9565325 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:27.326290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:27.330627 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e122d-f0ba-465f-89c1-aca569c45c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:27.331179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 522/1059] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:22:27 2022] GET /identity/v3/role_assignments?user.id=da124068ad6f4d10b15d2776f436a673&scope.project.id=fb41f9a776c6454f90bcd6dd00a5bd1b&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:27.331906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e122d-f0ba-465f-89c1-aca569c45c4e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.332012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c027c58-5dce-41bb-86f7-cf04b9565325 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:27.332254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e122d-f0ba-465f-89c1-aca569c45c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.332638 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e122d-f0ba-465f-89c1-aca569c45c4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.349228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e122d-f0ba-465f-89c1-aca569c45c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:27.350725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e122d-f0ba-465f-89c1-aca569c45c4e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-a88e122d-f0ba-465f-89c1-aca569c45c4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:27.367441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:27.368791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:27.369873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:27.369873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:27.369873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:27.369873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:27.369873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 538/1060] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:27.374551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e122d-f0ba-465f-89c1-aca569c45c4e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:27.452830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c027c58-5dce-41bb-86f7-cf04b9565325 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:27.492438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e122d-f0ba-465f-89c1-aca569c45c4e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:27.492656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a634481-0a14-4ca6-93dd-2e2894f258d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:27.493315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a634481-0a14-4ca6-93dd-2e2894f258d3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.493595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a634481-0a14-4ca6-93dd-2e2894f258d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.493869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a634481-0a14-4ca6-93dd-2e2894f258d3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.494492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a634481-0a14-4ca6-93dd-2e2894f258d3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:27.495845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a634481-0a14-4ca6-93dd-2e2894f258d3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-1a634481-0a14-4ca6-93dd-2e2894f258d3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:27.505099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:27.506325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:27.507356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 523/1061] 10.222.0.67 () {56 vars in 1105 bytes} [Wed Jul 27 16:22:27 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:27.514285 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a634481-0a14-4ca6-93dd-2e2894f258d3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:27.536325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f310b-23a7-420a-b987-3ee902bdd1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:27.536948 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f310b-23a7-420a-b987-3ee902bdd1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.537228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f310b-23a7-420a-b987-3ee902bdd1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.537501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f310b-23a7-420a-b987-3ee902bdd1a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.538184 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f310b-23a7-420a-b987-3ee902bdd1a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:27.538491 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f310b-23a7-420a-b987-3ee902bdd1a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:27.539874 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f310b-23a7-420a-b987-3ee902bdd1a4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:27.552563 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 539/1062] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:27.557600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f310b-23a7-420a-b987-3ee902bdd1a4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:27.582001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:27.607179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:27.624135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a634481-0a14-4ca6-93dd-2e2894f258d3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:27.672303 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f310b-23a7-420a-b987-3ee902bdd1a4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:27.672948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2f748-ae7e-43e4-873c-f56a5df81bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:27.673823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2f748-ae7e-43e4-873c-f56a5df81bbd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.674123 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2f748-ae7e-43e4-873c-f56a5df81bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.674427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2f748-ae7e-43e4-873c-f56a5df81bbd None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.676011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2f748-ae7e-43e4-873c-f56a5df81bbd None admin] RBAC: Adding query filter params (name=image) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:27.676330 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2f748-ae7e-43e4-873c-f56a5df81bbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:27.677709 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2f748-ae7e-43e4-873c-f56a5df81bbd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:27.684212 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 524/1063] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:27.689876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2f748-ae7e-43e4-873c-f56a5df81bbd None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:27.712600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041af49f-fd45-4190-973c-8b97699233ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:27.713998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041af49f-fd45-4190-973c-8b97699233ef None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.714712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041af49f-fd45-4190-973c-8b97699233ef None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.715142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041af49f-fd45-4190-973c-8b97699233ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.726360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041af49f-fd45-4190-973c-8b97699233ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:27.728919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041af49f-fd45-4190-973c-8b97699233ef None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-041af49f-fd45-4190-973c-8b97699233ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:22:27.742007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:27.743150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:27.744488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:27.744488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:27.744488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:22:27.744488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:22:27.744488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:22:27.744488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:22:27.744488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:22:27.744488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:22:27.744488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:22:27.744488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:27.744488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 540/1064] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 16:22:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:27.748821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041af49f-fd45-4190-973c-8b97699233ef None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:27.802247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2f748-ae7e-43e4-873c-f56a5df81bbd None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:27.829112 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:27.839017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15322d66-3bd6-49cc-88d3-dd716478dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:27.839551 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15322d66-3bd6-49cc-88d3-dd716478dfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.839841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15322d66-3bd6-49cc-88d3-dd716478dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.840150 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15322d66-3bd6-49cc-88d3-dd716478dfb5 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.840831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15322d66-3bd6-49cc-88d3-dd716478dfb5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:27.841138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15322d66-3bd6-49cc-88d3-dd716478dfb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:27.842518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15322d66-3bd6-49cc-88d3-dd716478dfb5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:27.852860 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 525/1065] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:27.854033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15322d66-3bd6-49cc-88d3-dd716478dfb5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:27.861187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:27.865371 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041af49f-fd45-4190-973c-8b97699233ef None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:27.902913 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c9ce2-46ba-4579-bed0-cf8719f16102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:27.903793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c9ce2-46ba-4579-bed0-cf8719f16102 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:27.904122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c9ce2-46ba-4579-bed0-cf8719f16102 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:27.904401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c9ce2-46ba-4579-bed0-cf8719f16102 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:27.905194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c9ce2-46ba-4579-bed0-cf8719f16102 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:27.905805 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c9ce2-46ba-4579-bed0-cf8719f16102 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:27.907003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c9ce2-46ba-4579-bed0-cf8719f16102 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:27.925149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 541/1066] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 16:22:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:27.930656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c9ce2-46ba-4579-bed0-cf8719f16102 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:27.968396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15322d66-3bd6-49cc-88d3-dd716478dfb5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:28.003503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c82de-a5e7-4bca-9fea-b395d1189423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:28.004161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c82de-a5e7-4bca-9fea-b395d1189423 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:28.004447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c82de-a5e7-4bca-9fea-b395d1189423 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:28.004725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c82de-a5e7-4bca-9fea-b395d1189423 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:28.005436 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c82de-a5e7-4bca-9fea-b395d1189423 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:28.006792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c82de-a5e7-4bca-9fea-b395d1189423 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:28.032136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 526/1067] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:22:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:22:28.043055 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c9ce2-46ba-4579-bed0-cf8719f16102 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:28.089506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72365cec-6367-4607-a323-4db039f83108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:28.090087 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72365cec-6367-4607-a323-4db039f83108 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:28.090375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72365cec-6367-4607-a323-4db039f83108 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:28.090648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72365cec-6367-4607-a323-4db039f83108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:28.102977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72365cec-6367-4607-a323-4db039f83108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:28.104514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72365cec-6367-4607-a323-4db039f83108 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-72365cec-6367-4607-a323-4db039f83108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:28.122322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:28.123319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:28.128812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:28.128812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:28.128812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:28.128812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:28.128812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 542/1068] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:28.132258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c82de-a5e7-4bca-9fea-b395d1189423 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:28.184546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:28.246752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c82de-a5e7-4bca-9fea-b395d1189423 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:28.282060 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dc8c2-eccc-4074-ae61-a82097f5190d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:28.282694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dc8c2-eccc-4074-ae61-a82097f5190d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:28.282981 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dc8c2-eccc-4074-ae61-a82097f5190d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:28.283259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dc8c2-eccc-4074-ae61-a82097f5190d None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:28.283981 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dc8c2-eccc-4074-ae61-a82097f5190d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:28.284293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dc8c2-eccc-4074-ae61-a82097f5190d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:28.285661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dc8c2-eccc-4074-ae61-a82097f5190d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:28.298591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 527/1069] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:28.303979 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72365cec-6367-4607-a323-4db039f83108 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:28.308690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:28.410770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72365cec-6367-4607-a323-4db039f83108 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:28.447159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ca92a-95f0-4e13-9123-7de6050365f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:28.447804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ca92a-95f0-4e13-9123-7de6050365f3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:28.448119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ca92a-95f0-4e13-9123-7de6050365f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:28.448400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ca92a-95f0-4e13-9123-7de6050365f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:28.456023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ca92a-95f0-4e13-9123-7de6050365f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:28.457503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ca92a-95f0-4e13-9123-7de6050365f3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-481ca92a-95f0-4e13-9123-7de6050365f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:22:28.469268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:28.470227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:28.471162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:22:28.471162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:22:28.471162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:22:28.471162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:22:28.471162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:22:28.471162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:22:28.471162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:28.471162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:28.471162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 543/1070] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:22:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:28.477805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dc8c2-eccc-4074-ae61-a82097f5190d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:28.581638 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dc8c2-eccc-4074-ae61-a82097f5190d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:28.589245 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:28.617688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a513c-5dd2-442b-8cfb-5b3328c00f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:28.618447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a513c-5dd2-442b-8cfb-5b3328c00f9f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:28.618852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a513c-5dd2-442b-8cfb-5b3328c00f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:28.619240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a513c-5dd2-442b-8cfb-5b3328c00f9f None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:28.620119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a513c-5dd2-442b-8cfb-5b3328c00f9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:28.620537 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a513c-5dd2-442b-8cfb-5b3328c00f9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:28.622047 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a513c-5dd2-442b-8cfb-5b3328c00f9f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:28.634378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 528/1071] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:22:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:28.641602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ca92a-95f0-4e13-9123-7de6050365f3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:28.710763 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:28.754965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ca92a-95f0-4e13-9123-7de6050365f3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:28.788837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82873c-4c9a-4303-a6ae-92d1fcf6ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:28.789516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82873c-4c9a-4303-a6ae-92d1fcf6ded0 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:28.789806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82873c-4c9a-4303-a6ae-92d1fcf6ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:28.790087 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82873c-4c9a-4303-a6ae-92d1fcf6ded0 None admin] PATH_INFO: `/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/9d5a8ef373ca4ed7bf31361e24e42e54/roles/a6830cba40be4a629a151ed45e6a7f13` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:28.792413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82873c-4c9a-4303-a6ae-92d1fcf6ded0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01ef9cd2ffc4edd94cbf0017a720a57, user_id=9d5a8ef373ca4ed7bf31361e24e42e54, role_id=a6830cba40be4a629a151ed45e6a7f13)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:28.793857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82873c-4c9a-4303-a6ae-92d1fcf6ded0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:28.809269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 544/1072] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:22:28 2022] PUT /identity/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/9d5a8ef373ca4ed7bf31361e24e42e54/roles/a6830cba40be4a629a151ed45e6a7f13 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:22:29.322436 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259f04-62d6-4fac-aa99-e5c83b86d1e5 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:29.322966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259f04-62d6-4fac-aa99-e5c83b86d1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:29.322966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac259f04-62d6-4fac-aa99-e5c83b86d1e5 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:29.324413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 529/1073] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:29.330250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aab57-7075-4036-8c77-e2035c685864 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:29.330669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aab57-7075-4036-8c77-e2035c685864 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:29.330834 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aab57-7075-4036-8c77-e2035c685864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:29.350081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-177aab57-7075-4036-8c77-e2035c685864 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:29.351273 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-177aab57-7075-4036-8c77-e2035c685864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:29.422651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 545/1074] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:29.444735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac259f04-62d6-4fac-aa99-e5c83b86d1e5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:29.550530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac259f04-62d6-4fac-aa99-e5c83b86d1e5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:29.585144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d4b1d-a445-4bac-a5e7-ce41ee3ffdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:29.585710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d4b1d-a445-4bac-a5e7-ce41ee3ffdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:29.585995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d4b1d-a445-4bac-a5e7-ce41ee3ffdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:29.586273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d4b1d-a445-4bac-a5e7-ce41ee3ffdf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:29.596895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d4b1d-a445-4bac-a5e7-ce41ee3ffdf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-b18d4b1d-a445-4bac-a5e7-ce41ee3ffdf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:22:29.601853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:29.602786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:29.603642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:29.603642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:29.603642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:29.603642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:29.603642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:22:29.603642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:22:29.603642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:22:29.603642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:22:29.603642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:22:29.603642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:22:29.603642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:22:29.603642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:29.608088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 530/1075] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:22:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:29.609841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aab57-7075-4036-8c77-e2035c685864 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:29.671229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:29.719645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aab57-7075-4036-8c77-e2035c685864 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:29.754322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ebce5-9e50-4b26-8327-64f4deaf681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:29.755113 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ebce5-9e50-4b26-8327-64f4deaf681c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:29.755398 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ebce5-9e50-4b26-8327-64f4deaf681c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:29.755671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ebce5-9e50-4b26-8327-64f4deaf681c None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:29.756418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ebce5-9e50-4b26-8327-64f4deaf681c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:29.756726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ebce5-9e50-4b26-8327-64f4deaf681c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:29.758089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ebce5-9e50-4b26-8327-64f4deaf681c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:29.771778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 546/1076] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:22:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:29.773092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d4b1d-a445-4bac-a5e7-ce41ee3ffdf5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:29.803053 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:29.878155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d4b1d-a445-4bac-a5e7-ce41ee3ffdf5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:29.913624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82596904-7b8f-49a1-93df-e2ff8234105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:29.914279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82596904-7b8f-49a1-93df-e2ff8234105b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:29.914572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82596904-7b8f-49a1-93df-e2ff8234105b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:29.914853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82596904-7b8f-49a1-93df-e2ff8234105b None admin] PATH_INFO: `/v3/users/da124068ad6f4d10b15d2776f436a673` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:29.916063 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82596904-7b8f-49a1-93df-e2ff8234105b None admin] RBAC: Authorizing `identity:get_user(user_id=da124068ad6f4d10b15d2776f436a673)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:29.917498 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82596904-7b8f-49a1-93df-e2ff8234105b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:29.923888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 531/1077] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:22:29 2022] GET /identity/v3/users/da124068ad6f4d10b15d2776f436a673 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:29.925926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ebce5-9e50-4b26-8327-64f4deaf681c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:30.030176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ebce5-9e50-4b26-8327-64f4deaf681c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:30.047476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:30.066155 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9c553-94ef-44f2-89ab-5d826924c174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:30.066758 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c553-94ef-44f2-89ab-5d826924c174 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:30.067043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c553-94ef-44f2-89ab-5d826924c174 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:30.067324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c553-94ef-44f2-89ab-5d826924c174 None admin] PATH_INFO: `/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:30.067623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536b4e7-bb05-455c-8e14-aa8002a446ba None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:30.067941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536b4e7-bb05-455c-8e14-aa8002a446ba None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:30.068224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536b4e7-bb05-455c-8e14-aa8002a446ba None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:30.068502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9c553-94ef-44f2-89ab-5d826924c174 None admin] RBAC: Authorizing `identity:get_project(project_id=fb41f9a776c6454f90bcd6dd00a5bd1b)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:30.069710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 532/1078] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:22:30.069946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9c553-94ef-44f2-89ab-5d826924c174 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:30.076510 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 547/1079] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:22:29 2022] GET /identity/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:30.077095 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9c553-94ef-44f2-89ab-5d826924c174 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:30.077468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fea8b-4180-4423-b34e-fc392ceeb085 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:30.077800 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fea8b-4180-4423-b34e-fc392ceeb085 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:30.078079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fea8b-4180-4423-b34e-fc392ceeb085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:30.095986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3c8fea8b-4180-4423-b34e-fc392ceeb085 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:30.097170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3c8fea8b-4180-4423-b34e-fc392ceeb085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:30.176107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 533/1080] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:30.178350 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9c553-94ef-44f2-89ab-5d826924c174 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:30.191349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fea8b-4180-4423-b34e-fc392ceeb085 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:30.214591 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a859e5-67d3-4ee9-b517-cc4d8e4ad732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:30.215559 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a859e5-67d3-4ee9-b517-cc4d8e4ad732 None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:30.216059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a859e5-67d3-4ee9-b517-cc4d8e4ad732 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:30.216533 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a859e5-67d3-4ee9-b517-cc4d8e4ad732 None admin] PATH_INFO: `/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b/users/da124068ad6f4d10b15d2776f436a673/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:30.216668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:30.219042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a859e5-67d3-4ee9-b517-cc4d8e4ad732 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb41f9a776c6454f90bcd6dd00a5bd1b, user_id=da124068ad6f4d10b15d2776f436a673, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:30.220457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a859e5-67d3-4ee9-b517-cc4d8e4ad732 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:30.236411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 548/1081] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:22:30 2022] PUT /identity/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b/users/da124068ad6f4d10b15d2776f436a673/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:22:30.305829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fea8b-4180-4423-b34e-fc392ceeb085 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:30.342848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a8911-fcaa-4116-9609-62e2ea3fb6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:30.343529 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8911-fcaa-4116-9609-62e2ea3fb6ae None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:30.344327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8911-fcaa-4116-9609-62e2ea3fb6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:30.344709 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a8911-fcaa-4116-9609-62e2ea3fb6ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:30.419611 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a8911-fcaa-4116-9609-62e2ea3fb6ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:30.421095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a8911-fcaa-4116-9609-62e2ea3fb6ae None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:30.446154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:30.522444 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 534/1082] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:22:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 16:22:30.528166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a859e5-67d3-4ee9-b517-cc4d8e4ad732 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:30.575481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:30.635019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a859e5-67d3-4ee9-b517-cc4d8e4ad732 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:30.672009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7ada8-1a1f-4d7d-bdea-1267548b2da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:30.672658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7ada8-1a1f-4d7d-bdea-1267548b2da1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:30.672940 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7ada8-1a1f-4d7d-bdea-1267548b2da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:30.673214 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7ada8-1a1f-4d7d-bdea-1267548b2da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:30.683975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7ada8-1a1f-4d7d-bdea-1267548b2da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:30.685414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7ada8-1a1f-4d7d-bdea-1267548b2da1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-cef7ada8-1a1f-4d7d-bdea-1267548b2da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:30.702227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:30.703246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:30.704348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:30.704348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:30.704348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:30.704348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:30.704348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 549/1083] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:30.710552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a8911-fcaa-4116-9609-62e2ea3fb6ae None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:30.812718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a8911-fcaa-4116-9609-62e2ea3fb6ae None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:30.835984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:30.844851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd1779-990b-486b-824b-f58aa6a95e6f None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:30.845161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd1779-990b-486b-824b-f58aa6a95e6f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:30.845443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd1779-990b-486b-824b-f58aa6a95e6f None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:30.846923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 550/1084] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:22:30.849081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ca347-5072-4f3b-9902-6fa6c49a34c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:30.849699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca347-5072-4f3b-9902-6fa6c49a34c8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:30.849982 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca347-5072-4f3b-9902-6fa6c49a34c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:30.850256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca347-5072-4f3b-9902-6fa6c49a34c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:30.850941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ca347-5072-4f3b-9902-6fa6c49a34c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:30.851247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ca347-5072-4f3b-9902-6fa6c49a34c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:30.851783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921b39-5eee-425a-a859-4f1dd94ed9c4 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:30.852106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921b39-5eee-425a-a859-4f1dd94ed9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:30.852385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921b39-5eee-425a-a859-4f1dd94ed9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:30.852624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ca347-5072-4f3b-9902-6fa6c49a34c8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:30.869455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 535/1085] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:30.870801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-cf921b39-5eee-425a-a859-4f1dd94ed9c4 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:30.872071 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cf921b39-5eee-425a-a859-4f1dd94ed9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:30.945810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 551/1086] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:30.970490 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ca347-5072-4f3b-9902-6fa6c49a34c8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:31.075496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ca347-5072-4f3b-9902-6fa6c49a34c8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:31.111009 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ec7e-d9f4-47d7-9977-3d10dfef79e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:31.111662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ec7e-d9f4-47d7-9977-3d10dfef79e9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:31.111991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ec7e-d9f4-47d7-9977-3d10dfef79e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:31.112273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ec7e-d9f4-47d7-9977-3d10dfef79e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:31.122612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02ec7e-d9f4-47d7-9977-3d10dfef79e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-4e02ec7e-d9f4-47d7-9977-3d10dfef79e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:22:31.128104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:31.129049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:31.130044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:31.130044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:31.130044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:31.130044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:31.130044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:22:31.130044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:22:31.130044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:22:31.130044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:22:31.130044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:22:31.130044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:22:31.130044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 16:22:31.130044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:31.130044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 536/1087] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 27 16:22:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:31.137016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf921b39-5eee-425a-a859-4f1dd94ed9c4 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:31.167102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:31.238728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf921b39-5eee-425a-a859-4f1dd94ed9c4 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:31.271950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba0aca-d644-4202-aa50-3f3910071f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:31.272559 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba0aca-d644-4202-aa50-3f3910071f00 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:31.272840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba0aca-d644-4202-aa50-3f3910071f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:31.273114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba0aca-d644-4202-aa50-3f3910071f00 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:31.273819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba0aca-d644-4202-aa50-3f3910071f00 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:31.274121 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba0aca-d644-4202-aa50-3f3910071f00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:31.275481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba0aca-d644-4202-aa50-3f3910071f00 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:31.283527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 552/1088] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 16:22:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:31.289044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ec7e-d9f4-47d7-9977-3d10dfef79e9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:31.334314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:31.389333 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ec7e-d9f4-47d7-9977-3d10dfef79e9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:31.423048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f962ba-e472-4773-90fc-aa3242e6ca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:31.423704 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f962ba-e472-4773-90fc-aa3242e6ca72 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:31.424025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f962ba-e472-4773-90fc-aa3242e6ca72 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:31.424305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f962ba-e472-4773-90fc-aa3242e6ca72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:31.434745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f962ba-e472-4773-90fc-aa3242e6ca72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:31.436225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f962ba-e472-4773-90fc-aa3242e6ca72 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-e9f962ba-e472-4773-90fc-aa3242e6ca72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:31.450560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:31.451612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:31.452826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:31.452826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:31.452826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:31.452826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:31.456006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 537/1089] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:31.457987 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba0aca-d644-4202-aa50-3f3910071f00 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:31.544295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:31.557368 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba0aca-d644-4202-aa50-3f3910071f00 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:31.590623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dd9ab-74a8-4577-90ed-721f755ff5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:31.591235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd9ab-74a8-4577-90ed-721f755ff5ac None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:31.591522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd9ab-74a8-4577-90ed-721f755ff5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:31.591801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd9ab-74a8-4577-90ed-721f755ff5ac None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:31.592513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dd9ab-74a8-4577-90ed-721f755ff5ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:31.592821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dd9ab-74a8-4577-90ed-721f755ff5ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:31.594559 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dd9ab-74a8-4577-90ed-721f755ff5ac None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:31.606102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 553/1090] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:31.612703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f962ba-e472-4773-90fc-aa3242e6ca72 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:31.706688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:31.713202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f962ba-e472-4773-90fc-aa3242e6ca72 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:31.746123 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d032a-6f17-495c-950d-667a08ab8152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:31.746764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d032a-6f17-495c-950d-667a08ab8152 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:31.747049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d032a-6f17-495c-950d-667a08ab8152 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:31.747329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d032a-6f17-495c-950d-667a08ab8152 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:31.754647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d032a-6f17-495c-950d-667a08ab8152 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:31.756108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d032a-6f17-495c-950d-667a08ab8152 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-9f8d032a-6f17-495c-950d-667a08ab8152 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:22:31.768124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:31.769237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:31.770216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:31.770216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:31.770216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:22:31.770216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:22:31.770216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:22:31.770216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:22:31.770216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:22:31.770216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:22:31.770216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 16:22:31.770216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:31.770216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 538/1091] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 16:22:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:31.775162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dd9ab-74a8-4577-90ed-721f755ff5ac None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:31.873277 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dd9ab-74a8-4577-90ed-721f755ff5ac None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:31.906375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9e22f-4bcc-4d7e-959d-511b3b8c8cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:31.906992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9e22f-4bcc-4d7e-959d-511b3b8c8cfb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:31.907271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9e22f-4bcc-4d7e-959d-511b3b8c8cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:31.907543 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9e22f-4bcc-4d7e-959d-511b3b8c8cfb None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:31.908362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9e22f-4bcc-4d7e-959d-511b3b8c8cfb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:31.908668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9e22f-4bcc-4d7e-959d-511b3b8c8cfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:31.910091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9e22f-4bcc-4d7e-959d-511b3b8c8cfb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:31.926773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 554/1092] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 16:22:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:31.932500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d032a-6f17-495c-950d-667a08ab8152 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:32.032856 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d032a-6f17-495c-950d-667a08ab8152 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:32.065532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb079a-7c5c-465a-8db0-6eb7525ecc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:32.066148 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb079a-7c5c-465a-8db0-6eb7525ecc30 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.066436 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb079a-7c5c-465a-8db0-6eb7525ecc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.066717 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb079a-7c5c-465a-8db0-6eb7525ecc30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.091148 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:32.134834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb079a-7c5c-465a-8db0-6eb7525ecc30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:32.136239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb079a-7c5c-465a-8db0-6eb7525ecc30 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:32.235320 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a9b1a-7da2-404c-9edf-679044ff6d96 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.235710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a9b1a-7da2-404c-9edf-679044ff6d96 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.235812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 539/1093] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:22:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 16:22:32.235916 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a9b1a-7da2-404c-9edf-679044ff6d96 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.237269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 555/1094] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:22:32.241074 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb079a-7c5c-465a-8db0-6eb7525ecc30 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:32.242057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6db1d-c833-44f7-979a-31179c8607bc None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.242348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6db1d-c833-44f7-979a-31179c8607bc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.242627 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6db1d-c833-44f7-979a-31179c8607bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.255631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:32.261679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-4bf6db1d-c833-44f7-979a-31179c8607bc None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:32.262871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4bf6db1d-c833-44f7-979a-31179c8607bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:32.297222 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:32.333470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 556/1095] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:22:32.340879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb079a-7c5c-465a-8db0-6eb7525ecc30 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:32.356734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6db1d-c833-44f7-979a-31179c8607bc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:32.376838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d5b48-1df2-4499-a294-7c8a76d04c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:32.377488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d5b48-1df2-4499-a294-7c8a76d04c24 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.377767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d5b48-1df2-4499-a294-7c8a76d04c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.378042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d5b48-1df2-4499-a294-7c8a76d04c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.388313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d5b48-1df2-4499-a294-7c8a76d04c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:32.389670 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d5b48-1df2-4499-a294-7c8a76d04c24 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5d9d5b48-1df2-4499-a294-7c8a76d04c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:22:32.404290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:32.405193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:32.406106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:22:32.406106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:22:32.406106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:22:32.406106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:32.406106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 540/1096] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:32.411308 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d5b48-1df2-4499-a294-7c8a76d04c24 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:32.458157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6db1d-c833-44f7-979a-31179c8607bc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:32.492707 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11743d0b-d030-4dda-8f74-ffba3549f56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:32.493353 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11743d0b-d030-4dda-8f74-ffba3549f56e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.493641 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11743d0b-d030-4dda-8f74-ffba3549f56e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.493919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11743d0b-d030-4dda-8f74-ffba3549f56e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.496569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:32.505202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11743d0b-d030-4dda-8f74-ffba3549f56e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-11743d0b-d030-4dda-8f74-ffba3549f56e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:22:32.510145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:32.511122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:32.512242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:32.512242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:32.512242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:32.512242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:32.512242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:22:32.512242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:22:32.512242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:22:32.512242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:22:32.512242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:22:32.512242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:22:32.512242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:22:32.512242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:32.513116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d5b48-1df2-4499-a294-7c8a76d04c24 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:32.513211 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 557/1097] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:22:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:32.517729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11743d0b-d030-4dda-8f74-ffba3549f56e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:32.521503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:32.546804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38a82c-d011-4285-89b8-b32a01bbb2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:32.547434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38a82c-d011-4285-89b8-b32a01bbb2cb None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.547722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38a82c-d011-4285-89b8-b32a01bbb2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.548033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38a82c-d011-4285-89b8-b32a01bbb2cb None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.548719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38a82c-d011-4285-89b8-b32a01bbb2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:32.549026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38a82c-d011-4285-89b8-b32a01bbb2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:32.550381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38a82c-d011-4285-89b8-b32a01bbb2cb None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:32.562570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 541/1098] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:32.568229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38a82c-d011-4285-89b8-b32a01bbb2cb None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:32.617842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11743d0b-d030-4dda-8f74-ffba3549f56e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:32.652036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25898bf-8ac5-4b32-87f7-b207f1abde04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:32.652632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25898bf-8ac5-4b32-87f7-b207f1abde04 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.652956 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25898bf-8ac5-4b32-87f7-b207f1abde04 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.653169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25898bf-8ac5-4b32-87f7-b207f1abde04 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.653880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25898bf-8ac5-4b32-87f7-b207f1abde04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:32.654181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25898bf-8ac5-4b32-87f7-b207f1abde04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:32.655609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25898bf-8ac5-4b32-87f7-b207f1abde04 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:32.665000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 558/1099] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:22:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:32.668728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38a82c-d011-4285-89b8-b32a01bbb2cb None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:32.670705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25898bf-8ac5-4b32-87f7-b207f1abde04 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:32.702532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f970f2-eb69-454c-b4ef-95eabbd86c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:32.703747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f970f2-eb69-454c-b4ef-95eabbd86c79 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.704056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f970f2-eb69-454c-b4ef-95eabbd86c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.704330 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f970f2-eb69-454c-b4ef-95eabbd86c79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.710914 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f970f2-eb69-454c-b4ef-95eabbd86c79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:32.712380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f970f2-eb69-454c-b4ef-95eabbd86c79 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-b7f970f2-eb69-454c-b4ef-95eabbd86c79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:22:32.723768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:32.724783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:32.725715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:22:32.725715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:22:32.725715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:22:32.725715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:22:32.725715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:22:32.725715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:22:32.725715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:22:32.725715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:32.725715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 542/1100] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:22:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:22:32.730791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f970f2-eb69-454c-b4ef-95eabbd86c79 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:32.740595 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:32.759329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:32.783601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25898bf-8ac5-4b32-87f7-b207f1abde04 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:32.817563 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48f621-c067-4501-b972-f4ed35677154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:32.818198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48f621-c067-4501-b972-f4ed35677154 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.818485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48f621-c067-4501-b972-f4ed35677154 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.818766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48f621-c067-4501-b972-f4ed35677154 None admin] PATH_INFO: `/v3/users/da124068ad6f4d10b15d2776f436a673` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.819976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48f621-c067-4501-b972-f4ed35677154 None admin] RBAC: Authorizing `identity:get_user(user_id=da124068ad6f4d10b15d2776f436a673)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:32.821408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48f621-c067-4501-b972-f4ed35677154 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:32.823028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 559/1101] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:22:32 2022] GET /identity/v3/users/da124068ad6f4d10b15d2776f436a673 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:32.828994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48f621-c067-4501-b972-f4ed35677154 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:32.831014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f970f2-eb69-454c-b4ef-95eabbd86c79 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:32.866165 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29444b6-5bf8-40d0-9f7a-7c121713f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:32.866784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29444b6-5bf8-40d0-9f7a-7c121713f38d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.867067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29444b6-5bf8-40d0-9f7a-7c121713f38d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.867340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29444b6-5bf8-40d0-9f7a-7c121713f38d None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.868155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29444b6-5bf8-40d0-9f7a-7c121713f38d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:32.868461 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29444b6-5bf8-40d0-9f7a-7c121713f38d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:32.869869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29444b6-5bf8-40d0-9f7a-7c121713f38d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:32.881768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 543/1102] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:22:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:32.888267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29444b6-5bf8-40d0-9f7a-7c121713f38d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:32.929458 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48f621-c067-4501-b972-f4ed35677154 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:32.954410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:32.963756 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6073b-2ca3-4feb-a94d-51b2e626f2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:32.964406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6073b-2ca3-4feb-a94d-51b2e626f2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:32.964694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6073b-2ca3-4feb-a94d-51b2e626f2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:32.964976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6073b-2ca3-4feb-a94d-51b2e626f2f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:32.975380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:32.987491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29444b6-5bf8-40d0-9f7a-7c121713f38d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:33.022051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a286545-aa67-4173-93dc-052d642f0d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:33.022772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a286545-aa67-4173-93dc-052d642f0d98 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:33.023126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a286545-aa67-4173-93dc-052d642f0d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:33.023475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a286545-aa67-4173-93dc-052d642f0d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:33.024357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a286545-aa67-4173-93dc-052d642f0d98 None admin] RBAC: Adding query filter params (role.id=a6830cba40be4a629a151ed45e6a7f13, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=9d5a8ef373ca4ed7bf31361e24e42e54) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:33.024677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a286545-aa67-4173-93dc-052d642f0d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:33.026090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a286545-aa67-4173-93dc-052d642f0d98 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:33.031773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 544/1103] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:22:32 2022] GET /identity/v3/role_assignments?user.id=9d5a8ef373ca4ed7bf31361e24e42e54&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=a6830cba40be4a629a151ed45e6a7f13 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:33.036906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6073b-2ca3-4feb-a94d-51b2e626f2f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:33.038476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6073b-2ca3-4feb-a94d-51b2e626f2f7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:33.145887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 560/1104] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:22:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 16:22:33.151995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a286545-aa67-4173-93dc-052d642f0d98 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:33.256930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a286545-aa67-4173-93dc-052d642f0d98 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:33.291159 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72099e4-703f-446f-83aa-410292d59f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:33.291794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72099e4-703f-446f-83aa-410292d59f53 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:33.292103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72099e4-703f-446f-83aa-410292d59f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:33.292378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72099e4-703f-446f-83aa-410292d59f53 None admin] PATH_INFO: `/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:33.293530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72099e4-703f-446f-83aa-410292d59f53 None admin] RBAC: Authorizing `identity:get_project(project_id=fb41f9a776c6454f90bcd6dd00a5bd1b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:33.294937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72099e4-703f-446f-83aa-410292d59f53 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:33.298086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 545/1105] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:22:33 2022] GET /identity/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:33.304651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6073b-2ca3-4feb-a94d-51b2e626f2f7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:33.332874 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:33.409149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6073b-2ca3-4feb-a94d-51b2e626f2f7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:33.443647 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a01bf-c3f0-4e0c-88ff-30ec4f9fdd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:33.444303 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a01bf-c3f0-4e0c-88ff-30ec4f9fdd58 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:33.444594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a01bf-c3f0-4e0c-88ff-30ec4f9fdd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:33.445028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a01bf-c3f0-4e0c-88ff-30ec4f9fdd58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:33.445831 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a01bf-c3f0-4e0c-88ff-30ec4f9fdd58 None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=fb41f9a776c6454f90bcd6dd00a5bd1b, user.id=da124068ad6f4d10b15d2776f436a673) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:33.446151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a01bf-c3f0-4e0c-88ff-30ec4f9fdd58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:33.447587 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a01bf-c3f0-4e0c-88ff-30ec4f9fdd58 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:33.453841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 561/1106] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:22:33 2022] GET /identity/v3/role_assignments?user.id=da124068ad6f4d10b15d2776f436a673&scope.project.id=fb41f9a776c6454f90bcd6dd00a5bd1b&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:35.473681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387cd9d-5253-45ae-b7a3-e977eb307c84 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:35.474213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387cd9d-5253-45ae-b7a3-e977eb307c84 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:35.474308 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387cd9d-5253-45ae-b7a3-e977eb307c84 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:35.475585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 546/1107] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:35.480612 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835a52-868e-4a9e-9801-622c5d3b6502 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:35.481033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835a52-868e-4a9e-9801-622c5d3b6502 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:35.481172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83835a52-868e-4a9e-9801-622c5d3b6502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:35.500662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-83835a52-868e-4a9e-9801-622c5d3b6502 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:35.501840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-83835a52-868e-4a9e-9801-622c5d3b6502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:35.566427 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 562/1108] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:35.590478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387cd9d-5253-45ae-b7a3-e977eb307c84 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:35.612939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:35.690818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387cd9d-5253-45ae-b7a3-e977eb307c84 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:35.723527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b354856-720f-443a-adab-dbbee593715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:35.724242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b354856-720f-443a-adab-dbbee593715d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:35.724480 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b354856-720f-443a-adab-dbbee593715d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:35.724759 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b354856-720f-443a-adab-dbbee593715d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:35.725914 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b354856-720f-443a-adab-dbbee593715d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:35.727333 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b354856-720f-443a-adab-dbbee593715d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:35.728958 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 547/1109] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:35.735472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83835a52-868e-4a9e-9801-622c5d3b6502 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:35.756088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:35.832227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83835a52-868e-4a9e-9801-622c5d3b6502 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:35.866123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b965d3c-500f-4398-91aa-cb703c9f7bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:35.866736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b965d3c-500f-4398-91aa-cb703c9f7bf6 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:35.867024 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b965d3c-500f-4398-91aa-cb703c9f7bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:35.867313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b965d3c-500f-4398-91aa-cb703c9f7bf6 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:35.868046 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b965d3c-500f-4398-91aa-cb703c9f7bf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:35.869489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b965d3c-500f-4398-91aa-cb703c9f7bf6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:35.889833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 563/1110] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:22:35 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:22:37.904525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83203be3-965c-4577-b899-e0ebbfb6eca3 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:37.905028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83203be3-965c-4577-b899-e0ebbfb6eca3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:37.905028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83203be3-965c-4577-b899-e0ebbfb6eca3 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:37.907166 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 548/1111] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:37.912355 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45322c00-dc29-48c6-b2f6-e79f51a2da2e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:37.912738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45322c00-dc29-48c6-b2f6-e79f51a2da2e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:37.912908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45322c00-dc29-48c6-b2f6-e79f51a2da2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:37.930484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-45322c00-dc29-48c6-b2f6-e79f51a2da2e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:37.931649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-45322c00-dc29-48c6-b2f6-e79f51a2da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:37.996819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 564/1112] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:38.022203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83203be3-965c-4577-b899-e0ebbfb6eca3 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:38.106455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:38.119257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83203be3-965c-4577-b899-e0ebbfb6eca3 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:38.152000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ef17b-4bc1-4fd0-bdfb-18394196866c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:38.152622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ef17b-4bc1-4fd0-bdfb-18394196866c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:38.152902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ef17b-4bc1-4fd0-bdfb-18394196866c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:38.153174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ef17b-4bc1-4fd0-bdfb-18394196866c None admin] PATH_INFO: `/v3/roles/84e73bacaaef4e4ab018e94824f9d891` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:38.154634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ef17b-4bc1-4fd0-bdfb-18394196866c None admin] RBAC: Authorizing `identity:get_role(role_id=84e73bacaaef4e4ab018e94824f9d891)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:38.156183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ef17b-4bc1-4fd0-bdfb-18394196866c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:38.157502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 549/1113] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:22:38 2022] GET /identity/v3/roles/84e73bacaaef4e4ab018e94824f9d891 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:38.163248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45322c00-dc29-48c6-b2f6-e79f51a2da2e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:38.171151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:38.270479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45322c00-dc29-48c6-b2f6-e79f51a2da2e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:38.311425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5083293-dcc1-43a0-b8d9-2f7621202dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:38.312715 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5083293-dcc1-43a0-b8d9-2f7621202dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:38.313039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5083293-dcc1-43a0-b8d9-2f7621202dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:38.313316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5083293-dcc1-43a0-b8d9-2f7621202dc2 None admin] PATH_INFO: `/v3/users/05ad16a57e0644848fa5b98bfea311e8` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:38.325835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5083293-dcc1-43a0-b8d9-2f7621202dc2 None admin] RBAC: Authorizing `identity:get_user(user_id=05ad16a57e0644848fa5b98bfea311e8)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:38.327268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5083293-dcc1-43a0-b8d9-2f7621202dc2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:38.328981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 565/1114] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:22:38 2022] GET /identity/v3/users/05ad16a57e0644848fa5b98bfea311e8 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:38.334782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ef17b-4bc1-4fd0-bdfb-18394196866c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:38.431941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ef17b-4bc1-4fd0-bdfb-18394196866c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:38.464054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc14874-166f-4e7e-878c-b5bb27935488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:38.464661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc14874-166f-4e7e-878c-b5bb27935488 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:38.464946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc14874-166f-4e7e-878c-b5bb27935488 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:38.465227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc14874-166f-4e7e-878c-b5bb27935488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:38.490007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:38.531207 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc14874-166f-4e7e-878c-b5bb27935488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:38.532660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc14874-166f-4e7e-878c-b5bb27935488 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:38.627268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 550/1115] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:22:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:22:38.633100 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5083293-dcc1-43a0-b8d9-2f7621202dc2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:38.693434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:38.734763 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5083293-dcc1-43a0-b8d9-2f7621202dc2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:38.768623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670711e-c0c3-4303-b49e-c8fdd0dce759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:38.769254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670711e-c0c3-4303-b49e-c8fdd0dce759 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:38.769532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670711e-c0c3-4303-b49e-c8fdd0dce759 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:38.769803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670711e-c0c3-4303-b49e-c8fdd0dce759 None admin] PATH_INFO: `/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:38.770937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670711e-c0c3-4303-b49e-c8fdd0dce759 None admin] RBAC: Authorizing `identity:get_project(project_id=fb41f9a776c6454f90bcd6dd00a5bd1b)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:38.772385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670711e-c0c3-4303-b49e-c8fdd0dce759 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:38.774022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 566/1116] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:22:38 2022] GET /identity/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:38.780259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc14874-166f-4e7e-878c-b5bb27935488 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:38.835517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:38.878090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc14874-166f-4e7e-878c-b5bb27935488 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:38.910639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82ac05-1cfb-4d5b-8770-1abd041db224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:38.911248 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82ac05-1cfb-4d5b-8770-1abd041db224 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:38.911528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82ac05-1cfb-4d5b-8770-1abd041db224 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:38.911808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82ac05-1cfb-4d5b-8770-1abd041db224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:38.912612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82ac05-1cfb-4d5b-8770-1abd041db224 None admin] RBAC: Adding query filter params (role.id=84e73bacaaef4e4ab018e94824f9d891, scope.project.id=fb41f9a776c6454f90bcd6dd00a5bd1b, user.id=05ad16a57e0644848fa5b98bfea311e8) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:38.912925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82ac05-1cfb-4d5b-8770-1abd041db224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:38.914337 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82ac05-1cfb-4d5b-8770-1abd041db224 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:38.919544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 551/1117] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:22:38 2022] GET /identity/v3/role_assignments?user.id=05ad16a57e0644848fa5b98bfea311e8&scope.project.id=fb41f9a776c6454f90bcd6dd00a5bd1b&role.id=84e73bacaaef4e4ab018e94824f9d891 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:40.862127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22d75a-2ee5-4ece-8bc3-1a6879bfc39d None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:40.862677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22d75a-2ee5-4ece-8bc3-1a6879bfc39d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:40.862677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22d75a-2ee5-4ece-8bc3-1a6879bfc39d None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:40.864070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 567/1118] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:40.869116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780b006-d169-4a39-a457-2af0dba81e5a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:40.869542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780b006-d169-4a39-a457-2af0dba81e5a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:40.869658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780b006-d169-4a39-a457-2af0dba81e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:40.888057 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e780b006-d169-4a39-a457-2af0dba81e5a None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:40.889245 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e780b006-d169-4a39-a457-2af0dba81e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:40.953903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 552/1119] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:40.976724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22d75a-2ee5-4ece-8bc3-1a6879bfc39d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:41.074898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22d75a-2ee5-4ece-8bc3-1a6879bfc39d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:41.103915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:41.109734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710648b-4ea8-42f2-ba4b-06e3a7b462d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:41.110388 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710648b-4ea8-42f2-ba4b-06e3a7b462d7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:41.110671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710648b-4ea8-42f2-ba4b-06e3a7b462d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:41.110947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710648b-4ea8-42f2-ba4b-06e3a7b462d7 None admin] PATH_INFO: `/v3/roles/84e73bacaaef4e4ab018e94824f9d891` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:41.112414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710648b-4ea8-42f2-ba4b-06e3a7b462d7 None admin] RBAC: Authorizing `identity:get_role(role_id=84e73bacaaef4e4ab018e94824f9d891)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:41.113766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710648b-4ea8-42f2-ba4b-06e3a7b462d7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:41.115080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 568/1120] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:22:40 2022] GET /identity/v3/roles/84e73bacaaef4e4ab018e94824f9d891 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:41.120852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780b006-d169-4a39-a457-2af0dba81e5a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:41.168878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:41.216638 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780b006-d169-4a39-a457-2af0dba81e5a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:41.250095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff25572-0300-4e92-ae93-0854af792a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:41.250723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff25572-0300-4e92-ae93-0854af792a36 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:41.251005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff25572-0300-4e92-ae93-0854af792a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:41.251281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff25572-0300-4e92-ae93-0854af792a36 None admin] PATH_INFO: `/v3/users/05ad16a57e0644848fa5b98bfea311e8` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:41.252451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff25572-0300-4e92-ae93-0854af792a36 None admin] RBAC: Authorizing `identity:get_user(user_id=05ad16a57e0644848fa5b98bfea311e8)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:41.253868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff25572-0300-4e92-ae93-0854af792a36 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:41.255448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 553/1121] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:22:41 2022] GET /identity/v3/users/05ad16a57e0644848fa5b98bfea311e8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:41.261224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710648b-4ea8-42f2-ba4b-06e3a7b462d7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:41.358184 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710648b-4ea8-42f2-ba4b-06e3a7b462d7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:41.391207 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cce3a1-4f83-46ee-a235-f944ea14ee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:41.391840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce3a1-4f83-46ee-a235-f944ea14ee86 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:41.392155 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce3a1-4f83-46ee-a235-f944ea14ee86 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:41.392437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce3a1-4f83-46ee-a235-f944ea14ee86 None admin] PATH_INFO: `/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:41.393588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cce3a1-4f83-46ee-a235-f944ea14ee86 None admin] RBAC: Authorizing `identity:get_project(project_id=fb41f9a776c6454f90bcd6dd00a5bd1b)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:41.395016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cce3a1-4f83-46ee-a235-f944ea14ee86 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:41.396681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 569/1122] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:22:41 2022] GET /identity/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:41.402536 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff25572-0300-4e92-ae93-0854af792a36 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:41.500279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff25572-0300-4e92-ae93-0854af792a36 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:41.516516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:41.533273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919142e-60e2-4637-a45a-054da847d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:41.533926 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919142e-60e2-4637-a45a-054da847d1d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:41.534213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919142e-60e2-4637-a45a-054da847d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:41.534493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919142e-60e2-4637-a45a-054da847d1d2 None admin] PATH_INFO: `/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b/users/05ad16a57e0644848fa5b98bfea311e8/roles/84e73bacaaef4e4ab018e94824f9d891` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:41.536693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919142e-60e2-4637-a45a-054da847d1d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb41f9a776c6454f90bcd6dd00a5bd1b, user_id=05ad16a57e0644848fa5b98bfea311e8, role_id=84e73bacaaef4e4ab018e94824f9d891)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:41.538105 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919142e-60e2-4637-a45a-054da847d1d2 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:41.551022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 554/1123] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:22:41 2022] PUT /identity/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b/users/05ad16a57e0644848fa5b98bfea311e8/roles/84e73bacaaef4e4ab018e94824f9d891 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:22:43.507569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06503f-a3c6-458d-8d36-70cda3d75a17 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:43.508276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06503f-a3c6-458d-8d36-70cda3d75a17 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:43.508276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06503f-a3c6-458d-8d36-70cda3d75a17 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:43.509481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 570/1124] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:43.514527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fc95f-a94d-4881-a7d3-5d1a31c434ed None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:43.514947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fc95f-a94d-4881-a7d3-5d1a31c434ed None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:43.515651 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fc95f-a94d-4881-a7d3-5d1a31c434ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:43.533341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-643fc95f-a94d-4881-a7d3-5d1a31c434ed None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:43.534512 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-643fc95f-a94d-4881-a7d3-5d1a31c434ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:43.599268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 555/1125] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:43.622438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06503f-a3c6-458d-8d36-70cda3d75a17 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:43.688341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:43.722521 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06503f-a3c6-458d-8d36-70cda3d75a17 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:43.754681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18763b89-9050-492e-9380-6168a800c829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:43.755303 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18763b89-9050-492e-9380-6168a800c829 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:43.755583 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18763b89-9050-492e-9380-6168a800c829 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:43.755881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18763b89-9050-492e-9380-6168a800c829 None admin] PATH_INFO: `/v3/roles/84e73bacaaef4e4ab018e94824f9d891` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:43.757291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18763b89-9050-492e-9380-6168a800c829 None admin] RBAC: Authorizing `identity:get_role(role_id=84e73bacaaef4e4ab018e94824f9d891)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:43.758689 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18763b89-9050-492e-9380-6168a800c829 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:43.759990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 571/1126] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:22:43 2022] GET /identity/v3/roles/84e73bacaaef4e4ab018e94824f9d891 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:43.766369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fc95f-a94d-4881-a7d3-5d1a31c434ed None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:43.860759 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fc95f-a94d-4881-a7d3-5d1a31c434ed None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:43.869514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:43.894562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ba717-db6b-4474-ab46-f85a96d552cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:43.895192 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ba717-db6b-4474-ab46-f85a96d552cd None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:43.895473 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ba717-db6b-4474-ab46-f85a96d552cd None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:43.895747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ba717-db6b-4474-ab46-f85a96d552cd None admin] PATH_INFO: `/v3/users/05ad16a57e0644848fa5b98bfea311e8` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:43.896916 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ba717-db6b-4474-ab46-f85a96d552cd None admin] RBAC: Authorizing `identity:get_user(user_id=05ad16a57e0644848fa5b98bfea311e8)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:43.898333 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ba717-db6b-4474-ab46-f85a96d552cd None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:43.899931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 556/1127] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:22:43 2022] GET /identity/v3/users/05ad16a57e0644848fa5b98bfea311e8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:43.906282 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18763b89-9050-492e-9380-6168a800c829 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:44.003749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18763b89-9050-492e-9380-6168a800c829 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:44.037600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9504a-1780-4c37-9643-feef2b969c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:44.038146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9504a-1780-4c37-9643-feef2b969c1b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:44.038433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9504a-1780-4c37-9643-feef2b969c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:44.038713 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9504a-1780-4c37-9643-feef2b969c1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:44.042034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:44.105129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9504a-1780-4c37-9643-feef2b969c1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:44.106573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9504a-1780-4c37-9643-feef2b969c1b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:44.201194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 572/1128] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:22:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:22:44.207117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ba717-db6b-4474-ab46-f85a96d552cd None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:44.303695 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ba717-db6b-4474-ab46-f85a96d552cd None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:44.337532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ee090-3d0d-4377-9703-38239ebb9974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:44.338169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ee090-3d0d-4377-9703-38239ebb9974 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:44.338457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ee090-3d0d-4377-9703-38239ebb9974 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:44.338739 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ee090-3d0d-4377-9703-38239ebb9974 None admin] PATH_INFO: `/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:44.339914 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ee090-3d0d-4377-9703-38239ebb9974 None admin] RBAC: Authorizing `identity:get_project(project_id=fb41f9a776c6454f90bcd6dd00a5bd1b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:44.341344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ee090-3d0d-4377-9703-38239ebb9974 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:44.343044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 557/1129] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:22:44 2022] GET /identity/v3/projects/fb41f9a776c6454f90bcd6dd00a5bd1b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:44.350074 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9504a-1780-4c37-9643-feef2b969c1b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:44.383207 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:44.445494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9504a-1780-4c37-9643-feef2b969c1b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:44.479230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4380373-0087-4bc1-ab2b-8f04f71a0afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:44.479846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4380373-0087-4bc1-ab2b-8f04f71a0afc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:44.480157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4380373-0087-4bc1-ab2b-8f04f71a0afc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:44.480439 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4380373-0087-4bc1-ab2b-8f04f71a0afc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:44.481220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4380373-0087-4bc1-ab2b-8f04f71a0afc None admin] RBAC: Adding query filter params (role.id=84e73bacaaef4e4ab018e94824f9d891, scope.project.id=fb41f9a776c6454f90bcd6dd00a5bd1b, user.id=05ad16a57e0644848fa5b98bfea311e8) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:44.481534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4380373-0087-4bc1-ab2b-8f04f71a0afc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:44.482961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4380373-0087-4bc1-ab2b-8f04f71a0afc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:44.488908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 573/1130] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:22:44 2022] GET /identity/v3/role_assignments?user.id=05ad16a57e0644848fa5b98bfea311e8&scope.project.id=fb41f9a776c6454f90bcd6dd00a5bd1b&role.id=84e73bacaaef4e4ab018e94824f9d891 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:46.477015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb6a11-81e1-4a6d-b898-4e01edfb4e3d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:46.477574 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb6a11-81e1-4a6d-b898-4e01edfb4e3d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:46.477574 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb6a11-81e1-4a6d-b898-4e01edfb4e3d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:46.478898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 558/1131] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:46.484056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021df87-24ed-4988-9626-8d8486e80b34 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:46.484490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021df87-24ed-4988-9626-8d8486e80b34 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:46.484650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021df87-24ed-4988-9626-8d8486e80b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:46.503589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8021df87-24ed-4988-9626-8d8486e80b34 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:46.504798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8021df87-24ed-4988-9626-8d8486e80b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:46.569452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 574/1132] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:46.591797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb6a11-81e1-4a6d-b898-4e01edfb4e3d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:46.637873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:46.693129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb6a11-81e1-4a6d-b898-4e01edfb4e3d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:46.726523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c34f64-7134-48e2-a02a-b6e3e2012ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:46.727208 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34f64-7134-48e2-a02a-b6e3e2012ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:46.727444 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34f64-7134-48e2-a02a-b6e3e2012ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:46.727719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34f64-7134-48e2-a02a-b6e3e2012ec5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:46.728900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c34f64-7134-48e2-a02a-b6e3e2012ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:46.730320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c34f64-7134-48e2-a02a-b6e3e2012ec5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:46.731935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 559/1133] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:46.737870 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021df87-24ed-4988-9626-8d8486e80b34 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:46.766793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:46.835204 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021df87-24ed-4988-9626-8d8486e80b34 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:46.868289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00474e48-b369-45dd-a9cc-f8228cb15eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:46.868897 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474e48-b369-45dd-a9cc-f8228cb15eae None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:46.869179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474e48-b369-45dd-a9cc-f8228cb15eae None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:46.869456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474e48-b369-45dd-a9cc-f8228cb15eae None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:46.870132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00474e48-b369-45dd-a9cc-f8228cb15eae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:46.871559 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00474e48-b369-45dd-a9cc-f8228cb15eae None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:46.897138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 575/1134] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:22:46 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:22:48.902925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c7bef-d295-4441-9dba-6ba078880fa1 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:48.903449 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c7bef-d295-4441-9dba-6ba078880fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:48.903558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c7bef-d295-4441-9dba-6ba078880fa1 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:48.904936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 560/1135] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:48.910615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e093525-7d05-45d5-b745-8863a3142849 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:48.911036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e093525-7d05-45d5-b745-8863a3142849 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:48.911176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e093525-7d05-45d5-b745-8863a3142849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:48.929268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7e093525-7d05-45d5-b745-8863a3142849 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:48.930447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7e093525-7d05-45d5-b745-8863a3142849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:48.996812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 576/1136] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:49.021211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c7bef-d295-4441-9dba-6ba078880fa1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:49.119608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c7bef-d295-4441-9dba-6ba078880fa1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:49.132212 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:49.153538 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9b8c6-05e2-462c-a03f-01bbcdd89c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:49.154165 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9b8c6-05e2-462c-a03f-01bbcdd89c4b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:49.154453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9b8c6-05e2-462c-a03f-01bbcdd89c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:49.154735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9b8c6-05e2-462c-a03f-01bbcdd89c4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:49.156674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9b8c6-05e2-462c-a03f-01bbcdd89c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:49.158039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9b8c6-05e2-462c-a03f-01bbcdd89c4b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:49.159622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 561/1137] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:22:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:49.165308 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e093525-7d05-45d5-b745-8863a3142849 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:49.179605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:49.264704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e093525-7d05-45d5-b745-8863a3142849 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:49.297880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c33e68-b0f2-4566-b872-167b4a6535fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:49.298499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c33e68-b0f2-4566-b872-167b4a6535fb None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:49.298783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c33e68-b0f2-4566-b872-167b4a6535fb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:49.299067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c33e68-b0f2-4566-b872-167b4a6535fb None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:49.299815 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c33e68-b0f2-4566-b872-167b4a6535fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:49.301288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c33e68-b0f2-4566-b872-167b4a6535fb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:49.330325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 577/1138] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:22:49 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:22:51.397313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca1b7-8166-47bc-b537-f8a2151584c3 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:51.397853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca1b7-8166-47bc-b537-f8a2151584c3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:51.397853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca1b7-8166-47bc-b537-f8a2151584c3 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:51.399216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 562/1139] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:51.404267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950bd52-a4b9-438c-8745-be50221ff976 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:51.404674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950bd52-a4b9-438c-8745-be50221ff976 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:51.404820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950bd52-a4b9-438c-8745-be50221ff976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:51.423442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c950bd52-a4b9-438c-8745-be50221ff976 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:51.424655 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c950bd52-a4b9-438c-8745-be50221ff976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:51.484801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:51.490560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 578/1140] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:51.513327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ca1b7-8166-47bc-b537-f8a2151584c3 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:51.610440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ca1b7-8166-47bc-b537-f8a2151584c3 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:51.643986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca88bd-ed60-4261-abba-33cd4b648e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:51.644620 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca88bd-ed60-4261-abba-33cd4b648e1d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:51.644901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca88bd-ed60-4261-abba-33cd4b648e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:51.645174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca88bd-ed60-4261-abba-33cd4b648e1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:51.655021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca88bd-ed60-4261-abba-33cd4b648e1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-fcca88bd-ed60-4261-abba-33cd4b648e1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:22:51.660088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:51.661247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:51.662292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:51.662292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:51.662292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:51.662292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:51.662292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:22:51.662292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:22:51.662292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:22:51.662292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:22:51.662292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:22:51.662292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:22:51.662292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:22:51.662292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:51.662292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 563/1141] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:22:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:51.667238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950bd52-a4b9-438c-8745-be50221ff976 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:51.763339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950bd52-a4b9-438c-8745-be50221ff976 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:51.795374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067275bd-6c7e-48f3-8f9c-a5138f52e78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:51.796519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067275bd-6c7e-48f3-8f9c-a5138f52e78f None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:51.796803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067275bd-6c7e-48f3-8f9c-a5138f52e78f None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:51.797176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067275bd-6c7e-48f3-8f9c-a5138f52e78f None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:51.797885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067275bd-6c7e-48f3-8f9c-a5138f52e78f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:51.798189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067275bd-6c7e-48f3-8f9c-a5138f52e78f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:51.799543 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067275bd-6c7e-48f3-8f9c-a5138f52e78f None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:51.807242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 579/1142] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:22:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:51.812990 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca88bd-ed60-4261-abba-33cd4b648e1d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:51.855362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:51.911439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca88bd-ed60-4261-abba-33cd4b648e1d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:51.944607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c559313-37e4-4b14-a85c-7201ad71f0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:51.945229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c559313-37e4-4b14-a85c-7201ad71f0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:51.945516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c559313-37e4-4b14-a85c-7201ad71f0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:51.945790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c559313-37e4-4b14-a85c-7201ad71f0d8 None admin] PATH_INFO: `/v3/users/112ce1d6874d4ace914b285859354b2c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:51.958481 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c559313-37e4-4b14-a85c-7201ad71f0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=112ce1d6874d4ace914b285859354b2c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:51.959924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c559313-37e4-4b14-a85c-7201ad71f0d8 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:51.961511 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 564/1143] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:22:51 2022] GET /identity/v3/users/112ce1d6874d4ace914b285859354b2c => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:22:51.967417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067275bd-6c7e-48f3-8f9c-a5138f52e78f None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:52.025326 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:52.068080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067275bd-6c7e-48f3-8f9c-a5138f52e78f None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:52.100455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480676a-b6e9-4646-88f4-c78297c5f86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:52.101066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480676a-b6e9-4646-88f4-c78297c5f86a None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:52.101354 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480676a-b6e9-4646-88f4-c78297c5f86a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:52.101640 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480676a-b6e9-4646-88f4-c78297c5f86a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:52.169003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480676a-b6e9-4646-88f4-c78297c5f86a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:52.170392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480676a-b6e9-4646-88f4-c78297c5f86a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:52.226086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:52.266199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 580/1144] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:22:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:22:52.272066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c559313-37e4-4b14-a85c-7201ad71f0d8 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:52.365305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:52.368733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c559313-37e4-4b14-a85c-7201ad71f0d8 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:52.401106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b0d57-5df0-46c7-84b7-3a33e354f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:52.401744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b0d57-5df0-46c7-84b7-3a33e354f646 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:52.402033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b0d57-5df0-46c7-84b7-3a33e354f646 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:52.402314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b0d57-5df0-46c7-84b7-3a33e354f646 None admin] PATH_INFO: `/v3/projects/13182d4b6aec4595b29a6f5b5f514cf5` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:52.403477 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b0d57-5df0-46c7-84b7-3a33e354f646 None admin] RBAC: Authorizing `identity:get_project(project_id=13182d4b6aec4595b29a6f5b5f514cf5)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:52.404931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b0d57-5df0-46c7-84b7-3a33e354f646 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:52.407334 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 565/1145] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:22:52 2022] GET /identity/v3/projects/13182d4b6aec4595b29a6f5b5f514cf5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:52.413384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480676a-b6e9-4646-88f4-c78297c5f86a None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:52.508840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480676a-b6e9-4646-88f4-c78297c5f86a None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:52.542225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be0e6b-12e6-4458-b1f7-1e0dd256dcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:52.542829 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be0e6b-12e6-4458-b1f7-1e0dd256dcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:52.543113 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be0e6b-12e6-4458-b1f7-1e0dd256dcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:52.543388 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be0e6b-12e6-4458-b1f7-1e0dd256dcf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:52.544189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be0e6b-12e6-4458-b1f7-1e0dd256dcf5 None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=13182d4b6aec4595b29a6f5b5f514cf5, user.id=112ce1d6874d4ace914b285859354b2c) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:52.544499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be0e6b-12e6-4458-b1f7-1e0dd256dcf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:52.545920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be0e6b-12e6-4458-b1f7-1e0dd256dcf5 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:52.551197 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 581/1146] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:22:52 2022] GET /identity/v3/role_assignments?user.id=112ce1d6874d4ace914b285859354b2c&scope.project.id=13182d4b6aec4595b29a6f5b5f514cf5&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:54.513201 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a1f7f-d193-46c2-b26a-c1c38b57bd24 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:54.513772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a1f7f-d193-46c2-b26a-c1c38b57bd24 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:54.513772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a1f7f-d193-46c2-b26a-c1c38b57bd24 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:54.516034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 566/1147] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:54.521128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19162c15-01df-4a69-9b7b-8aef5e9255d1 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:54.521501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19162c15-01df-4a69-9b7b-8aef5e9255d1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:54.521693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19162c15-01df-4a69-9b7b-8aef5e9255d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:54.539580 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-19162c15-01df-4a69-9b7b-8aef5e9255d1 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:54.540794 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-19162c15-01df-4a69-9b7b-8aef5e9255d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:54.557663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:54.606137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 582/1148] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:54.628470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a1f7f-d193-46c2-b26a-c1c38b57bd24 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:54.728212 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a1f7f-d193-46c2-b26a-c1c38b57bd24 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:54.761587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0c4d0-328e-4036-9e36-a87bde81b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:54.762220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0c4d0-328e-4036-9e36-a87bde81b12a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:54.762510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0c4d0-328e-4036-9e36-a87bde81b12a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:54.762785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0c4d0-328e-4036-9e36-a87bde81b12a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:54.773489 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0c4d0-328e-4036-9e36-a87bde81b12a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-aac0c4d0-328e-4036-9e36-a87bde81b12a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:22:54.778328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:54.779425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:54.780646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:54.780646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:54.780646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:54.780646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:54.780646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:22:54.780646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:22:54.780646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:22:54.780646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:22:54.780646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:22:54.780646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:22:54.780646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:22:54.780646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:22:54.780646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 567/1149] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:22:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:54.785676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19162c15-01df-4a69-9b7b-8aef5e9255d1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:54.883193 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19162c15-01df-4a69-9b7b-8aef5e9255d1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:54.916089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbf71e-2bfe-4e59-bffd-c1528c8c80f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:54.916697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbf71e-2bfe-4e59-bffd-c1528c8c80f3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:54.916986 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbf71e-2bfe-4e59-bffd-c1528c8c80f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:54.917267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbf71e-2bfe-4e59-bffd-c1528c8c80f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:54.917975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbf71e-2bfe-4e59-bffd-c1528c8c80f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:54.918283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbf71e-2bfe-4e59-bffd-c1528c8c80f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:54.919648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbf71e-2bfe-4e59-bffd-c1528c8c80f3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:54.928067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 583/1150] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:22:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:54.933971 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0c4d0-328e-4036-9e36-a87bde81b12a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:54.961294 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:55.033173 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0c4d0-328e-4036-9e36-a87bde81b12a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:55.065397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5c8d3-b841-4d4a-a9e6-02c05ee01fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:55.066023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5c8d3-b841-4d4a-a9e6-02c05ee01fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:55.066303 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5c8d3-b841-4d4a-a9e6-02c05ee01fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:55.066576 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5c8d3-b841-4d4a-a9e6-02c05ee01fe0 None admin] PATH_INFO: `/v3/users/112ce1d6874d4ace914b285859354b2c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:55.067713 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5c8d3-b841-4d4a-a9e6-02c05ee01fe0 None admin] RBAC: Authorizing `identity:get_user(user_id=112ce1d6874d4ace914b285859354b2c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:55.069221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5c8d3-b841-4d4a-a9e6-02c05ee01fe0 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:55.070792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 568/1151] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:22:54 2022] GET /identity/v3/users/112ce1d6874d4ace914b285859354b2c => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:55.076566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbf71e-2bfe-4e59-bffd-c1528c8c80f3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:55.096152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:55.177404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbf71e-2bfe-4e59-bffd-c1528c8c80f3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:55.210516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c297f3e-06f3-45ed-9eb0-794be25c249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:55.211140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c297f3e-06f3-45ed-9eb0-794be25c249b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:55.211419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c297f3e-06f3-45ed-9eb0-794be25c249b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:55.211688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c297f3e-06f3-45ed-9eb0-794be25c249b None admin] PATH_INFO: `/v3/projects/13182d4b6aec4595b29a6f5b5f514cf5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:55.212836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c297f3e-06f3-45ed-9eb0-794be25c249b None admin] RBAC: Authorizing `identity:get_project(project_id=13182d4b6aec4595b29a6f5b5f514cf5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:55.214246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c297f3e-06f3-45ed-9eb0-794be25c249b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:55.215868 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 584/1152] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:22:55 2022] GET /identity/v3/projects/13182d4b6aec4595b29a6f5b5f514cf5 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:55.222213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5c8d3-b841-4d4a-a9e6-02c05ee01fe0 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:55.313221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:55.319908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5c8d3-b841-4d4a-a9e6-02c05ee01fe0 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:55.352856 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb73ed-b22a-462b-bc64-89ce84870c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:55.353510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb73ed-b22a-462b-bc64-89ce84870c5d None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:55.353795 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb73ed-b22a-462b-bc64-89ce84870c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:55.354071 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb73ed-b22a-462b-bc64-89ce84870c5d None admin] PATH_INFO: `/v3/projects/13182d4b6aec4595b29a6f5b5f514cf5/users/112ce1d6874d4ace914b285859354b2c/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:55.356008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb73ed-b22a-462b-bc64-89ce84870c5d None admin] RBAC: Authorizing `identity:create_grant(project_id=13182d4b6aec4595b29a6f5b5f514cf5, user_id=112ce1d6874d4ace914b285859354b2c, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:55.357429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb73ed-b22a-462b-bc64-89ce84870c5d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:55.370453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 569/1153] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:22:55 2022] PUT /identity/v3/projects/13182d4b6aec4595b29a6f5b5f514cf5/users/112ce1d6874d4ace914b285859354b2c/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:22:57.346993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba3a3c-9013-4f41-afb9-1d98f1cba2cc None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:57.347526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba3a3c-9013-4f41-afb9-1d98f1cba2cc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:57.347526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba3a3c-9013-4f41-afb9-1d98f1cba2cc None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:57.348948 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 585/1154] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:22:57.354088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b0219-9284-4478-a493-1363a91202ac None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:57.354494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b0219-9284-4478-a493-1363a91202ac None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:57.354643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b0219-9284-4478-a493-1363a91202ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:57.372667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6a5b0219-9284-4478-a493-1363a91202ac None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:22:57.373834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6a5b0219-9284-4478-a493-1363a91202ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:22:57.441850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 570/1155] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:22:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:22:57.465481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba3a3c-9013-4f41-afb9-1d98f1cba2cc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:57.548574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:57.565637 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba3a3c-9013-4f41-afb9-1d98f1cba2cc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:57.598655 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f5c75-1e76-457b-80ca-d18c34b34ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:57.599218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f5c75-1e76-457b-80ca-d18c34b34ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:57.599503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f5c75-1e76-457b-80ca-d18c34b34ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:57.599780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f5c75-1e76-457b-80ca-d18c34b34ad2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:57.610138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f5c75-1e76-457b-80ca-d18c34b34ad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-710f5c75-1e76-457b-80ca-d18c34b34ad2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:22:57.615038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:22:57.616141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:22:57.617305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:22:57.617305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:22:57.617305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:22:57.617305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:22:57.617305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:22:57.617305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:22:57.617305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:22:57.617305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:22:57.617305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:22:57.617305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:22:57.617305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:22:57.617305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:22:57.617305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 586/1156] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:22:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:22:57.622162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b0219-9284-4478-a493-1363a91202ac None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:57.707120 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:57.723531 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b0219-9284-4478-a493-1363a91202ac None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:57.756289 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10258fb0-25f9-42b3-a9f4-3ca03eb91200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:57.756906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10258fb0-25f9-42b3-a9f4-3ca03eb91200 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:57.757193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10258fb0-25f9-42b3-a9f4-3ca03eb91200 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:57.757472 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10258fb0-25f9-42b3-a9f4-3ca03eb91200 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:57.758184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10258fb0-25f9-42b3-a9f4-3ca03eb91200 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:57.758493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10258fb0-25f9-42b3-a9f4-3ca03eb91200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:57.759873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10258fb0-25f9-42b3-a9f4-3ca03eb91200 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:57.768403 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 571/1157] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:22:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:57.774139 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f5c75-1e76-457b-80ca-d18c34b34ad2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:57.871241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f5c75-1e76-457b-80ca-d18c34b34ad2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:57.903602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ff484-c44c-4ed3-bfc2-76df86486868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:57.904255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ff484-c44c-4ed3-bfc2-76df86486868 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:57.904539 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ff484-c44c-4ed3-bfc2-76df86486868 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:57.904814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ff484-c44c-4ed3-bfc2-76df86486868 None admin] PATH_INFO: `/v3/users/112ce1d6874d4ace914b285859354b2c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:57.906237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ff484-c44c-4ed3-bfc2-76df86486868 None admin] RBAC: Authorizing `identity:get_user(user_id=112ce1d6874d4ace914b285859354b2c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:57.907660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ff484-c44c-4ed3-bfc2-76df86486868 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:57.909263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 587/1158] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:22:57 2022] GET /identity/v3/users/112ce1d6874d4ace914b285859354b2c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:57.914919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10258fb0-25f9-42b3-a9f4-3ca03eb91200 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:58.012158 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10258fb0-25f9-42b3-a9f4-3ca03eb91200 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:58.043682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef9469-e6f8-4b7d-a199-355f474cc71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:58.044317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef9469-e6f8-4b7d-a199-355f474cc71d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:58.044600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef9469-e6f8-4b7d-a199-355f474cc71d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:58.044876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef9469-e6f8-4b7d-a199-355f474cc71d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:58.059668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:58.109830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef9469-e6f8-4b7d-a199-355f474cc71d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:58.111252 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef9469-e6f8-4b7d-a199-355f474cc71d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:58.205167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 572/1159] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:22:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 16:22:58.210915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ff484-c44c-4ed3-bfc2-76df86486868 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:58.226518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:58.308360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ff484-c44c-4ed3-bfc2-76df86486868 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:58.340036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848c0dc-b8f7-4b61-ab7b-c2c4ee83da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:58.340657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848c0dc-b8f7-4b61-ab7b-c2c4ee83da0e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:58.340946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848c0dc-b8f7-4b61-ab7b-c2c4ee83da0e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:58.341224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848c0dc-b8f7-4b61-ab7b-c2c4ee83da0e None admin] PATH_INFO: `/v3/projects/13182d4b6aec4595b29a6f5b5f514cf5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:58.342364 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848c0dc-b8f7-4b61-ab7b-c2c4ee83da0e None admin] RBAC: Authorizing `identity:get_project(project_id=13182d4b6aec4595b29a6f5b5f514cf5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:58.344611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848c0dc-b8f7-4b61-ab7b-c2c4ee83da0e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:58.346244 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 588/1160] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:22:58 2022] GET /identity/v3/projects/13182d4b6aec4595b29a6f5b5f514cf5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:22:58.352298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef9469-e6f8-4b7d-a199-355f474cc71d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:22:58.397110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:22:58.449073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef9469-e6f8-4b7d-a199-355f474cc71d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:22:58.483265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500d7fd-a325-42c9-8c59-9e30c2a85f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:22:58.484698 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500d7fd-a325-42c9-8c59-9e30c2a85f6c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:22:58.484994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500d7fd-a325-42c9-8c59-9e30c2a85f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:22:58.485275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500d7fd-a325-42c9-8c59-9e30c2a85f6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:22:58.486451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500d7fd-a325-42c9-8c59-9e30c2a85f6c None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=13182d4b6aec4595b29a6f5b5f514cf5, user.id=112ce1d6874d4ace914b285859354b2c) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:22:58.486843 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500d7fd-a325-42c9-8c59-9e30c2a85f6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:22:58.488503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500d7fd-a325-42c9-8c59-9e30c2a85f6c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:22:58.494467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 573/1161] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:22:58 2022] GET /identity/v3/role_assignments?user.id=112ce1d6874d4ace914b285859354b2c&scope.project.id=13182d4b6aec4595b29a6f5b5f514cf5&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:00.534675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d6d6-11e9-4af2-8779-dc3f67f37757 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:00.535235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d6d6-11e9-4af2-8779-dc3f67f37757 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:00.535349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d6d6-11e9-4af2-8779-dc3f67f37757 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:00.536668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 589/1162] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:23:00.541745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21415066-f484-45d7-8f00-8b9c917d4ce2 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:00.542114 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21415066-f484-45d7-8f00-8b9c917d4ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:00.542317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21415066-f484-45d7-8f00-8b9c917d4ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:00.560558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-21415066-f484-45d7-8f00-8b9c917d4ce2 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:23:00.562272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-21415066-f484-45d7-8f00-8b9c917d4ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:23:00.627698 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 574/1163] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:23:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:23:00.649545 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8d6d6-11e9-4af2-8779-dc3f67f37757 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:00.729446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:00.753703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8d6d6-11e9-4af2-8779-dc3f67f37757 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:00.786607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a09120-f9b2-40d7-b07b-8408b1ee4bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:00.787154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a09120-f9b2-40d7-b07b-8408b1ee4bdc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:00.787432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a09120-f9b2-40d7-b07b-8408b1ee4bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:00.787703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a09120-f9b2-40d7-b07b-8408b1ee4bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:00.853903 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a09120-f9b2-40d7-b07b-8408b1ee4bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:00.855332 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a09120-f9b2-40d7-b07b-8408b1ee4bdc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:00.931516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:00.950830 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 590/1164] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:23:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:23:00.957421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21415066-f484-45d7-8f00-8b9c917d4ce2 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:00.997139 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:01.053302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21415066-f484-45d7-8f00-8b9c917d4ce2 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:01.085570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1eff7-1fae-40b7-93c0-f339f5088728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:01.086193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1eff7-1fae-40b7-93c0-f339f5088728 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:01.086473 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1eff7-1fae-40b7-93c0-f339f5088728 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:01.086743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1eff7-1fae-40b7-93c0-f339f5088728 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:01.093705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1eff7-1fae-40b7-93c0-f339f5088728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:01.095375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1eff7-1fae-40b7-93c0-f339f5088728 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-7aa1eff7-1fae-40b7-93c0-f339f5088728 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:23:01.106387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:23:01.107566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:23:01.108752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 575/1165] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 16:23:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:23:01.114064 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a09120-f9b2-40d7-b07b-8408b1ee4bdc None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:01.225094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a09120-f9b2-40d7-b07b-8408b1ee4bdc None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:01.257576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d3112-1e96-46c5-af53-c6ba77904317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:01.258177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d3112-1e96-46c5-af53-c6ba77904317 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:01.258455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d3112-1e96-46c5-af53-c6ba77904317 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:01.258725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d3112-1e96-46c5-af53-c6ba77904317 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:01.259401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d3112-1e96-46c5-af53-c6ba77904317 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:23:01.259701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d3112-1e96-46c5-af53-c6ba77904317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:01.261073 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d3112-1e96-46c5-af53-c6ba77904317 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:01.268525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 591/1166] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 16:23:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:03.267920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38201f4f-57ba-4d7c-a3c5-b9c8ccdbc88f None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:03.269801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38201f4f-57ba-4d7c-a3c5-b9c8ccdbc88f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:03.269801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38201f4f-57ba-4d7c-a3c5-b9c8ccdbc88f None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:03.270027 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 576/1167] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:23:03.275167 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ff29a-a170-4d5e-a6fd-85f51b743bcb None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:03.275623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ff29a-a170-4d5e-a6fd-85f51b743bcb None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:03.275724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ff29a-a170-4d5e-a6fd-85f51b743bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:03.294153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7d8ff29a-a170-4d5e-a6fd-85f51b743bcb None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:23:03.295322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7d8ff29a-a170-4d5e-a6fd-85f51b743bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:23:03.333493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:03.360289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 592/1168] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:23:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:23:03.383045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38201f4f-57ba-4d7c-a3c5-b9c8ccdbc88f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:03.478769 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:03.482848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38201f4f-57ba-4d7c-a3c5-b9c8ccdbc88f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:03.516261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76de28-e4e9-4616-8a51-23e145480809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:03.516873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76de28-e4e9-4616-8a51-23e145480809 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:03.517160 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76de28-e4e9-4616-8a51-23e145480809 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:03.517440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76de28-e4e9-4616-8a51-23e145480809 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:03.518186 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76de28-e4e9-4616-8a51-23e145480809 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:03.519483 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76de28-e4e9-4616-8a51-23e145480809 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:03.534636 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 577/1169] 10.222.0.67 () {60 vars in 1138 bytes} [Wed Jul 27 16:23:03 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:23:05.593436 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e153cf-3426-431f-8f3e-153c1bcee3b2 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:05.594246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e153cf-3426-431f-8f3e-153c1bcee3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:05.594246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e153cf-3426-431f-8f3e-153c1bcee3b2 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:05.595589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 593/1170] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:23:05.600840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85767dc2-5014-446b-8acf-2326e15499a2 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:05.601283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85767dc2-5014-446b-8acf-2326e15499a2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:05.601411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85767dc2-5014-446b-8acf-2326e15499a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:05.619775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-85767dc2-5014-446b-8acf-2326e15499a2 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:23:05.620984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-85767dc2-5014-446b-8acf-2326e15499a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:23:05.686903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 578/1171] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:23:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:23:05.709553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e153cf-3426-431f-8f3e-153c1bcee3b2 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:05.809203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e153cf-3426-431f-8f3e-153c1bcee3b2 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:05.841389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49229446-554b-4a6b-89cf-603dddab6632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:05.842014 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49229446-554b-4a6b-89cf-603dddab6632 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:05.842301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49229446-554b-4a6b-89cf-603dddab6632 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:05.843084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49229446-554b-4a6b-89cf-603dddab6632 None admin] PATH_INFO: `/v3/domains/777e8b58d5754b5b94cf6f76cd771413` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:05.853779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49229446-554b-4a6b-89cf-603dddab6632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=777e8b58d5754b5b94cf6f76cd771413)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:05.855165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49229446-554b-4a6b-89cf-603dddab6632 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:05.856806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 594/1172] 10.222.0.67 () {56 vars in 1183 bytes} [Wed Jul 27 16:23:05 2022] GET /identity/v3/domains/777e8b58d5754b5b94cf6f76cd771413 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:05.862820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85767dc2-5014-446b-8acf-2326e15499a2 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:05.950096 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:05.961420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85767dc2-5014-446b-8acf-2326e15499a2 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:05.994088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee21959-ed97-40bb-ac71-a7f11670ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:05.994699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee21959-ed97-40bb-ac71-a7f11670ded6 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:05.994988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee21959-ed97-40bb-ac71-a7f11670ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:05.995266 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee21959-ed97-40bb-ac71-a7f11670ded6 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:05.995974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee21959-ed97-40bb-ac71-a7f11670ded6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:05.997389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee21959-ed97-40bb-ac71-a7f11670ded6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:06.023026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 579/1173] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:23:05 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:23:08.016710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78a9dd-5be7-433f-9b83-f9f78aef9730 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:08.017254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78a9dd-5be7-433f-9b83-f9f78aef9730 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:08.017254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78a9dd-5be7-433f-9b83-f9f78aef9730 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:08.018608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 595/1174] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:23:08.023807 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d391c-0e5e-4579-a38a-0558329d4db9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:08.024259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d391c-0e5e-4579-a38a-0558329d4db9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:08.024400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d391c-0e5e-4579-a38a-0558329d4db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:08.043325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-316d391c-0e5e-4579-a38a-0558329d4db9 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:23:08.044550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-316d391c-0e5e-4579-a38a-0558329d4db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:23:08.109463 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 580/1175] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:23:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:23:08.133172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78a9dd-5be7-433f-9b83-f9f78aef9730 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:08.168278 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:08.234460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78a9dd-5be7-433f-9b83-f9f78aef9730 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:08.268598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7d0ca-fc65-46e0-bfd3-652af10ec879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:08.269168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7d0ca-fc65-46e0-bfd3-652af10ec879 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:08.269454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7d0ca-fc65-46e0-bfd3-652af10ec879 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:08.269732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7d0ca-fc65-46e0-bfd3-652af10ec879 None admin] PATH_INFO: `/v3/domains/777e8b58d5754b5b94cf6f76cd771413` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:08.270872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7d0ca-fc65-46e0-bfd3-652af10ec879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=777e8b58d5754b5b94cf6f76cd771413)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:08.272327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7d0ca-fc65-46e0-bfd3-652af10ec879 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:08.273904 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 596/1176] 10.222.0.67 () {56 vars in 1183 bytes} [Wed Jul 27 16:23:08 2022] GET /identity/v3/domains/777e8b58d5754b5b94cf6f76cd771413 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:08.279575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d391c-0e5e-4579-a38a-0558329d4db9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:08.346788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:08.375046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d391c-0e5e-4579-a38a-0558329d4db9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:08.407720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6557c-e5bb-4db1-8406-b37a1345e648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:08.408355 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6557c-e5bb-4db1-8406-b37a1345e648 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:08.408634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6557c-e5bb-4db1-8406-b37a1345e648 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:08.408901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6557c-e5bb-4db1-8406-b37a1345e648 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:08.409580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6557c-e5bb-4db1-8406-b37a1345e648 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:08.410978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6557c-e5bb-4db1-8406-b37a1345e648 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:08.431381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 581/1177] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:23:08 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:23:10.460840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dce7d-070d-4a7c-bb0e-e5fed28d2e29 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:10.461425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dce7d-070d-4a7c-bb0e-e5fed28d2e29 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:10.461425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dce7d-070d-4a7c-bb0e-e5fed28d2e29 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:10.462742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 597/1178] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:23:10.468673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ac0db-9381-4b89-9ec4-8838347f905a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:10.469372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ac0db-9381-4b89-9ec4-8838347f905a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:10.469372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ac0db-9381-4b89-9ec4-8838347f905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:10.487773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a47ac0db-9381-4b89-9ec4-8838347f905a None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:23:10.488995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a47ac0db-9381-4b89-9ec4-8838347f905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:23:10.553525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 582/1179] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:23:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:23:10.576384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dce7d-070d-4a7c-bb0e-e5fed28d2e29 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:10.677153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dce7d-070d-4a7c-bb0e-e5fed28d2e29 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:10.678630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:10.711317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4739c-8e8e-4015-a154-d347fb9b19d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:10.711904 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4739c-8e8e-4015-a154-d347fb9b19d1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:10.712188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4739c-8e8e-4015-a154-d347fb9b19d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:10.712460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4739c-8e8e-4015-a154-d347fb9b19d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:10.723290 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4739c-8e8e-4015-a154-d347fb9b19d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-e2f4739c-8e8e-4015-a154-d347fb9b19d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:23:10.728156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:23:10.729317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:23:10.730581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:23:10.730581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:23:10.730581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:23:10.730581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:23:10.730581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:23:10.730581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:23:10.730581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:23:10.730581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:23:10.730581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:23:10.730581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:23:10.730581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:23:10.730581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:23:10.730581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 598/1180] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:23:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:23:10.735825 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ac0db-9381-4b89-9ec4-8838347f905a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:10.790516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:10.831736 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ac0db-9381-4b89-9ec4-8838347f905a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:10.864119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f50585-1c0a-4946-93d6-110302464e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:10.864724 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50585-1c0a-4946-93d6-110302464e4d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:10.865002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50585-1c0a-4946-93d6-110302464e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:10.865272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50585-1c0a-4946-93d6-110302464e4d None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:10.865980 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f50585-1c0a-4946-93d6-110302464e4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:23:10.866282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f50585-1c0a-4946-93d6-110302464e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:10.867615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f50585-1c0a-4946-93d6-110302464e4d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:10.876010 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 583/1181] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:23:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:10.881792 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4739c-8e8e-4015-a154-d347fb9b19d1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:10.978123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4739c-8e8e-4015-a154-d347fb9b19d1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:11.010022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892a4a8-a752-4e1f-a14a-fb081bf6d2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:11.010636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892a4a8-a752-4e1f-a14a-fb081bf6d2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:11.010915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892a4a8-a752-4e1f-a14a-fb081bf6d2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:11.011188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892a4a8-a752-4e1f-a14a-fb081bf6d2c1 None admin] PATH_INFO: `/v3/users/d9f8e63527db4d67bdae97b2678e47f9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:11.024286 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892a4a8-a752-4e1f-a14a-fb081bf6d2c1 None admin] RBAC: Authorizing `identity:get_user(user_id=d9f8e63527db4d67bdae97b2678e47f9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:11.025758 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892a4a8-a752-4e1f-a14a-fb081bf6d2c1 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:11.027383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 599/1182] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:23:10 2022] GET /identity/v3/users/d9f8e63527db4d67bdae97b2678e47f9 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:11.033634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f50585-1c0a-4946-93d6-110302464e4d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:11.128744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f50585-1c0a-4946-93d6-110302464e4d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:11.147261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:11.161287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ea77-608c-446f-918e-cb367a3a6fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:11.161889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ea77-608c-446f-918e-cb367a3a6fcf None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:11.162168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ea77-608c-446f-918e-cb367a3a6fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:11.162438 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ea77-608c-446f-918e-cb367a3a6fcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:11.226708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6ea77-608c-446f-918e-cb367a3a6fcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:11.228222 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6ea77-608c-446f-918e-cb367a3a6fcf None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:11.321571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 584/1183] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:23:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:23:11.327975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892a4a8-a752-4e1f-a14a-fb081bf6d2c1 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:11.349821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:11.428283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892a4a8-a752-4e1f-a14a-fb081bf6d2c1 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:11.461456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb9539-e519-4762-bdba-951603b4043d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:11.462090 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb9539-e519-4762-bdba-951603b4043d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:11.462374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb9539-e519-4762-bdba-951603b4043d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:11.462651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb9539-e519-4762-bdba-951603b4043d None admin] PATH_INFO: `/v3/projects/2815bf7d99eb4d3f98077f3b51385fd7` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:11.463795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb9539-e519-4762-bdba-951603b4043d None admin] RBAC: Authorizing `identity:get_project(project_id=2815bf7d99eb4d3f98077f3b51385fd7)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:11.465252 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb9539-e519-4762-bdba-951603b4043d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:11.466897 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 600/1184] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:23:11 2022] GET /identity/v3/projects/2815bf7d99eb4d3f98077f3b51385fd7 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:11.473812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ea77-608c-446f-918e-cb367a3a6fcf None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:11.494061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:11.570771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ea77-608c-446f-918e-cb367a3a6fcf None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:11.604642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97382516-4eea-4a82-96b1-f87017abfc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:11.605247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97382516-4eea-4a82-96b1-f87017abfc6b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:11.605533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97382516-4eea-4a82-96b1-f87017abfc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:11.605811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97382516-4eea-4a82-96b1-f87017abfc6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:11.606586 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97382516-4eea-4a82-96b1-f87017abfc6b None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=2815bf7d99eb4d3f98077f3b51385fd7, user.id=d9f8e63527db4d67bdae97b2678e47f9) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:23:11.606898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97382516-4eea-4a82-96b1-f87017abfc6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:11.608361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97382516-4eea-4a82-96b1-f87017abfc6b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:11.613575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 585/1185] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:23:11 2022] GET /identity/v3/role_assignments?user.id=d9f8e63527db4d67bdae97b2678e47f9&scope.project.id=2815bf7d99eb4d3f98077f3b51385fd7&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:13.544265 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a423c-5e09-48f3-b129-80a3ee7eedf9 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:13.544800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a423c-5e09-48f3-b129-80a3ee7eedf9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:13.544800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a423c-5e09-48f3-b129-80a3ee7eedf9 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:13.546670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 601/1186] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:23:13.551794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef21c6-43f3-4cf3-980a-5196af207f43 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:13.552235 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef21c6-43f3-4cf3-980a-5196af207f43 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:13.552370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef21c6-43f3-4cf3-980a-5196af207f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:13.570567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7aef21c6-43f3-4cf3-980a-5196af207f43 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:23:13.571768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7aef21c6-43f3-4cf3-980a-5196af207f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:23:13.635339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 586/1187] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:23:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:23:13.657011 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a423c-5e09-48f3-b129-80a3ee7eedf9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:13.743323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:13.757149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a423c-5e09-48f3-b129-80a3ee7eedf9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:13.789607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd3f01-6283-46cc-a476-1301007782a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:13.790233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd3f01-6283-46cc-a476-1301007782a9 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:13.790521 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd3f01-6283-46cc-a476-1301007782a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:13.790801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd3f01-6283-46cc-a476-1301007782a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:13.801439 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd3f01-6283-46cc-a476-1301007782a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-3bdd3f01-6283-46cc-a476-1301007782a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:23:13.806359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:23:13.807477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:23:13.808399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:23:13.808399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:23:13.808399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:23:13.808399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:23:13.808399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:23:13.808399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:23:13.808399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:23:13.808399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:23:13.808399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:23:13.808399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:23:13.808399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:23:13.808399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:23:13.808399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 602/1188] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:23:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:23:13.814019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef21c6-43f3-4cf3-980a-5196af207f43 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:13.828650 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:13.910312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef21c6-43f3-4cf3-980a-5196af207f43 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:13.943138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1fda9-b245-4dae-823f-2a0d13100741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:13.943742 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1fda9-b245-4dae-823f-2a0d13100741 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:13.944058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1fda9-b245-4dae-823f-2a0d13100741 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:13.944340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1fda9-b245-4dae-823f-2a0d13100741 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:13.945050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1fda9-b245-4dae-823f-2a0d13100741 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:23:13.945358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1fda9-b245-4dae-823f-2a0d13100741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:13.946714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1fda9-b245-4dae-823f-2a0d13100741 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:13.954527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 587/1189] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:23:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:13.960216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd3f01-6283-46cc-a476-1301007782a9 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:14.059226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd3f01-6283-46cc-a476-1301007782a9 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:14.091794 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12824ac6-766e-4268-a222-5cf6d08e23ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:14.092453 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12824ac6-766e-4268-a222-5cf6d08e23ac None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:14.093469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12824ac6-766e-4268-a222-5cf6d08e23ac None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:14.093891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12824ac6-766e-4268-a222-5cf6d08e23ac None admin] PATH_INFO: `/v3/users/d9f8e63527db4d67bdae97b2678e47f9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:14.095321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12824ac6-766e-4268-a222-5cf6d08e23ac None admin] RBAC: Authorizing `identity:get_user(user_id=d9f8e63527db4d67bdae97b2678e47f9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:14.096780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12824ac6-766e-4268-a222-5cf6d08e23ac None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:14.098369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 603/1190] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:23:13 2022] GET /identity/v3/users/d9f8e63527db4d67bdae97b2678e47f9 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:14.104005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1fda9-b245-4dae-823f-2a0d13100741 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:14.179921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:14.201954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1fda9-b245-4dae-823f-2a0d13100741 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:14.235378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4168bd-947e-4128-b0a3-6317b8952529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:14.236034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4168bd-947e-4128-b0a3-6317b8952529 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:14.236324 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4168bd-947e-4128-b0a3-6317b8952529 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:14.236601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4168bd-947e-4128-b0a3-6317b8952529 None admin] PATH_INFO: `/v3/projects/2815bf7d99eb4d3f98077f3b51385fd7` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:14.237748 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4168bd-947e-4128-b0a3-6317b8952529 None admin] RBAC: Authorizing `identity:get_project(project_id=2815bf7d99eb4d3f98077f3b51385fd7)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:14.239160 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4168bd-947e-4128-b0a3-6317b8952529 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:14.240893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 588/1191] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:23:14 2022] GET /identity/v3/projects/2815bf7d99eb4d3f98077f3b51385fd7 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:14.246697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12824ac6-766e-4268-a222-5cf6d08e23ac None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:14.264958 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:14.345374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12824ac6-766e-4268-a222-5cf6d08e23ac None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:14.378835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409aabd-52e0-4ce0-b741-7b97699e7b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:14.379489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409aabd-52e0-4ce0-b741-7b97699e7b1b None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:14.379771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409aabd-52e0-4ce0-b741-7b97699e7b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:14.380071 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409aabd-52e0-4ce0-b741-7b97699e7b1b None admin] PATH_INFO: `/v3/projects/2815bf7d99eb4d3f98077f3b51385fd7/users/d9f8e63527db4d67bdae97b2678e47f9/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:14.381975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409aabd-52e0-4ce0-b741-7b97699e7b1b None admin] RBAC: Authorizing `identity:create_grant(project_id=2815bf7d99eb4d3f98077f3b51385fd7, user_id=d9f8e63527db4d67bdae97b2678e47f9, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:14.383403 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409aabd-52e0-4ce0-b741-7b97699e7b1b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:14.395744 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 604/1192] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:23:14 2022] PUT /identity/v3/projects/2815bf7d99eb4d3f98077f3b51385fd7/users/d9f8e63527db4d67bdae97b2678e47f9/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:23:16.350935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89601a-7f1b-4458-9b8a-fc7707471c5e None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:16.351468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89601a-7f1b-4458-9b8a-fc7707471c5e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:16.351468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89601a-7f1b-4458-9b8a-fc7707471c5e None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:16.352877 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 589/1193] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:23:16.357912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bf336-8d25-4412-a1c2-ee3e843887ff None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:16.358491 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bf336-8d25-4412-a1c2-ee3e843887ff None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:16.358642 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bf336-8d25-4412-a1c2-ee3e843887ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:16.377169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-646bf336-8d25-4412-a1c2-ee3e843887ff None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:23:16.378328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-646bf336-8d25-4412-a1c2-ee3e843887ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:23:16.442567 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 605/1194] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:23:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:23:16.465962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89601a-7f1b-4458-9b8a-fc7707471c5e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:16.565655 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89601a-7f1b-4458-9b8a-fc7707471c5e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:16.598682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea20992-7aec-4db2-8971-70349633ca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:16.599306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea20992-7aec-4db2-8971-70349633ca3c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:16.599588 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea20992-7aec-4db2-8971-70349633ca3c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:16.599890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea20992-7aec-4db2-8971-70349633ca3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:16.610119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea20992-7aec-4db2-8971-70349633ca3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-5ea20992-7aec-4db2-8971-70349633ca3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:23:16.614920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:23:16.616092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:23:16.616966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:23:16.616966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:23:16.616966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:23:16.616966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:23:16.616966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:23:16.616966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:23:16.616966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:23:16.616966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:23:16.616966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:23:16.616966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:23:16.616966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:23:16.616966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:23:16.616966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 590/1195] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:23:16.621939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bf336-8d25-4412-a1c2-ee3e843887ff None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:16.630517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:16.728759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bf336-8d25-4412-a1c2-ee3e843887ff None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:16.762863 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b3332-3224-4012-aa37-32a3b7264bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:16.763477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b3332-3224-4012-aa37-32a3b7264bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:16.763761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b3332-3224-4012-aa37-32a3b7264bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:16.764066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b3332-3224-4012-aa37-32a3b7264bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:16.764826 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b3332-3224-4012-aa37-32a3b7264bf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:23:16.765131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b3332-3224-4012-aa37-32a3b7264bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:16.766499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b3332-3224-4012-aa37-32a3b7264bf6 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:16.774308 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 606/1196] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:16.780366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea20992-7aec-4db2-8971-70349633ca3c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:16.784980 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:16.879410 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea20992-7aec-4db2-8971-70349633ca3c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:16.912714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fef1df-4667-4766-8ad3-d34ece7e6d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:16.913342 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fef1df-4667-4766-8ad3-d34ece7e6d19 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:16.913627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fef1df-4667-4766-8ad3-d34ece7e6d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:16.913906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fef1df-4667-4766-8ad3-d34ece7e6d19 None admin] PATH_INFO: `/v3/users/d9f8e63527db4d67bdae97b2678e47f9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:16.915052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fef1df-4667-4766-8ad3-d34ece7e6d19 None admin] RBAC: Authorizing `identity:get_user(user_id=d9f8e63527db4d67bdae97b2678e47f9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:16.916501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fef1df-4667-4766-8ad3-d34ece7e6d19 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:16.918080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 591/1197] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 16:23:16 2022] GET /identity/v3/users/d9f8e63527db4d67bdae97b2678e47f9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:16.924366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b3332-3224-4012-aa37-32a3b7264bf6 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:16.989162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:17.021222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b3332-3224-4012-aa37-32a3b7264bf6 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:17.054427 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571fa47-b66c-4e04-84e0-1a5bbf95a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:17.055039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571fa47-b66c-4e04-84e0-1a5bbf95a506 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:17.055325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571fa47-b66c-4e04-84e0-1a5bbf95a506 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:17.055602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571fa47-b66c-4e04-84e0-1a5bbf95a506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:17.120497 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571fa47-b66c-4e04-84e0-1a5bbf95a506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:17.121933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571fa47-b66c-4e04-84e0-1a5bbf95a506 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:17.182550 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:17.218463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 607/1198] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:23:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:23:17.224741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fef1df-4667-4766-8ad3-d34ece7e6d19 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:17.298540 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:17.327626 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fef1df-4667-4766-8ad3-d34ece7e6d19 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:17.360456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14326184-7249-472c-9211-34f85c6d78c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:17.361094 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14326184-7249-472c-9211-34f85c6d78c4 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:17.361375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14326184-7249-472c-9211-34f85c6d78c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:17.361650 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14326184-7249-472c-9211-34f85c6d78c4 None admin] PATH_INFO: `/v3/projects/2815bf7d99eb4d3f98077f3b51385fd7` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:17.362799 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14326184-7249-472c-9211-34f85c6d78c4 None admin] RBAC: Authorizing `identity:get_project(project_id=2815bf7d99eb4d3f98077f3b51385fd7)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:17.364237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14326184-7249-472c-9211-34f85c6d78c4 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:17.365894 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 592/1199] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 16:23:17 2022] GET /identity/v3/projects/2815bf7d99eb4d3f98077f3b51385fd7 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:17.372235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571fa47-b66c-4e04-84e0-1a5bbf95a506 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:23:17.469844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571fa47-b66c-4e04-84e0-1a5bbf95a506 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:23:17.502681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f990b98-6d86-45d4-b975-5e8d5c387ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:23:17.503289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f990b98-6d86-45d4-b975-5e8d5c387ecc None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:23:17.503576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f990b98-6d86-45d4-b975-5e8d5c387ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:23:17.503881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f990b98-6d86-45d4-b975-5e8d5c387ecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:23:17.504664 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f990b98-6d86-45d4-b975-5e8d5c387ecc None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=2815bf7d99eb4d3f98077f3b51385fd7, user.id=d9f8e63527db4d67bdae97b2678e47f9) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:23:17.504977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f990b98-6d86-45d4-b975-5e8d5c387ecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:23:17.506407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f990b98-6d86-45d4-b975-5e8d5c387ecc None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:23:17.512047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 608/1200] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:23:17 2022] GET /identity/v3/role_assignments?user.id=d9f8e63527db4d67bdae97b2678e47f9&scope.project.id=2815bf7d99eb4d3f98077f3b51385fd7&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:23:27.355746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=30 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:23:27.509460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=84 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:12.383214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42ae91-5afd-4494-958b-066be60c8088 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:12.383795 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42ae91-5afd-4494-958b-066be60c8088 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:12.383795 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42ae91-5afd-4494-958b-066be60c8088 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:12.385937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 593/1201] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:12.394022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7230e5b-1b45-4881-b26b-d70b4526648d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:12.394532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7230e5b-1b45-4881-b26b-d70b4526648d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:12.394619 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7230e5b-1b45-4881-b26b-d70b4526648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:12.415297 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e7230e5b-1b45-4881-b26b-d70b4526648d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:12.416575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e7230e5b-1b45-4881-b26b-d70b4526648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:12.508223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 609/1202] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:24:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 16:24:12.534808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42ae91-5afd-4494-958b-066be60c8088 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:12.682418 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42ae91-5afd-4494-958b-066be60c8088 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:12.728550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dc703-16a3-4592-9c52-0c8baf4ed65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:12.729295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc703-16a3-4592-9c52-0c8baf4ed65f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:12.729616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc703-16a3-4592-9c52-0c8baf4ed65f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:12.730021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc703-16a3-4592-9c52-0c8baf4ed65f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:12.743042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dc703-16a3-4592-9c52-0c8baf4ed65f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:12.744775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dc703-16a3-4592-9c52-0c8baf4ed65f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-b50dc703-16a3-4592-9c52-0c8baf4ed65f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:24:12.770733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:12.772073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:12.773077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:24:12.773077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:24:12.773077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:12.773077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:12.773077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 594/1203] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:12.778372 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7230e5b-1b45-4881-b26b-d70b4526648d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:12.922623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7230e5b-1b45-4881-b26b-d70b4526648d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:12.958846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:12.970723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd58b5-671e-4fe7-a33c-5015df0cbd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:12.971751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd58b5-671e-4fe7-a33c-5015df0cbd84 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:12.972196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd58b5-671e-4fe7-a33c-5015df0cbd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:12.972520 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd58b5-671e-4fe7-a33c-5015df0cbd84 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:12.973351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd58b5-671e-4fe7-a33c-5015df0cbd84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:12.973663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd58b5-671e-4fe7-a33c-5015df0cbd84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:12.975359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd58b5-671e-4fe7-a33c-5015df0cbd84 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:12.989454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 610/1204] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:24:12.995917 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dc703-16a3-4592-9c52-0c8baf4ed65f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:13.065122 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:13.122307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dc703-16a3-4592-9c52-0c8baf4ed65f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:13.173876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b47fbf-0546-45e9-84dc-31bc1954e43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:13.174903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b47fbf-0546-45e9-84dc-31bc1954e43e None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:13.175254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b47fbf-0546-45e9-84dc-31bc1954e43e None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:13.175583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b47fbf-0546-45e9-84dc-31bc1954e43e None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:13.176402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b47fbf-0546-45e9-84dc-31bc1954e43e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:13.177840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b47fbf-0546-45e9-84dc-31bc1954e43e None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:13.211889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 595/1205] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 16:24:12 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:24:15.495096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497264a0-9091-4ca3-80a5-b08b66634e20 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:15.495670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497264a0-9091-4ca3-80a5-b08b66634e20 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:15.495670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497264a0-9091-4ca3-80a5-b08b66634e20 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:15.497201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 611/1206] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:15.503116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6809a-e969-42cf-8010-5c81d6fa6e88 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:15.503542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6809a-e969-42cf-8010-5c81d6fa6e88 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:15.503753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6809a-e969-42cf-8010-5c81d6fa6e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:15.524421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-38c6809a-e969-42cf-8010-5c81d6fa6e88 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:15.525638 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-38c6809a-e969-42cf-8010-5c81d6fa6e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:15.609477 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 596/1207] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:24:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:24:15.635671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497264a0-9091-4ca3-80a5-b08b66634e20 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:15.778474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497264a0-9091-4ca3-80a5-b08b66634e20 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:15.814400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda0bec-09d4-4c0f-a641-f59d116acbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:15.815231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda0bec-09d4-4c0f-a641-f59d116acbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:15.815339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda0bec-09d4-4c0f-a641-f59d116acbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:15.815606 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda0bec-09d4-4c0f-a641-f59d116acbc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:15.827834 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda0bec-09d4-4c0f-a641-f59d116acbc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-7cda0bec-09d4-4c0f-a641-f59d116acbc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:24:15.833110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:15.836172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:15.837084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:15.837084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:15.837084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:15.837084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:15.837084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:24:15.837084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:24:15.837084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:24:15.837084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:24:15.837084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:24:15.837084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:24:15.837084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:24:15.837084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:15.837084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 612/1208] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:24:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:15.840395 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6809a-e969-42cf-8010-5c81d6fa6e88 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:15.884281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:15.962864 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6809a-e969-42cf-8010-5c81d6fa6e88 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:16.002431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5348b94-ea1c-4b50-9dd6-165addcf256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:16.003089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5348b94-ea1c-4b50-9dd6-165addcf256c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:16.003377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5348b94-ea1c-4b50-9dd6-165addcf256c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:16.003688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5348b94-ea1c-4b50-9dd6-165addcf256c None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:16.004396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5348b94-ea1c-4b50-9dd6-165addcf256c None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:16.004914 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5348b94-ea1c-4b50-9dd6-165addcf256c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:16.006022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5348b94-ea1c-4b50-9dd6-165addcf256c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:16.016890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 597/1209] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:24:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:16.020677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda0bec-09d4-4c0f-a641-f59d116acbc3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:16.083839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:16.147689 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda0bec-09d4-4c0f-a641-f59d116acbc3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:16.183851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb2a8-d5bf-4c5a-a894-f61a0f780b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:16.184514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb2a8-d5bf-4c5a-a894-f61a0f780b9e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:16.184854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb2a8-d5bf-4c5a-a894-f61a0f780b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:16.185134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb2a8-d5bf-4c5a-a894-f61a0f780b9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:16.197235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cb2a8-d5bf-4c5a-a894-f61a0f780b9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:16.198725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cb2a8-d5bf-4c5a-a894-f61a0f780b9e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-3b6cb2a8-d5bf-4c5a-a894-f61a0f780b9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:24:16.215202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:16.216186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:16.217157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:24:16.217157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:24:16.217157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:16.217157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:16.221373 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 613/1210] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:24:16.222964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5348b94-ea1c-4b50-9dd6-165addcf256c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:16.338619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:16.341598 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5348b94-ea1c-4b50-9dd6-165addcf256c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:16.386291 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa77e3-ea65-4bea-b60e-b30739da8501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:16.386968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa77e3-ea65-4bea-b60e-b30739da8501 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:16.387250 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa77e3-ea65-4bea-b60e-b30739da8501 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:16.387598 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa77e3-ea65-4bea-b60e-b30739da8501 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:16.388326 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa77e3-ea65-4bea-b60e-b30739da8501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:16.388633 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa77e3-ea65-4bea-b60e-b30739da8501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:16.390608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa77e3-ea65-4bea-b60e-b30739da8501 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:16.403482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 598/1211] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:16.409662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb2a8-d5bf-4c5a-a894-f61a0f780b9e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:16.520522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb2a8-d5bf-4c5a-a894-f61a0f780b9e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:16.522155 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:16.559196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a018a-2817-4615-9590-ebf46b9618fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:16.559881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a018a-2817-4615-9590-ebf46b9618fb None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:16.560226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a018a-2817-4615-9590-ebf46b9618fb None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:16.560511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a018a-2817-4615-9590-ebf46b9618fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:16.570117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a018a-2817-4615-9590-ebf46b9618fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:16.571656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a018a-2817-4615-9590-ebf46b9618fb None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-143a018a-2817-4615-9590-ebf46b9618fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:24:16.584570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:16.585635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:16.586628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:16.586628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:16.586628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:24:16.586628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:24:16.586628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:24:16.586628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:24:16.586628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:24:16.586628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:24:16.586628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:24:16.586628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:16.586628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 614/1212] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:24:16.592018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa77e3-ea65-4bea-b60e-b30739da8501 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:16.711039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa77e3-ea65-4bea-b60e-b30739da8501 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:16.749349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a20b4c-73a0-41a4-8fea-37ee5582e54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:16.750017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a20b4c-73a0-41a4-8fea-37ee5582e54d None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:16.750308 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a20b4c-73a0-41a4-8fea-37ee5582e54d None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:16.750569 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a20b4c-73a0-41a4-8fea-37ee5582e54d None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:16.751420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a20b4c-73a0-41a4-8fea-37ee5582e54d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:16.751743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a20b4c-73a0-41a4-8fea-37ee5582e54d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:16.754143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a20b4c-73a0-41a4-8fea-37ee5582e54d None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:16.773993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 599/1213] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 27 16:24:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:16.780544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a018a-2817-4615-9590-ebf46b9618fb None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:16.914111 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a018a-2817-4615-9590-ebf46b9618fb None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:16.957189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc4707-4b63-4ce5-ba8c-e2b344dc81a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:16.957847 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc4707-4b63-4ce5-ba8c-e2b344dc81a2 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:16.958162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc4707-4b63-4ce5-ba8c-e2b344dc81a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:16.958441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc4707-4b63-4ce5-ba8c-e2b344dc81a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:16.994568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:17.045497 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc4707-4b63-4ce5-ba8c-e2b344dc81a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:17.046991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc4707-4b63-4ce5-ba8c-e2b344dc81a2 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:17.166425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 615/1214] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:24:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:24:17.173318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a20b4c-73a0-41a4-8fea-37ee5582e54d None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:17.202293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:17.309463 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a20b4c-73a0-41a4-8fea-37ee5582e54d None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:17.357997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4fed2-05ab-4cf1-b5d1-cecb03daf282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:17.359613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4fed2-05ab-4cf1-b5d1-cecb03daf282 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:17.359926 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4fed2-05ab-4cf1-b5d1-cecb03daf282 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:17.360192 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4fed2-05ab-4cf1-b5d1-cecb03daf282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:17.377483 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4fed2-05ab-4cf1-b5d1-cecb03daf282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:17.379025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4fed2-05ab-4cf1-b5d1-cecb03daf282 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-cce4fed2-05ab-4cf1-b5d1-cecb03daf282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:24:17.397785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:17.399007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:17.405275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:24:17.405275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:24:17.405275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:17.405275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:17.405275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 600/1215] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:17.407816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc4707-4b63-4ce5-ba8c-e2b344dc81a2 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:17.485786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:17.532728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc4707-4b63-4ce5-ba8c-e2b344dc81a2 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:17.573602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188be96b-f8ad-43e5-97e6-b57f97ef9698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:17.574937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188be96b-f8ad-43e5-97e6-b57f97ef9698 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:17.574937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188be96b-f8ad-43e5-97e6-b57f97ef9698 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:17.575101 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188be96b-f8ad-43e5-97e6-b57f97ef9698 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:17.575789 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188be96b-f8ad-43e5-97e6-b57f97ef9698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:17.576154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188be96b-f8ad-43e5-97e6-b57f97ef9698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:17.577885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188be96b-f8ad-43e5-97e6-b57f97ef9698 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:17.596225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 616/1216] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:17.598042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4fed2-05ab-4cf1-b5d1-cecb03daf282 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:17.694980 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:17.738011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4fed2-05ab-4cf1-b5d1-cecb03daf282 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:17.787513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e2bea-2577-460e-99cf-fe8cd54973c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:17.788627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e2bea-2577-460e-99cf-fe8cd54973c9 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:17.789088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e2bea-2577-460e-99cf-fe8cd54973c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:17.789570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e2bea-2577-460e-99cf-fe8cd54973c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:17.797493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e2bea-2577-460e-99cf-fe8cd54973c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:17.799160 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e2bea-2577-460e-99cf-fe8cd54973c9 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-796e2bea-2577-460e-99cf-fe8cd54973c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:24:17.813735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:17.814934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:17.815924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:24:17.815924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:24:17.815924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:24:17.815924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:24:17.815924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:24:17.815924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:24:17.815924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:24:17.815924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:17.815924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 601/1217] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:24:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:17.821169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188be96b-f8ad-43e5-97e6-b57f97ef9698 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:17.941167 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188be96b-f8ad-43e5-97e6-b57f97ef9698 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:17.966690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:17.982460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bdfc4-5225-486a-b353-2101bbd0dd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:17.983350 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bdfc4-5225-486a-b353-2101bbd0dd26 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:17.984292 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bdfc4-5225-486a-b353-2101bbd0dd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:17.984702 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bdfc4-5225-486a-b353-2101bbd0dd26 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:17.985675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bdfc4-5225-486a-b353-2101bbd0dd26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:17.986106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bdfc4-5225-486a-b353-2101bbd0dd26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:17.987830 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bdfc4-5225-486a-b353-2101bbd0dd26 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:18.001828 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 617/1218] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:24:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:18.008697 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e2bea-2577-460e-99cf-fe8cd54973c9 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:18.117735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e2bea-2577-460e-99cf-fe8cd54973c9 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:18.148092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:18.156162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25696e-d3c8-4d7c-9513-b22156480881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:18.156779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25696e-d3c8-4d7c-9513-b22156480881 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:18.157064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25696e-d3c8-4d7c-9513-b22156480881 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:18.157337 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25696e-d3c8-4d7c-9513-b22156480881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:18.158121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25696e-d3c8-4d7c-9513-b22156480881 None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=f602decb26be477b867493429352bd03) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:18.158437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25696e-d3c8-4d7c-9513-b22156480881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:18.159840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25696e-d3c8-4d7c-9513-b22156480881 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:18.175903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 602/1219] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:24:18 2022] GET /identity/v3/role_assignments?user.id=f602decb26be477b867493429352bd03&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:20.300909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a084f-548a-42e9-8559-facc46b1434a None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:20.301452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a084f-548a-42e9-8559-facc46b1434a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:20.301614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a084f-548a-42e9-8559-facc46b1434a None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:20.303712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 618/1220] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:20.309320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacffb0e-8bcf-401c-a2fd-81cff8f38912 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:20.309743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacffb0e-8bcf-401c-a2fd-81cff8f38912 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:20.309982 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacffb0e-8bcf-401c-a2fd-81cff8f38912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:20.329892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-dacffb0e-8bcf-401c-a2fd-81cff8f38912 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:20.331081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-dacffb0e-8bcf-401c-a2fd-81cff8f38912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:20.423891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 603/1221] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:24:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:24:20.448549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a084f-548a-42e9-8559-facc46b1434a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:20.559961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a084f-548a-42e9-8559-facc46b1434a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:20.600592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7961bfb-6e73-44b2-97d0-f7d550e9e15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:20.601231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7961bfb-6e73-44b2-97d0-f7d550e9e15e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:20.601508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7961bfb-6e73-44b2-97d0-f7d550e9e15e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:20.601787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7961bfb-6e73-44b2-97d0-f7d550e9e15e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:20.611779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7961bfb-6e73-44b2-97d0-f7d550e9e15e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-c7961bfb-6e73-44b2-97d0-f7d550e9e15e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:24:20.616673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:20.617732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:20.619084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:20.619084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:20.619084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:20.619084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:20.619084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:24:20.619084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:24:20.619084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:24:20.619084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:24:20.619084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:24:20.619084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:24:20.619084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:24:20.619084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:20.619084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 619/1222] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:24:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:24:20.624012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacffb0e-8bcf-401c-a2fd-81cff8f38912 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:20.733075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacffb0e-8bcf-401c-a2fd-81cff8f38912 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:20.762289 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:20.776129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363da00-9fc8-485a-8479-0f4814722b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:20.776802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363da00-9fc8-485a-8479-0f4814722b4c None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:20.777238 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363da00-9fc8-485a-8479-0f4814722b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:20.777718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363da00-9fc8-485a-8479-0f4814722b4c None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:20.778570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363da00-9fc8-485a-8479-0f4814722b4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:20.778917 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363da00-9fc8-485a-8479-0f4814722b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:20.780484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363da00-9fc8-485a-8479-0f4814722b4c None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:20.790207 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 604/1223] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:24:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:20.795795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7961bfb-6e73-44b2-97d0-f7d550e9e15e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:20.844411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:20.903398 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7961bfb-6e73-44b2-97d0-f7d550e9e15e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:20.938507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402dca6-cbcc-473b-b2ed-62f59f95b6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:20.939226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402dca6-cbcc-473b-b2ed-62f59f95b6cf None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:20.939515 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402dca6-cbcc-473b-b2ed-62f59f95b6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:20.939799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402dca6-cbcc-473b-b2ed-62f59f95b6cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:20.952166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402dca6-cbcc-473b-b2ed-62f59f95b6cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:20.954574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402dca6-cbcc-473b-b2ed-62f59f95b6cf None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-7402dca6-cbcc-473b-b2ed-62f59f95b6cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:24:20.972678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:20.973773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:20.974827 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:24:20.974827 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:24:20.974827 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:20.974827 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:20.974827 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 620/1224] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:20.979919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363da00-9fc8-485a-8479-0f4814722b4c None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:21.088974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363da00-9fc8-485a-8479-0f4814722b4c None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:21.125552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1370598-69c1-48e0-a72b-0c2cbf09f978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:21.126379 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1370598-69c1-48e0-a72b-0c2cbf09f978 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:21.126716 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1370598-69c1-48e0-a72b-0c2cbf09f978 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:21.127049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1370598-69c1-48e0-a72b-0c2cbf09f978 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:21.128043 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1370598-69c1-48e0-a72b-0c2cbf09f978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:21.128423 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1370598-69c1-48e0-a72b-0c2cbf09f978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:21.130133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1370598-69c1-48e0-a72b-0c2cbf09f978 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:21.146227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 605/1225] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:21.151814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402dca6-cbcc-473b-b2ed-62f59f95b6cf None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:21.257394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:21.264411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402dca6-cbcc-473b-b2ed-62f59f95b6cf None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:21.302182 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ea1c1-5eeb-43ef-8e26-ba9fdd4a931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:21.302854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ea1c1-5eeb-43ef-8e26-ba9fdd4a931e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:21.303091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ea1c1-5eeb-43ef-8e26-ba9fdd4a931e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:21.303367 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ea1c1-5eeb-43ef-8e26-ba9fdd4a931e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:21.310846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ea1c1-5eeb-43ef-8e26-ba9fdd4a931e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:21.312409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ea1c1-5eeb-43ef-8e26-ba9fdd4a931e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-f43ea1c1-5eeb-43ef-8e26-ba9fdd4a931e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:24:21.323654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:21.324663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:21.325662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:21.325662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:21.325662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:24:21.325662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:24:21.325662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:24:21.325662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:24:21.325662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:24:21.325662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:24:21.325662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:24:21.325662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:21.325662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 621/1226] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:21.331516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1370598-69c1-48e0-a72b-0c2cbf09f978 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:21.383332 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:21.444415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1370598-69c1-48e0-a72b-0c2cbf09f978 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:21.478063 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7adf1d-8db4-48cf-a525-222446dc52d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:21.478676 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7adf1d-8db4-48cf-a525-222446dc52d6 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:21.478960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7adf1d-8db4-48cf-a525-222446dc52d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:21.479237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7adf1d-8db4-48cf-a525-222446dc52d6 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:21.480051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7adf1d-8db4-48cf-a525-222446dc52d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:21.480362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7adf1d-8db4-48cf-a525-222446dc52d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:21.481781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7adf1d-8db4-48cf-a525-222446dc52d6 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:21.498660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 606/1227] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 27 16:24:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:21.505071 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ea1c1-5eeb-43ef-8e26-ba9fdd4a931e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:21.615251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ea1c1-5eeb-43ef-8e26-ba9fdd4a931e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:21.656587 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d02093-e506-42e9-ac77-c0fcb1ce46c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:21.657231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02093-e506-42e9-ac77-c0fcb1ce46c0 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:21.657516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02093-e506-42e9-ac77-c0fcb1ce46c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:21.657794 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02093-e506-42e9-ac77-c0fcb1ce46c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:21.668498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d02093-e506-42e9-ac77-c0fcb1ce46c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:21.669995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d02093-e506-42e9-ac77-c0fcb1ce46c0 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-68d02093-e506-42e9-ac77-c0fcb1ce46c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:24:21.685216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:21.686974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:21.688108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:24:21.688108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:24:21.688108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:21.688108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:21.688108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 622/1228] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:21.693222 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7adf1d-8db4-48cf-a525-222446dc52d6 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:21.806678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7adf1d-8db4-48cf-a525-222446dc52d6 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:21.809269 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:21.845683 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306da2d-788a-4f80-811f-6c5f2254495b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:21.846397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306da2d-788a-4f80-811f-6c5f2254495b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:21.846681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306da2d-788a-4f80-811f-6c5f2254495b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:21.847210 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306da2d-788a-4f80-811f-6c5f2254495b None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:21.848069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306da2d-788a-4f80-811f-6c5f2254495b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:21.848380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306da2d-788a-4f80-811f-6c5f2254495b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:21.850189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306da2d-788a-4f80-811f-6c5f2254495b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:21.862899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 607/1229] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:21.868825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d02093-e506-42e9-ac77-c0fcb1ce46c0 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:21.879096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:21.984555 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d02093-e506-42e9-ac77-c0fcb1ce46c0 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:22.024522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b12b9-200d-40fa-ac01-04920087f552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:22.025191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b12b9-200d-40fa-ac01-04920087f552 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:22.025524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b12b9-200d-40fa-ac01-04920087f552 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:22.025778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b12b9-200d-40fa-ac01-04920087f552 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:22.033031 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b12b9-200d-40fa-ac01-04920087f552 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:22.034470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b12b9-200d-40fa-ac01-04920087f552 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-4d3b12b9-200d-40fa-ac01-04920087f552 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:24:22.046888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:22.047984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:22.049005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:24:22.049005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:24:22.049005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:24:22.049005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:24:22.049005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:24:22.049005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:24:22.049005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:24:22.049005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:22.049005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 623/1230] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:24:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:24:22.053936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306da2d-788a-4f80-811f-6c5f2254495b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:22.163376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306da2d-788a-4f80-811f-6c5f2254495b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:22.198925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a03af-cda8-4232-9175-885a03f5576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:22.199552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a03af-cda8-4232-9175-885a03f5576a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:22.199830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a03af-cda8-4232-9175-885a03f5576a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:22.200143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a03af-cda8-4232-9175-885a03f5576a None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:22.200883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a03af-cda8-4232-9175-885a03f5576a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:22.201191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a03af-cda8-4232-9175-885a03f5576a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:22.203316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a03af-cda8-4232-9175-885a03f5576a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:22.216334 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 608/1231] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:24:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:22.223088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b12b9-200d-40fa-ac01-04920087f552 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:22.298811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:22.340461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b12b9-200d-40fa-ac01-04920087f552 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:22.376464 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d446b2f-4fc7-402e-87c6-12fc91fefa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:22.377141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446b2f-4fc7-402e-87c6-12fc91fefa8a None admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:22.377573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446b2f-4fc7-402e-87c6-12fc91fefa8a None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:22.377748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446b2f-4fc7-402e-87c6-12fc91fefa8a None admin] PATH_INFO: `/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/f602decb26be477b867493429352bd03/roles/93a2fa7fee0546bfb1e36487e6785cdd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:22.394159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d446b2f-4fc7-402e-87c6-12fc91fefa8a None admin] RBAC: Authorizing `identity:create_grant(project_id=f01ef9cd2ffc4edd94cbf0017a720a57, user_id=f602decb26be477b867493429352bd03, role_id=93a2fa7fee0546bfb1e36487e6785cdd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:22.395775 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d446b2f-4fc7-402e-87c6-12fc91fefa8a None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:22.411214 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 624/1232] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:24:22 2022] PUT /identity/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/f602decb26be477b867493429352bd03/roles/93a2fa7fee0546bfb1e36487e6785cdd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:24:24.440183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85f6d-6b24-4b90-aca6-7dbe21bb5b96 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:24.440723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85f6d-6b24-4b90-aca6-7dbe21bb5b96 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:24.440723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85f6d-6b24-4b90-aca6-7dbe21bb5b96 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:24.442078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 609/1233] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:24.447134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ea79-42d4-4690-ba06-d72ec3fbd34e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:24.447545 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ea79-42d4-4690-ba06-d72ec3fbd34e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:24.447695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ea79-42d4-4690-ba06-d72ec3fbd34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:24.467568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2207ea79-42d4-4690-ba06-d72ec3fbd34e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:24.470014 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2207ea79-42d4-4690-ba06-d72ec3fbd34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:24.541282 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 625/1234] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:24:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:24:24.566089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf85f6d-6b24-4b90-aca6-7dbe21bb5b96 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:24.591837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:24.672874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf85f6d-6b24-4b90-aca6-7dbe21bb5b96 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:24.708773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921ec1e-91f4-4f89-9470-ab8e1e70d2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:24.709339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921ec1e-91f4-4f89-9470-ab8e1e70d2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:24.709621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921ec1e-91f4-4f89-9470-ab8e1e70d2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:24.709892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921ec1e-91f4-4f89-9470-ab8e1e70d2b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:24.720368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921ec1e-91f4-4f89-9470-ab8e1e70d2b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-7921ec1e-91f4-4f89-9470-ab8e1e70d2b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:24:24.725575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:24.726616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:24.728078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:24.728078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:24.728078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:24.728078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:24.728078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:24:24.728078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:24:24.728078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:24:24.728078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:24:24.728078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:24:24.728078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:24:24.728078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 16:24:24.728078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:24.728078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 610/1235] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 16:24:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:24.733094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207ea79-42d4-4690-ba06-d72ec3fbd34e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:24.791039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:24.849878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207ea79-42d4-4690-ba06-d72ec3fbd34e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:24.888119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253667de-a7f7-4bdc-89a3-b1a92c70df1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:24.888739 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253667de-a7f7-4bdc-89a3-b1a92c70df1e None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:24.889019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253667de-a7f7-4bdc-89a3-b1a92c70df1e None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:24.889295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253667de-a7f7-4bdc-89a3-b1a92c70df1e None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:24.890053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253667de-a7f7-4bdc-89a3-b1a92c70df1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:24.890356 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253667de-a7f7-4bdc-89a3-b1a92c70df1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:24.891724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253667de-a7f7-4bdc-89a3-b1a92c70df1e None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:24.906248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 626/1236] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 16:24:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:24.907519 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921ec1e-91f4-4f89-9470-ab8e1e70d2b7 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:25.004381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:25.024445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921ec1e-91f4-4f89-9470-ab8e1e70d2b7 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:25.066255 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67babd16-db99-4f92-aba6-affad522c630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:25.066915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67babd16-db99-4f92-aba6-affad522c630 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:25.067205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67babd16-db99-4f92-aba6-affad522c630 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:25.067484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67babd16-db99-4f92-aba6-affad522c630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:25.079949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67babd16-db99-4f92-aba6-affad522c630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:25.081391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67babd16-db99-4f92-aba6-affad522c630 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-67babd16-db99-4f92-aba6-affad522c630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:24:25.097579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:25.098649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:25.099569 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:24:25.099569 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:24:25.099569 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:25.099569 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:25.099569 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 611/1237] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:25.105206 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253667de-a7f7-4bdc-89a3-b1a92c70df1e None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:25.219692 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253667de-a7f7-4bdc-89a3-b1a92c70df1e None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:25.229052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:25.256597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f2ee1-1abd-42ec-9384-1d494a8dec42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:25.257145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f2ee1-1abd-42ec-9384-1d494a8dec42 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:25.257433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f2ee1-1abd-42ec-9384-1d494a8dec42 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:25.257718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f2ee1-1abd-42ec-9384-1d494a8dec42 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:25.258405 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f2ee1-1abd-42ec-9384-1d494a8dec42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:25.258714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f2ee1-1abd-42ec-9384-1d494a8dec42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:25.260110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f2ee1-1abd-42ec-9384-1d494a8dec42 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:25.274095 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 627/1238] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:25.279701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67babd16-db99-4f92-aba6-affad522c630 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:25.388306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67babd16-db99-4f92-aba6-affad522c630 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:25.430893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c82a6-bd70-412e-bf0c-3d5fd02c0923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:25.432083 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c82a6-bd70-412e-bf0c-3d5fd02c0923 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:25.432710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c82a6-bd70-412e-bf0c-3d5fd02c0923 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:25.433075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c82a6-bd70-412e-bf0c-3d5fd02c0923 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:25.436512 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:25.443785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c82a6-bd70-412e-bf0c-3d5fd02c0923 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:25.445663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c82a6-bd70-412e-bf0c-3d5fd02c0923 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-a45c82a6-bd70-412e-bf0c-3d5fd02c0923 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:24:25.460317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:25.461442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:25.462429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:25.462429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:25.462429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:24:25.462429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:24:25.462429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:24:25.462429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:24:25.462429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:24:25.462429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:24:25.462429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:24:25.462429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:25.462429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 612/1239] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:25.467647 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f2ee1-1abd-42ec-9384-1d494a8dec42 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:25.576028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f2ee1-1abd-42ec-9384-1d494a8dec42 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:25.615332 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58622b85-9c60-4f77-bc35-280da70b9cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:25.616159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58622b85-9c60-4f77-bc35-280da70b9cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:25.616443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58622b85-9c60-4f77-bc35-280da70b9cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:25.616723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58622b85-9c60-4f77-bc35-280da70b9cb7 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:25.617506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58622b85-9c60-4f77-bc35-280da70b9cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:25.617814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58622b85-9c60-4f77-bc35-280da70b9cb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:25.619255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58622b85-9c60-4f77-bc35-280da70b9cb7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:25.645179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 628/1240] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 27 16:24:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:25.647011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c82a6-bd70-412e-bf0c-3d5fd02c0923 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:25.765275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c82a6-bd70-412e-bf0c-3d5fd02c0923 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:25.805281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88009aab-6c21-41c9-b8c8-e336e89745e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:25.806008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88009aab-6c21-41c9-b8c8-e336e89745e5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:25.806297 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88009aab-6c21-41c9-b8c8-e336e89745e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:25.806820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88009aab-6c21-41c9-b8c8-e336e89745e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:25.878726 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:25.885902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88009aab-6c21-41c9-b8c8-e336e89745e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:25.887539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88009aab-6c21-41c9-b8c8-e336e89745e5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:25.999725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 613/1241] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:24:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:24:26.005768 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58622b85-9c60-4f77-bc35-280da70b9cb7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:26.039358 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:26.118390 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58622b85-9c60-4f77-bc35-280da70b9cb7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:26.155510 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574ad9d-d12f-4130-82aa-56a5ccbec2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:26.156058 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574ad9d-d12f-4130-82aa-56a5ccbec2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:26.156337 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574ad9d-d12f-4130-82aa-56a5ccbec2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:26.156652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574ad9d-d12f-4130-82aa-56a5ccbec2c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:26.167471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574ad9d-d12f-4130-82aa-56a5ccbec2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:26.169071 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574ad9d-d12f-4130-82aa-56a5ccbec2c7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-9574ad9d-d12f-4130-82aa-56a5ccbec2c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:24:26.184144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:26.185119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:26.186225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:24:26.186225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:24:26.186225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:26.186225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:26.186225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 629/1242] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:26.193334 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88009aab-6c21-41c9-b8c8-e336e89745e5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:26.309189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:26.317257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88009aab-6c21-41c9-b8c8-e336e89745e5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:26.357261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aff574-5457-4322-b37f-a750c38b55b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:26.357942 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aff574-5457-4322-b37f-a750c38b55b5 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:26.358315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aff574-5457-4322-b37f-a750c38b55b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:26.359091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aff574-5457-4322-b37f-a750c38b55b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:26.360008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aff574-5457-4322-b37f-a750c38b55b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:26.360358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aff574-5457-4322-b37f-a750c38b55b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:26.361883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aff574-5457-4322-b37f-a750c38b55b5 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:26.373647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 614/1243] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:26.380701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574ad9d-d12f-4130-82aa-56a5ccbec2c7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:26.477517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:26.504839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574ad9d-d12f-4130-82aa-56a5ccbec2c7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:26.541657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd818bda-e18e-43d1-8c5f-bebf469b7258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:26.542299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd818bda-e18e-43d1-8c5f-bebf469b7258 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:26.542582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd818bda-e18e-43d1-8c5f-bebf469b7258 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:26.542858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd818bda-e18e-43d1-8c5f-bebf469b7258 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:26.550523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd818bda-e18e-43d1-8c5f-bebf469b7258 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:26.552000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd818bda-e18e-43d1-8c5f-bebf469b7258 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-cd818bda-e18e-43d1-8c5f-bebf469b7258 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:24:26.563576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:26.564598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:26.565522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:24:26.565522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:24:26.565522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:24:26.565522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:24:26.565522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:24:26.565522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:24:26.565522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:24:26.565522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:26.569457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 630/1244] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:24:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:26.570585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aff574-5457-4322-b37f-a750c38b55b5 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:26.680688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aff574-5457-4322-b37f-a750c38b55b5 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:26.716219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7e39b-111f-41f0-8533-1e151a0f5147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:26.716893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7e39b-111f-41f0-8533-1e151a0f5147 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:26.717176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7e39b-111f-41f0-8533-1e151a0f5147 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:26.717453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7e39b-111f-41f0-8533-1e151a0f5147 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:26.718482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7e39b-111f-41f0-8533-1e151a0f5147 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:26.718794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7e39b-111f-41f0-8533-1e151a0f5147 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:26.720259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7e39b-111f-41f0-8533-1e151a0f5147 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:26.733016 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 615/1245] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:24:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:26.738981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd818bda-e18e-43d1-8c5f-bebf469b7258 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:26.849754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd818bda-e18e-43d1-8c5f-bebf469b7258 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:26.890365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc0818-e291-4ca2-b850-3227940c18b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:26.890909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc0818-e291-4ca2-b850-3227940c18b7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:26.891204 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc0818-e291-4ca2-b850-3227940c18b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:26.891476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc0818-e291-4ca2-b850-3227940c18b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:26.892299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc0818-e291-4ca2-b850-3227940c18b7 None admin] RBAC: Adding query filter params (role.id=93a2fa7fee0546bfb1e36487e6785cdd, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=f602decb26be477b867493429352bd03) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:26.892613 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc0818-e291-4ca2-b850-3227940c18b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:26.894046 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc0818-e291-4ca2-b850-3227940c18b7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:26.901057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 631/1246] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:24:26 2022] GET /identity/v3/role_assignments?user.id=f602decb26be477b867493429352bd03&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=93a2fa7fee0546bfb1e36487e6785cdd => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:29.049417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6412442-05fa-4417-b8de-0acd332e8c6a None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:29.049978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6412442-05fa-4417-b8de-0acd332e8c6a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:29.049978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6412442-05fa-4417-b8de-0acd332e8c6a None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:29.051639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 616/1247] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:29.057589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1597ec-b1d9-4c86-8cf2-870e0282ddda None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:29.058039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1597ec-b1d9-4c86-8cf2-870e0282ddda None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:29.058259 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1597ec-b1d9-4c86-8cf2-870e0282ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:29.065020 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:29.083119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1e1597ec-b1d9-4c86-8cf2-870e0282ddda None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:29.084448 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1e1597ec-b1d9-4c86-8cf2-870e0282ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:29.161804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 632/1248] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:24:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:24:29.189303 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6412442-05fa-4417-b8de-0acd332e8c6a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:29.210015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:29.315035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6412442-05fa-4417-b8de-0acd332e8c6a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:29.353515 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cadb0-29a3-49c8-a5ad-df660221c30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:29.354288 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cadb0-29a3-49c8-a5ad-df660221c30a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:29.354651 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cadb0-29a3-49c8-a5ad-df660221c30a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:29.355022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cadb0-29a3-49c8-a5ad-df660221c30a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:29.367817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cadb0-29a3-49c8-a5ad-df660221c30a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-e84cadb0-29a3-49c8-a5ad-df660221c30a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:24:29.372791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:29.373960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:29.380306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:29.380306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:29.380306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:29.380306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:29.380306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:24:29.380306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:24:29.380306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:24:29.380306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:24:29.380306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:24:29.380306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:24:29.380306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:24:29.380306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:29.380306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 617/1249] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:24:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:29.381127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1597ec-b1d9-4c86-8cf2-870e0282ddda None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:29.516795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1597ec-b1d9-4c86-8cf2-870e0282ddda None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:29.550557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:29.556325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43814720-a035-47f5-8858-d77732fba21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:29.556949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43814720-a035-47f5-8858-d77732fba21c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:29.557230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43814720-a035-47f5-8858-d77732fba21c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:29.557523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43814720-a035-47f5-8858-d77732fba21c None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:29.558256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43814720-a035-47f5-8858-d77732fba21c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:29.558554 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43814720-a035-47f5-8858-d77732fba21c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:29.559982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43814720-a035-47f5-8858-d77732fba21c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:29.574095 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 633/1250] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:24:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:29.575202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cadb0-29a3-49c8-a5ad-df660221c30a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:29.668261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:29.696922 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cadb0-29a3-49c8-a5ad-df660221c30a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:29.736141 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414d8ae-67da-4609-b4fc-5ef208712d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:29.736885 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414d8ae-67da-4609-b4fc-5ef208712d77 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:29.737165 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414d8ae-67da-4609-b4fc-5ef208712d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:29.737447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414d8ae-67da-4609-b4fc-5ef208712d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:29.749185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414d8ae-67da-4609-b4fc-5ef208712d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:29.751147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414d8ae-67da-4609-b4fc-5ef208712d77 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-c414d8ae-67da-4609-b4fc-5ef208712d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:24:29.768830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:29.769956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:29.770865 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:24:29.770865 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:24:29.770865 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:29.770865 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:29.770865 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 618/1251] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:24:29.775634 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43814720-a035-47f5-8858-d77732fba21c None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:29.888896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43814720-a035-47f5-8858-d77732fba21c None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:29.928106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295c2f6-08c9-4b10-9398-023c6cb3a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:29.928754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295c2f6-08c9-4b10-9398-023c6cb3a1ff None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:29.929070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295c2f6-08c9-4b10-9398-023c6cb3a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:29.929335 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295c2f6-08c9-4b10-9398-023c6cb3a1ff None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:29.930300 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295c2f6-08c9-4b10-9398-023c6cb3a1ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:29.930611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295c2f6-08c9-4b10-9398-023c6cb3a1ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:29.932181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295c2f6-08c9-4b10-9398-023c6cb3a1ff None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:29.946897 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 634/1252] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:29.952889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414d8ae-67da-4609-b4fc-5ef208712d77 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:30.068206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414d8ae-67da-4609-b4fc-5ef208712d77 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:30.099491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:30.109517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1ca89-d005-4293-a1d7-5d050fd9142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:30.110209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1ca89-d005-4293-a1d7-5d050fd9142a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:30.110509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1ca89-d005-4293-a1d7-5d050fd9142a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:30.110776 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1ca89-d005-4293-a1d7-5d050fd9142a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:30.120830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1ca89-d005-4293-a1d7-5d050fd9142a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:30.122359 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1ca89-d005-4293-a1d7-5d050fd9142a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-52e1ca89-d005-4293-a1d7-5d050fd9142a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:24:30.136058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:30.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:30.138382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:30.138382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:30.138382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:24:30.138382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:24:30.138382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:24:30.138382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:24:30.138382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:24:30.138382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:24:30.138382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:24:30.138382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:30.138382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 619/1253] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:30.143953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295c2f6-08c9-4b10-9398-023c6cb3a1ff None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:30.210854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:30.263188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295c2f6-08c9-4b10-9398-023c6cb3a1ff None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:30.304727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55333e41-9939-4061-89c9-6d3765f78ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:30.305440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333e41-9939-4061-89c9-6d3765f78ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:30.305724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333e41-9939-4061-89c9-6d3765f78ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:30.306051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333e41-9939-4061-89c9-6d3765f78ff7 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:30.306880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55333e41-9939-4061-89c9-6d3765f78ff7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:30.307190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55333e41-9939-4061-89c9-6d3765f78ff7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:30.308751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55333e41-9939-4061-89c9-6d3765f78ff7 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:30.328008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 635/1254] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 27 16:24:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:24:30.334659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1ca89-d005-4293-a1d7-5d050fd9142a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:30.451145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1ca89-d005-4293-a1d7-5d050fd9142a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:30.511703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8d736-2acc-403b-b129-f7e85664525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:30.512581 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8d736-2acc-403b-b129-f7e85664525f None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:30.512995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8d736-2acc-403b-b129-f7e85664525f None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:30.513374 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8d736-2acc-403b-b129-f7e85664525f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:30.588087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:30.606104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8d736-2acc-403b-b129-f7e85664525f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:30.607699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8d736-2acc-403b-b129-f7e85664525f None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:30.718775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 620/1255] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:24:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:24:30.725028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55333e41-9939-4061-89c9-6d3765f78ff7 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:30.843968 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55333e41-9939-4061-89c9-6d3765f78ff7 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:30.859041 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:30.881412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc8768-512c-4e60-b149-9c229cfb67c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:30.882062 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc8768-512c-4e60-b149-9c229cfb67c4 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:30.882347 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc8768-512c-4e60-b149-9c229cfb67c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:30.882622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc8768-512c-4e60-b149-9c229cfb67c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:30.893674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc8768-512c-4e60-b149-9c229cfb67c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:30.895253 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc8768-512c-4e60-b149-9c229cfb67c4 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-84dc8768-512c-4e60-b149-9c229cfb67c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:24:30.917366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:30.918494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:30.919506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:24:30.919506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:24:30.919506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:30.919506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:30.919506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 636/1256] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:30.925279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8d736-2acc-403b-b129-f7e85664525f None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:31.021797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:31.036578 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8d736-2acc-403b-b129-f7e85664525f None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:31.070956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9a485-7dc0-4ce7-b19e-62da6b74c581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:31.071747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9a485-7dc0-4ce7-b19e-62da6b74c581 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:31.072170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9a485-7dc0-4ce7-b19e-62da6b74c581 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:31.072543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9a485-7dc0-4ce7-b19e-62da6b74c581 None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:31.073338 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9a485-7dc0-4ce7-b19e-62da6b74c581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:31.073743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9a485-7dc0-4ce7-b19e-62da6b74c581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:31.075199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9a485-7dc0-4ce7-b19e-62da6b74c581 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:31.087618 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 621/1257] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:31.094008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc8768-512c-4e60-b149-9c229cfb67c4 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:31.198531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc8768-512c-4e60-b149-9c229cfb67c4 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:31.234650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06b048-a067-40d8-b715-d647600befca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:31.235298 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06b048-a067-40d8-b715-d647600befca None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:31.235581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06b048-a067-40d8-b715-d647600befca None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:31.235899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06b048-a067-40d8-b715-d647600befca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:31.242891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06b048-a067-40d8-b715-d647600befca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:31.244413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06b048-a067-40d8-b715-d647600befca None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-3c06b048-a067-40d8-b715-d647600befca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:24:31.257493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:31.258939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:31.260170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:24:31.260170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:24:31.260170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:24:31.260170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:24:31.260170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:24:31.260170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:24:31.260170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:24:31.260170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:31.260170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 637/1258] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 16:24:31.264691 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9a485-7dc0-4ce7-b19e-62da6b74c581 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:31.378854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9a485-7dc0-4ce7-b19e-62da6b74c581 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:31.421350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c35191-5e1f-4c9d-b2f9-41c2988b5485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:31.422219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c35191-5e1f-4c9d-b2f9-41c2988b5485 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:31.422515 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c35191-5e1f-4c9d-b2f9-41c2988b5485 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:31.422803 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c35191-5e1f-4c9d-b2f9-41c2988b5485 None admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:31.423566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c35191-5e1f-4c9d-b2f9-41c2988b5485 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:31.423919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c35191-5e1f-4c9d-b2f9-41c2988b5485 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:31.425538 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c35191-5e1f-4c9d-b2f9-41c2988b5485 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:31.441656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 622/1259] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:24:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:31.447832 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06b048-a067-40d8-b715-d647600befca None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:31.479153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:31.576559 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06b048-a067-40d8-b715-d647600befca None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:31.612162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a48a0-5264-4b43-8967-461ce4aab918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:31.612889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a48a0-5264-4b43-8967-461ce4aab918 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:31.613089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a48a0-5264-4b43-8967-461ce4aab918 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:31.613400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a48a0-5264-4b43-8967-461ce4aab918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:31.614213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a48a0-5264-4b43-8967-461ce4aab918 None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=f602decb26be477b867493429352bd03) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:31.614545 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a48a0-5264-4b43-8967-461ce4aab918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:31.615904 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a48a0-5264-4b43-8967-461ce4aab918 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:31.621508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 638/1260] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:24:31 2022] GET /identity/v3/role_assignments?user.id=f602decb26be477b867493429352bd03&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:24:33.667705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063d957-da11-438d-8e35-9ef8b041f31a None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:33.668181 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063d957-da11-438d-8e35-9ef8b041f31a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:33.668303 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063d957-da11-438d-8e35-9ef8b041f31a None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:33.669663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 623/1261] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:33.675767 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e63c36-2638-46ae-815e-2470a4e27287 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:33.676228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e63c36-2638-46ae-815e-2470a4e27287 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:33.676363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e63c36-2638-46ae-815e-2470a4e27287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:33.694137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-69e63c36-2638-46ae-815e-2470a4e27287 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:33.695352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-69e63c36-2638-46ae-815e-2470a4e27287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:33.761400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 639/1262] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:24:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:24:33.784385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063d957-da11-438d-8e35-9ef8b041f31a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:33.795086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:33.886376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063d957-da11-438d-8e35-9ef8b041f31a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:33.919811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbd678-7caa-4cc7-bdb4-11af720a5477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:33.920408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbd678-7caa-4cc7-bdb4-11af720a5477 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:33.920693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbd678-7caa-4cc7-bdb4-11af720a5477 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:33.920972 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbd678-7caa-4cc7-bdb4-11af720a5477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:33.931597 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbd678-7caa-4cc7-bdb4-11af720a5477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-54cbd678-7caa-4cc7-bdb4-11af720a5477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:24:33.936493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:33.938311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:33.939451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:33.939451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:33.939451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:33.939451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:33.939451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:24:33.939451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:24:33.939451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:24:33.939451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:24:33.939451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:24:33.939451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:24:33.939451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:24:33.939451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:33.939451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 624/1263] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:24:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:33.944573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e63c36-2638-46ae-815e-2470a4e27287 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:33.962973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:34.042005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e63c36-2638-46ae-815e-2470a4e27287 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:34.075598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42a7a9-9438-48dd-aff2-e1db7e085c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:34.076235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42a7a9-9438-48dd-aff2-e1db7e085c84 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:34.076524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42a7a9-9438-48dd-aff2-e1db7e085c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:34.076804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42a7a9-9438-48dd-aff2-e1db7e085c84 None admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:34.077665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42a7a9-9438-48dd-aff2-e1db7e085c84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:34.077976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42a7a9-9438-48dd-aff2-e1db7e085c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:34.079349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42a7a9-9438-48dd-aff2-e1db7e085c84 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:34.087287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 640/1264] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:24:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:34.092843 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbd678-7caa-4cc7-bdb4-11af720a5477 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:34.158946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:34.192153 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbd678-7caa-4cc7-bdb4-11af720a5477 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:34.225495 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51302f53-e3fb-4d07-8d8c-7aa264e9ec36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:34.226122 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302f53-e3fb-4d07-8d8c-7aa264e9ec36 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:34.226405 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302f53-e3fb-4d07-8d8c-7aa264e9ec36 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:34.226682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302f53-e3fb-4d07-8d8c-7aa264e9ec36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:34.236983 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51302f53-e3fb-4d07-8d8c-7aa264e9ec36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:34.238405 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51302f53-e3fb-4d07-8d8c-7aa264e9ec36 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-51302f53-e3fb-4d07-8d8c-7aa264e9ec36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:24:34.252585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:34.253616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:34.254723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:24:34.254723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:24:34.254723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:34.254723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:34.254723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 625/1265] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:34.259411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42a7a9-9438-48dd-aff2-e1db7e085c84 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:34.337751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:34.357843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42a7a9-9438-48dd-aff2-e1db7e085c84 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:34.394149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c56e1-ff5a-45ef-9bfa-49e6d4b5ffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:34.394853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c56e1-ff5a-45ef-9bfa-49e6d4b5ffb3 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:34.395226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c56e1-ff5a-45ef-9bfa-49e6d4b5ffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:34.395591 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c56e1-ff5a-45ef-9bfa-49e6d4b5ffb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:34.396329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c56e1-ff5a-45ef-9bfa-49e6d4b5ffb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:34.396685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c56e1-ff5a-45ef-9bfa-49e6d4b5ffb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:34.398233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c56e1-ff5a-45ef-9bfa-49e6d4b5ffb3 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:34.412693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 641/1266] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:34.418541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51302f53-e3fb-4d07-8d8c-7aa264e9ec36 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:34.520113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51302f53-e3fb-4d07-8d8c-7aa264e9ec36 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:34.539370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:34.553399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6df4bc-aa5c-49ea-96db-72e36eabec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:34.554035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6df4bc-aa5c-49ea-96db-72e36eabec84 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:34.554321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6df4bc-aa5c-49ea-96db-72e36eabec84 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:34.554601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6df4bc-aa5c-49ea-96db-72e36eabec84 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:34.561893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6df4bc-aa5c-49ea-96db-72e36eabec84 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:34.563341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6df4bc-aa5c-49ea-96db-72e36eabec84 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-6e6df4bc-aa5c-49ea-96db-72e36eabec84 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:24:34.574325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:34.575391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:34.576427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:34.576427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:34.576427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:24:34.576427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:24:34.576427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:24:34.576427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:24:34.576427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:24:34.576427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:24:34.576427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:24:34.576427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:34.576427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 626/1267] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:34.582058 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c56e1-ff5a-45ef-9bfa-49e6d4b5ffb3 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:34.681643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c56e1-ff5a-45ef-9bfa-49e6d4b5ffb3 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:34.714847 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8bfe-f22a-4131-9330-679366fe3543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:34.715462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8bfe-f22a-4131-9330-679366fe3543 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:34.715746 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8bfe-f22a-4131-9330-679366fe3543 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:34.716058 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8bfe-f22a-4131-9330-679366fe3543 None admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:34.716844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea8bfe-f22a-4131-9330-679366fe3543 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:34.717153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea8bfe-f22a-4131-9330-679366fe3543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:34.719301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea8bfe-f22a-4131-9330-679366fe3543 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:34.727982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:34.737224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 642/1268] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 27 16:24:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:34.743158 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6df4bc-aa5c-49ea-96db-72e36eabec84 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:34.839533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6df4bc-aa5c-49ea-96db-72e36eabec84 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:34.872389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50f74c-2ae6-4e66-a906-0e54ea9ff1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:34.873014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50f74c-2ae6-4e66-a906-0e54ea9ff1ab None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:34.873296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50f74c-2ae6-4e66-a906-0e54ea9ff1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:34.873570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50f74c-2ae6-4e66-a906-0e54ea9ff1ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:34.883754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50f74c-2ae6-4e66-a906-0e54ea9ff1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:34.885200 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50f74c-2ae6-4e66-a906-0e54ea9ff1ab None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-6b50f74c-2ae6-4e66-a906-0e54ea9ff1ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:24:34.899558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:34.900604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:34.901577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:24:34.901577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:24:34.901577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:34.901577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:34.901577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 627/1269] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:34.906868 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8bfe-f22a-4131-9330-679366fe3543 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:35.005021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8bfe-f22a-4131-9330-679366fe3543 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:35.038145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a257222-d9a3-4009-a216-1d4418a25080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:35.038756 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a257222-d9a3-4009-a216-1d4418a25080 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:35.039042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a257222-d9a3-4009-a216-1d4418a25080 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:35.039321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a257222-d9a3-4009-a216-1d4418a25080 None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:35.040033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a257222-d9a3-4009-a216-1d4418a25080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:35.040341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a257222-d9a3-4009-a216-1d4418a25080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:35.041702 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a257222-d9a3-4009-a216-1d4418a25080 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:35.052600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 643/1270] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:35.058164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50f74c-2ae6-4e66-a906-0e54ea9ff1ab None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:35.089879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:35.157863 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50f74c-2ae6-4e66-a906-0e54ea9ff1ab None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:35.190144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205749e-3fa2-46c4-ad17-8a6946794f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:35.190781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205749e-3fa2-46c4-ad17-8a6946794f8b None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:35.191068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205749e-3fa2-46c4-ad17-8a6946794f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:35.191345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205749e-3fa2-46c4-ad17-8a6946794f8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:35.197807 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205749e-3fa2-46c4-ad17-8a6946794f8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:35.199225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205749e-3fa2-46c4-ad17-8a6946794f8b None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-9205749e-3fa2-46c4-ad17-8a6946794f8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:24:35.210905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:35.212050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:35.213371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:24:35.213371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:24:35.213371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:24:35.213371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:24:35.213371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:24:35.213371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:24:35.213371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:24:35.213371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:35.213371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 628/1271] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:24:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:35.217864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a257222-d9a3-4009-a216-1d4418a25080 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:35.275645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:35.317801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a257222-d9a3-4009-a216-1d4418a25080 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:35.350324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52737d-25a7-41dd-9884-9fa280e5653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:35.350878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52737d-25a7-41dd-9884-9fa280e5653c None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:35.351165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52737d-25a7-41dd-9884-9fa280e5653c None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:35.351442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52737d-25a7-41dd-9884-9fa280e5653c None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:35.352214 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52737d-25a7-41dd-9884-9fa280e5653c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:35.352526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52737d-25a7-41dd-9884-9fa280e5653c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:35.353951 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52737d-25a7-41dd-9884-9fa280e5653c None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:35.366108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 644/1272] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:24:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:35.372070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205749e-3fa2-46c4-ad17-8a6946794f8b None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:35.466071 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:35.475279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205749e-3fa2-46c4-ad17-8a6946794f8b None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:35.507806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb8193-3080-4a44-bb03-8f1314c46c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:35.508489 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb8193-3080-4a44-bb03-8f1314c46c66 None admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:35.508771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb8193-3080-4a44-bb03-8f1314c46c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:35.509043 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb8193-3080-4a44-bb03-8f1314c46c66 None admin] PATH_INFO: `/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/f602decb26be477b867493429352bd03/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:35.510923 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb8193-3080-4a44-bb03-8f1314c46c66 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01ef9cd2ffc4edd94cbf0017a720a57, user_id=f602decb26be477b867493429352bd03, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:35.512369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb8193-3080-4a44-bb03-8f1314c46c66 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:35.524623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 629/1273] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 16:24:35 2022] PUT /identity/v3/projects/f01ef9cd2ffc4edd94cbf0017a720a57/users/f602decb26be477b867493429352bd03/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:24:37.470417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b32f-1d7d-44a4-8cbb-4c93a151136f None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:37.470950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b32f-1d7d-44a4-8cbb-4c93a151136f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:37.470950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b32f-1d7d-44a4-8cbb-4c93a151136f None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:37.472341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 645/1274] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:37.477819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb349f28-ff25-4992-82d3-40f9fa327113 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:37.478227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb349f28-ff25-4992-82d3-40f9fa327113 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:37.478372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb349f28-ff25-4992-82d3-40f9fa327113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:37.496134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-cb349f28-ff25-4992-82d3-40f9fa327113 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:37.497320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cb349f28-ff25-4992-82d3-40f9fa327113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:37.569142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 630/1275] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:24:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:24:37.592163 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1b32f-1d7d-44a4-8cbb-4c93a151136f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:37.692520 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1b32f-1d7d-44a4-8cbb-4c93a151136f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:37.708922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:37.725905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bafb90-ee9f-416b-add3-669d50a5933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:37.726531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bafb90-ee9f-416b-add3-669d50a5933b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:37.726812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bafb90-ee9f-416b-add3-669d50a5933b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:37.727086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bafb90-ee9f-416b-add3-669d50a5933b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:37.737588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bafb90-ee9f-416b-add3-669d50a5933b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-81bafb90-ee9f-416b-add3-669d50a5933b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 16:24:37.742442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:37.743566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:37.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:37.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:37.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:37.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:37.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 16:24:37.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 16:24:37.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 16:24:37.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 16:24:37.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 16:24:37.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 16:24:37.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 16:24:37.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:37.744678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 646/1276] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 16:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:37.750156 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb349f28-ff25-4992-82d3-40f9fa327113 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:37.827939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:37.846560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb349f28-ff25-4992-82d3-40f9fa327113 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:37.880223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1334a2-b67e-471c-9d5a-87080518a347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:37.880835 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1334a2-b67e-471c-9d5a-87080518a347 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:37.881122 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1334a2-b67e-471c-9d5a-87080518a347 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:37.881401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1334a2-b67e-471c-9d5a-87080518a347 None admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:37.882111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1334a2-b67e-471c-9d5a-87080518a347 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:37.882420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1334a2-b67e-471c-9d5a-87080518a347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:37.883779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1334a2-b67e-471c-9d5a-87080518a347 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:37.891823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 631/1277] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 16:24:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:37.897364 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bafb90-ee9f-416b-add3-669d50a5933b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:37.995015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bafb90-ee9f-416b-add3-669d50a5933b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:38.027198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50979b68-6124-4d3f-920c-02ef54a84e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:38.027817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50979b68-6124-4d3f-920c-02ef54a84e2b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:38.028124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50979b68-6124-4d3f-920c-02ef54a84e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:38.028399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50979b68-6124-4d3f-920c-02ef54a84e2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:38.038729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50979b68-6124-4d3f-920c-02ef54a84e2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:38.040180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50979b68-6124-4d3f-920c-02ef54a84e2b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-50979b68-6124-4d3f-920c-02ef54a84e2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:24:38.054490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:38.055471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:38.056885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:24:38.056885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:24:38.056885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:38.056885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:38.056885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 647/1278] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:38.061256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1334a2-b67e-471c-9d5a-87080518a347 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:38.158801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1334a2-b67e-471c-9d5a-87080518a347 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:38.191199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bd7fe-b0e1-4834-a0ba-fb03f198c0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:38.191808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bd7fe-b0e1-4834-a0ba-fb03f198c0ca None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:38.192124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bd7fe-b0e1-4834-a0ba-fb03f198c0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:38.192415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bd7fe-b0e1-4834-a0ba-fb03f198c0ca None admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:38.193094 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bd7fe-b0e1-4834-a0ba-fb03f198c0ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:38.193400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bd7fe-b0e1-4834-a0ba-fb03f198c0ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:38.194747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bd7fe-b0e1-4834-a0ba-fb03f198c0ca None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:38.206861 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 632/1279] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:38.212348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50979b68-6124-4d3f-920c-02ef54a84e2b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:38.242642 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:38.309618 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50979b68-6124-4d3f-920c-02ef54a84e2b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:38.341553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16083c9f-8b20-4e45-8cef-5a681d5d6c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:38.342174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16083c9f-8b20-4e45-8cef-5a681d5d6c93 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:38.342456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16083c9f-8b20-4e45-8cef-5a681d5d6c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:38.342733 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16083c9f-8b20-4e45-8cef-5a681d5d6c93 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:38.350442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16083c9f-8b20-4e45-8cef-5a681d5d6c93 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:38.351873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16083c9f-8b20-4e45-8cef-5a681d5d6c93 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-16083c9f-8b20-4e45-8cef-5a681d5d6c93 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 16:24:38.363363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:38.364532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:38.365723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:38.365723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:38.365723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 16:24:38.365723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 16:24:38.365723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 16:24:38.365723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 16:24:38.365723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 16:24:38.365723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 16:24:38.365723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 16:24:38.365723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:38.365723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 648/1280] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:38.370201 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bd7fe-b0e1-4834-a0ba-fb03f198c0ca None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:38.373941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:38.474110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bd7fe-b0e1-4834-a0ba-fb03f198c0ca None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:38.508447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032a3f4-eba1-46d4-8901-7511dee111e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:38.509071 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032a3f4-eba1-46d4-8901-7511dee111e3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:38.509360 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032a3f4-eba1-46d4-8901-7511dee111e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:38.509640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032a3f4-eba1-46d4-8901-7511dee111e3 None admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:38.510426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032a3f4-eba1-46d4-8901-7511dee111e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:38.510737 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032a3f4-eba1-46d4-8901-7511dee111e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:38.512206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032a3f4-eba1-46d4-8901-7511dee111e3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:38.528694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 633/1281] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 27 16:24:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:38.534414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16083c9f-8b20-4e45-8cef-5a681d5d6c93 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:38.622984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:38.633102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16083c9f-8b20-4e45-8cef-5a681d5d6c93 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:38.666132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac03d90-e7ac-4db1-af96-532775d39a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:38.666758 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03d90-e7ac-4db1-af96-532775d39a94 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:38.667046 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03d90-e7ac-4db1-af96-532775d39a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:38.667327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac03d90-e7ac-4db1-af96-532775d39a94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:38.734528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac03d90-e7ac-4db1-af96-532775d39a94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:38.736118 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac03d90-e7ac-4db1-af96-532775d39a94 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:38.820725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:38.831431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 649/1282] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 16:24:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 16:24:38.837238 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032a3f4-eba1-46d4-8901-7511dee111e3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:38.895880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:38.933496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032a3f4-eba1-46d4-8901-7511dee111e3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:38.966622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38293762-a456-4bbf-9c9c-3d1950feccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:38.967245 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293762-a456-4bbf-9c9c-3d1950feccef None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:38.967530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293762-a456-4bbf-9c9c-3d1950feccef None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:38.967801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293762-a456-4bbf-9c9c-3d1950feccef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:38.978319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38293762-a456-4bbf-9c9c-3d1950feccef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:38.979734 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38293762-a456-4bbf-9c9c-3d1950feccef None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-38293762-a456-4bbf-9c9c-3d1950feccef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 16:24:38.993908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:38.994984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:38.996067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 16:24:38.996067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 16:24:38.996067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 16:24:38.996067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:38.996067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 634/1283] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:39.001372 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac03d90-e7ac-4db1-af96-532775d39a94 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:39.097539 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac03d90-e7ac-4db1-af96-532775d39a94 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:39.130151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c5699-c303-4f2c-b146-bda42c16ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:39.130753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c5699-c303-4f2c-b146-bda42c16ac3b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:39.131034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c5699-c303-4f2c-b146-bda42c16ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:39.131308 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c5699-c303-4f2c-b146-bda42c16ac3b None admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:39.132009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c5699-c303-4f2c-b146-bda42c16ac3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:39.132312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c5699-c303-4f2c-b146-bda42c16ac3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:39.133662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c5699-c303-4f2c-b146-bda42c16ac3b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:39.144872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 650/1284] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 16:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:39.150422 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38293762-a456-4bbf-9c9c-3d1950feccef None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:39.247582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38293762-a456-4bbf-9c9c-3d1950feccef None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:39.260907 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:39.282514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3afc46-cd5a-4405-ae22-d437725bf31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:39.283149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3afc46-cd5a-4405-ae22-d437725bf31a None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:39.283437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3afc46-cd5a-4405-ae22-d437725bf31a None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:39.283718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3afc46-cd5a-4405-ae22-d437725bf31a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:39.290290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3afc46-cd5a-4405-ae22-d437725bf31a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:39.291709 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3afc46-cd5a-4405-ae22-d437725bf31a None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application [None req-0c3afc46-cd5a-4405-ae22-d437725bf31a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 16:24:39.303680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:39.304757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:39.305872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 16:24:39.305872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 16:24:39.305872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 16:24:39.305872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 16:24:39.305872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 16:24:39.305872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 16:24:39.305872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 16:24:39.305872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: ERROR keystone.server.flask.application Jul 27 16:24:39.305872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 635/1285] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 16:24:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:39.310536 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c5699-c303-4f2c-b146-bda42c16ac3b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:39.360914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:39.412091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c5699-c303-4f2c-b146-bda42c16ac3b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:39.444330 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7709c3-1c60-4d0c-89b2-ef217a5a0f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:39.444940 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7709c3-1c60-4d0c-89b2-ef217a5a0f45 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:39.445221 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7709c3-1c60-4d0c-89b2-ef217a5a0f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:39.445496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7709c3-1c60-4d0c-89b2-ef217a5a0f45 None admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:39.446228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7709c3-1c60-4d0c-89b2-ef217a5a0f45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:39.446534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7709c3-1c60-4d0c-89b2-ef217a5a0f45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:39.447973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7709c3-1c60-4d0c-89b2-ef217a5a0f45 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:39.460644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 651/1286] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 16:24:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:39.466767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3afc46-cd5a-4405-ae22-d437725bf31a None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:39.566236 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3afc46-cd5a-4405-ae22-d437725bf31a None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:39.600042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b3085-ec3e-4445-a3f8-c7b86907b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:39.600652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b3085-ec3e-4445-a3f8-c7b86907b092 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:39.600938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b3085-ec3e-4445-a3f8-c7b86907b092 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:39.601223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b3085-ec3e-4445-a3f8-c7b86907b092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:39.601995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b3085-ec3e-4445-a3f8-c7b86907b092 None admin] RBAC: Adding query filter params (role.id=83f21a1ed4e846b7a920b79671b52db9, scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57, user.id=f602decb26be477b867493429352bd03) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:39.602302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b3085-ec3e-4445-a3f8-c7b86907b092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:39.603734 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b3085-ec3e-4445-a3f8-c7b86907b092 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:39.609867 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 636/1287] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 16:24:39 2022] GET /identity/v3/role_assignments?user.id=f602decb26be477b867493429352bd03&scope.project.id=f01ef9cd2ffc4edd94cbf0017a720a57&role.id=83f21a1ed4e846b7a920b79671b52db9 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:41.617122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6342c-f631-48db-9302-86c8640856f6 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:41.617758 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6342c-f631-48db-9302-86c8640856f6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:41.617758 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6342c-f631-48db-9302-86c8640856f6 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:41.619034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 652/1288] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:41.624285 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4be921-be48-4a0e-afc8-6e261b71a450 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:41.624779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4be921-be48-4a0e-afc8-6e261b71a450 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:41.624882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4be921-be48-4a0e-afc8-6e261b71a450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:41.643562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-cb4be921-be48-4a0e-afc8-6e261b71a450 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:41.644797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cb4be921-be48-4a0e-afc8-6e261b71a450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:41.673985 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:41.711416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 637/1289] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:24:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:24:41.733410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6342c-f631-48db-9302-86c8640856f6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:41.833324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6342c-f631-48db-9302-86c8640856f6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:41.843548 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:41.866902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c06c-e441-4fd6-bd8c-e0f9dda8a391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:41.867583 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c06c-e441-4fd6-bd8c-e0f9dda8a391 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:41.867821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c06c-e441-4fd6-bd8c-e0f9dda8a391 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:41.868130 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c06c-e441-4fd6-bd8c-e0f9dda8a391 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:41.868756 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3c06c-e441-4fd6-bd8c-e0f9dda8a391 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:41.870132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3c06c-e441-4fd6-bd8c-e0f9dda8a391 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-12d3c06c-e441-4fd6-bd8c-e0f9dda8a391 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:41.879462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:41.880840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:41.882063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 653/1290] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 16:24:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:41.886561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4be921-be48-4a0e-afc8-6e261b71a450 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:41.983263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4be921-be48-4a0e-afc8-6e261b71a450 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:42.016987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e20440-1786-4565-b4d5-a5879772d569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:42.017810 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e20440-1786-4565-b4d5-a5879772d569 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:42.018103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e20440-1786-4565-b4d5-a5879772d569 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:42.018387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e20440-1786-4565-b4d5-a5879772d569 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:42.019064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e20440-1786-4565-b4d5-a5879772d569 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:42.019375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e20440-1786-4565-b4d5-a5879772d569 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:42.020762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e20440-1786-4565-b4d5-a5879772d569 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:42.025467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 638/1291] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Jul 27 16:24:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:42.031182 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c06c-e441-4fd6-bd8c-e0f9dda8a391 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:42.129346 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c06c-e441-4fd6-bd8c-e0f9dda8a391 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:42.161297 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23304296-42c1-4fb2-80e8-5c7f051c5f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:42.161903 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23304296-42c1-4fb2-80e8-5c7f051c5f16 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:42.162187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23304296-42c1-4fb2-80e8-5c7f051c5f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:42.162469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23304296-42c1-4fb2-80e8-5c7f051c5f16 None admin] PATH_INFO: `/v3/services` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:42.163138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23304296-42c1-4fb2-80e8-5c7f051c5f16 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:42.163447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23304296-42c1-4fb2-80e8-5c7f051c5f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:42.164841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23304296-42c1-4fb2-80e8-5c7f051c5f16 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:42.169133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 654/1292] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Jul 27 16:24:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:44.158688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911f10b-84c0-4bfd-84b8-8005d766363e None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:44.159243 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911f10b-84c0-4bfd-84b8-8005d766363e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:44.159243 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911f10b-84c0-4bfd-84b8-8005d766363e None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:44.160699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 639/1293] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:44.165685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e77c-7f02-4625-907e-75e13d1bd82e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:44.166125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e77c-7f02-4625-907e-75e13d1bd82e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:44.166235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e77c-7f02-4625-907e-75e13d1bd82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:44.184332 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f7b3e77c-7f02-4625-907e-75e13d1bd82e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:44.185495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f7b3e77c-7f02-4625-907e-75e13d1bd82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:44.213721 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:44.252263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 655/1294] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:24:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:24:44.274557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911f10b-84c0-4bfd-84b8-8005d766363e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:44.304762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:44.372444 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911f10b-84c0-4bfd-84b8-8005d766363e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:44.415429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b54ef-987e-45a2-921f-8dd71aca9e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:44.416406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b54ef-987e-45a2-921f-8dd71aca9e39 None admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:44.416695 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b54ef-987e-45a2-921f-8dd71aca9e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:44.417042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b54ef-987e-45a2-921f-8dd71aca9e39 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:44.418008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b54ef-987e-45a2-921f-8dd71aca9e39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:44.419806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b54ef-987e-45a2-921f-8dd71aca9e39 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:44.439211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 640/1295] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 16:24:44 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:24:46.404724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad90257-0c93-4fda-a358-af9b29b6a6ea None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:46.405278 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad90257-0c93-4fda-a358-af9b29b6a6ea None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:46.405278 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad90257-0c93-4fda-a358-af9b29b6a6ea None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:46.406709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 656/1296] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:46.411842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44c6ca-51a6-4ba9-ad33-349fa1724620 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:46.412308 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44c6ca-51a6-4ba9-ad33-349fa1724620 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:46.412412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44c6ca-51a6-4ba9-ad33-349fa1724620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:46.429992 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ae44c6ca-51a6-4ba9-ad33-349fa1724620 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:46.431154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ae44c6ca-51a6-4ba9-ad33-349fa1724620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:46.501411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 641/1297] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:24:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:24:46.524220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad90257-0c93-4fda-a358-af9b29b6a6ea None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:46.622689 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad90257-0c93-4fda-a358-af9b29b6a6ea None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:46.657601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e074c83-5a52-4dce-a828-b555831a5a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:46.658189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e074c83-5a52-4dce-a828-b555831a5a95 None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:46.658476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e074c83-5a52-4dce-a828-b555831a5a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:46.658757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e074c83-5a52-4dce-a828-b555831a5a95 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:46.659386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e074c83-5a52-4dce-a828-b555831a5a95 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:46.660796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e074c83-5a52-4dce-a828-b555831a5a95 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-4e074c83-5a52-4dce-a828-b555831a5a95 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:46.669564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:46.670725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:46.672532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 657/1298] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 16:24:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:46.677622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44c6ca-51a6-4ba9-ad33-349fa1724620 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:46.696297 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:46.775686 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44c6ca-51a6-4ba9-ad33-349fa1724620 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:46.808369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7796bf-b625-43c1-9d63-42b5c5f55ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:46.808981 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7796bf-b625-43c1-9d63-42b5c5f55ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:46.809268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7796bf-b625-43c1-9d63-42b5c5f55ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:46.809550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7796bf-b625-43c1-9d63-42b5c5f55ca3 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:46.810225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7796bf-b625-43c1-9d63-42b5c5f55ca3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:46.810535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7796bf-b625-43c1-9d63-42b5c5f55ca3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:46.811908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7796bf-b625-43c1-9d63-42b5c5f55ca3 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:46.817445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 642/1299] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Jul 27 16:24:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:46.823497 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e074c83-5a52-4dce-a828-b555831a5a95 None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:46.853855 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:46.921997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e074c83-5a52-4dce-a828-b555831a5a95 None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:46.954043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3403c6b-902d-4f0d-a0dd-9551babbd44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:46.954650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3403c6b-902d-4f0d-a0dd-9551babbd44d None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:46.954931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3403c6b-902d-4f0d-a0dd-9551babbd44d None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:46.955212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3403c6b-902d-4f0d-a0dd-9551babbd44d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:46.955992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3403c6b-902d-4f0d-a0dd-9551babbd44d None admin] RBAC: Adding query filter params (interface=public, service_id=d75d195ff67049119953c67f5df20784, region_id=RegionOne) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:46.956307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3403c6b-902d-4f0d-a0dd-9551babbd44d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:46.957669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3403c6b-902d-4f0d-a0dd-9551babbd44d None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:46.962544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 658/1300] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 16:24:46 2022] GET /identity/v3/endpoints?service_id=d75d195ff67049119953c67f5df20784&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:46.968155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7796bf-b625-43c1-9d63-42b5c5f55ca3 None admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:47.048672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:47.066643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7796bf-b625-43c1-9d63-42b5c5f55ca3 None admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:47.099445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c363ce-253e-4281-8197-00f183b74634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:47.100082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c363ce-253e-4281-8197-00f183b74634 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:47.100372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c363ce-253e-4281-8197-00f183b74634 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:47.100649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c363ce-253e-4281-8197-00f183b74634 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:47.101294 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c363ce-253e-4281-8197-00f183b74634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:47.102657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c363ce-253e-4281-8197-00f183b74634 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:47.109894 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 643/1301] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 16:24:46 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:24:49.078736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6b55b-e59b-4e42-b92f-3cd9f2fa5270 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:49.079300 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6b55b-e59b-4e42-b92f-3cd9f2fa5270 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:49.079300 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6b55b-e59b-4e42-b92f-3cd9f2fa5270 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:49.080841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 659/1302] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:24:49.086032 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5937b1c-3171-4f6d-b663-c24b45ba130c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:49.086430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5937b1c-3171-4f6d-b663-c24b45ba130c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:49.086589 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5937b1c-3171-4f6d-b663-c24b45ba130c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:49.105035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e5937b1c-3171-4f6d-b663-c24b45ba130c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:24:49.106209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e5937b1c-3171-4f6d-b663-c24b45ba130c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:24:49.173890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 644/1303] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:24:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 16:24:49.196130 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6b55b-e59b-4e42-b92f-3cd9f2fa5270 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:49.291227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:49.298988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6b55b-e59b-4e42-b92f-3cd9f2fa5270 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:49.331159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef588e-33b9-43b1-9789-b7f3bcb2977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:49.331728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef588e-33b9-43b1-9789-b7f3bcb2977b None admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:49.332037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef588e-33b9-43b1-9789-b7f3bcb2977b None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:49.332314 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef588e-33b9-43b1-9789-b7f3bcb2977b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:49.332931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef588e-33b9-43b1-9789-b7f3bcb2977b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:49.334288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef588e-33b9-43b1-9789-b7f3bcb2977b None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application [None req-a9ef588e-33b9-43b1-9789-b7f3bcb2977b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 16:24:49.342854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 16:24:49.344698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application with Lock( Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self._enter() Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application return self.creator() Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application created_value = creator( Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: ERROR keystone.server.flask.application Jul 27 16:24:49.345867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 660/1304] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 16:24:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 16:24:49.351471 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5937b1c-3171-4f6d-b663-c24b45ba130c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:49.435089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:49.457290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5937b1c-3171-4f6d-b663-c24b45ba130c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:49.490891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191e3a5-9cf7-427f-a2fe-9223530eeec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:49.491509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191e3a5-9cf7-427f-a2fe-9223530eeec7 None admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:49.491797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191e3a5-9cf7-427f-a2fe-9223530eeec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:49.492105 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191e3a5-9cf7-427f-a2fe-9223530eeec7 None admin] PATH_INFO: `/v3/services` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:49.492785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191e3a5-9cf7-427f-a2fe-9223530eeec7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:24:49.493096 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191e3a5-9cf7-427f-a2fe-9223530eeec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:49.494459 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191e3a5-9cf7-427f-a2fe-9223530eeec7 None admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:49.499431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 645/1305] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Jul 27 16:24:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:24:49.505256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef588e-33b9-43b1-9789-b7f3bcb2977b None admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:24:49.604730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef588e-33b9-43b1-9789-b7f3bcb2977b None admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:24:49.649567 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5feb0-b4ba-4dbc-a932-4a9481088b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:24:49.650199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5feb0-b4ba-4dbc-a932-4a9481088b70 None admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:24:49.650486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5feb0-b4ba-4dbc-a932-4a9481088b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:24:49.650768 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5feb0-b4ba-4dbc-a932-4a9481088b70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:24:49.651486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5feb0-b4ba-4dbc-a932-4a9481088b70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:24:49.652890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5feb0-b4ba-4dbc-a932-4a9481088b70 None admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:24:49.673004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 661/1306] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:24:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:24:59.496905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=30 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:24:59.668661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:25:52.080307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f0bd-5b14-4327-9603-b3e746c1c4d6 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:52.080890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f0bd-5b14-4327-9603-b3e746c1c4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:52.080890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3f0bd-5b14-4327-9603-b3e746c1c4d6 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:52.087953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01853c3f-fb7f-4cd2-ba2f-d952fce495a3 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:52.087953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01853c3f-fb7f-4cd2-ba2f-d952fce495a3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:52.088783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01853c3f-fb7f-4cd2-ba2f-d952fce495a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:52.092281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 646/1307] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:25:52 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:25:52.165418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-01853c3f-fb7f-4cd2-ba2f-d952fce495a3 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:25:52.166656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-01853c3f-fb7f-4cd2-ba2f-d952fce495a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:52.333352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 662/1308] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:25:52.366527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da517ac-4051-4e14-b401-4735f4ce8894 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:52.366825 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da517ac-4051-4e14-b401-4735f4ce8894 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:52.367103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da517ac-4051-4e14-b401-4735f4ce8894 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:52.368509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 647/1309] 10.222.0.67 () {54 vars in 965 bytes} [Wed Jul 27 16:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:25:52.375235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184b9ed-2c84-46db-886a-8906c39cdc90 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:52.375531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184b9ed-2c84-46db-886a-8906c39cdc90 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:52.375809 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184b9ed-2c84-46db-886a-8906c39cdc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:52.523395 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d184b9ed-2c84-46db-886a-8906c39cdc90 None None] MFA Rules not processed for user `73325bdd109749ad92a66e600fd61a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:25:52.525488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d184b9ed-2c84-46db-886a-8906c39cdc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:52.555780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:25:52.640258 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 663/1310] 10.222.0.67 () {58 vars in 1062 bytes} [Wed Jul 27 16:25:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:25:52.649601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da517ac-4051-4e14-b401-4735f4ce8894 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:25:52.654320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3da517ac-4051-4e14-b401-4735f4ce8894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:52.794697 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da517ac-4051-4e14-b401-4735f4ce8894 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:25:52.886867 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad81a48-4ae6-4725-904c-3f10cc233572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:25:52.887503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81a48-4ae6-4725-904c-3f10cc233572 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:52.887793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81a48-4ae6-4725-904c-3f10cc233572 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:52.888106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81a48-4ae6-4725-904c-3f10cc233572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:52.889785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6ad81a48-4ae6-4725-904c-3f10cc233572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:52.958035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:25:53.027143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad81a48-4ae6-4725-904c-3f10cc233572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:25:53.028768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad81a48-4ae6-4725-904c-3f10cc233572 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:25:53.053429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 648/1311] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:25:55.425574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7dcba-7cf9-4578-ae85-cb006109ce73 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:55.426114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7dcba-7cf9-4578-ae85-cb006109ce73 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:55.426114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7dcba-7cf9-4578-ae85-cb006109ce73 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:55.427670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 664/1312] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:25:55.432694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d0eba-eac7-48a2-89cf-3a968c9dbc17 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:55.433126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d0eba-eac7-48a2-89cf-3a968c9dbc17 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:55.433262 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d0eba-eac7-48a2-89cf-3a968c9dbc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:55.642834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2d8d0eba-eac7-48a2-89cf-3a968c9dbc17 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:25:55.644131 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2d8d0eba-eac7-48a2-89cf-3a968c9dbc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:55.764265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 649/1313] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:25:55.813934 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8261a20-d6c6-42dd-bd51-f84bad575b03 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:55.814255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8261a20-d6c6-42dd-bd51-f84bad575b03 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:55.814535 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8261a20-d6c6-42dd-bd51-f84bad575b03 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:55.816191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 665/1314] 10.222.0.67 () {54 vars in 965 bytes} [Wed Jul 27 16:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:25:55.822537 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3382f2f-6249-448c-bce8-119e1a0be17d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:55.822825 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3382f2f-6249-448c-bce8-119e1a0be17d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:55.823094 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3382f2f-6249-448c-bce8-119e1a0be17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:55.836649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:25:55.909643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e3382f2f-6249-448c-bce8-119e1a0be17d None None] MFA Rules not processed for user `73325bdd109749ad92a66e600fd61a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:25:55.911020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e3382f2f-6249-448c-bce8-119e1a0be17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:55.993822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 650/1315] 10.222.0.67 () {58 vars in 1062 bytes} [Wed Jul 27 16:25:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:25:56.003544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8261a20-d6c6-42dd-bd51-f84bad575b03 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:25:56.005080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b8261a20-d6c6-42dd-bd51-f84bad575b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:56.121629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8261a20-d6c6-42dd-bd51-f84bad575b03 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:25:56.195690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:25:56.198642 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77061206-c4f5-44f1-a543-8149a75b6b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:25:56.199350 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061206-c4f5-44f1-a543-8149a75b6b18 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:56.199843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061206-c4f5-44f1-a543-8149a75b6b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:56.200332 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77061206-c4f5-44f1-a543-8149a75b6b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:56.202209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-77061206-c4f5-44f1-a543-8149a75b6b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:56.312976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77061206-c4f5-44f1-a543-8149a75b6b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:25:56.315768 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77061206-c4f5-44f1-a543-8149a75b6b18 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:25:56.334570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 666/1316] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:25:58.875481 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53294e-2ff0-4090-8b3b-85986e7cd1d8 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:58.876118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53294e-2ff0-4090-8b3b-85986e7cd1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:58.876118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53294e-2ff0-4090-8b3b-85986e7cd1d8 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:58.877934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 651/1317] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:25:58.883150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d52f1e-2fbe-44f5-b3a2-595a1cc3c269 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:58.883596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d52f1e-2fbe-44f5-b3a2-595a1cc3c269 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:58.883704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d52f1e-2fbe-44f5-b3a2-595a1cc3c269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:58.950966 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-05d52f1e-2fbe-44f5-b3a2-595a1cc3c269 None None] MFA Rules not processed for user `f1e2907aa13946e8a0176f034f6fb069`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:25:58.952140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-05d52f1e-2fbe-44f5-b3a2-595a1cc3c269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:59.004022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:25:59.048826 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 667/1318] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:25:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:25:59.089240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53294e-2ff0-4090-8b3b-85986e7cd1d8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:25:59.090777 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7e53294e-2ff0-4090-8b3b-85986e7cd1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:59.190727 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53294e-2ff0-4090-8b3b-85986e7cd1d8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:25:59.193493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:25:59.262289 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d8e04-a13c-48b2-9ecf-263b0cb9030d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:25:59.262898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d8e04-a13c-48b2-9ecf-263b0cb9030d service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:25:59.263174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d8e04-a13c-48b2-9ecf-263b0cb9030d service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:25:59.263441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d8e04-a13c-48b2-9ecf-263b0cb9030d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:25:59.265059 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4f6d8e04-a13c-48b2-9ecf-263b0cb9030d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:25:59.372103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d8e04-a13c-48b2-9ecf-263b0cb9030d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:25:59.373525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d8e04-a13c-48b2-9ecf-263b0cb9030d service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:25:59.392488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 652/1319] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:25:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:01.946579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff242c5-5dd6-4965-ba78-c291a9944b88 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:01.947097 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff242c5-5dd6-4965-ba78-c291a9944b88 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:01.947097 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff242c5-5dd6-4965-ba78-c291a9944b88 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:01.948508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 668/1320] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:01.953552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff003c6-0210-4cbd-8f13-ccc4299df28e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:01.953953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff003c6-0210-4cbd-8f13-ccc4299df28e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:01.954106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff003c6-0210-4cbd-8f13-ccc4299df28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:01.994117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:02.020501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1ff003c6-0210-4cbd-8f13-ccc4299df28e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:02.021922 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1ff003c6-0210-4cbd-8f13-ccc4299df28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:02.117084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 653/1321] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:02.156011 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff242c5-5dd6-4965-ba78-c291a9944b88 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:02.157554 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5ff242c5-5dd6-4965-ba78-c291a9944b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:02.262981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff242c5-5dd6-4965-ba78-c291a9944b88 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:02.336281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec251064-1d2c-4b92-8d65-1d93d54630f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:02.336908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec251064-1d2c-4b92-8d65-1d93d54630f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:02.337210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec251064-1d2c-4b92-8d65-1d93d54630f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:02.337493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec251064-1d2c-4b92-8d65-1d93d54630f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:02.339124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ec251064-1d2c-4b92-8d65-1d93d54630f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:02.347319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:02.448754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec251064-1d2c-4b92-8d65-1d93d54630f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:02.450183 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec251064-1d2c-4b92-8d65-1d93d54630f6 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:02.468643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 669/1322] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:05.151981 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb08990-f7c4-4088-adf0-753e14fba144 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:05.152546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb08990-f7c4-4088-adf0-753e14fba144 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:05.152546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb08990-f7c4-4088-adf0-753e14fba144 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:05.154057 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 654/1323] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:05.159735 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87c20-0ead-4eeb-ba59-8d3c6d5e0669 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:05.160177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87c20-0ead-4eeb-ba59-8d3c6d5e0669 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:05.160345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87c20-0ead-4eeb-ba59-8d3c6d5e0669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:05.226495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-77e87c20-0ead-4eeb-ba59-8d3c6d5e0669 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:05.227704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-77e87c20-0ead-4eeb-ba59-8d3c6d5e0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:05.289493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:05.331348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 670/1324] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:05.375818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb08990-f7c4-4088-adf0-753e14fba144 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:05.377624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-edb08990-f7c4-4088-adf0-753e14fba144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:05.491000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb08990-f7c4-4088-adf0-753e14fba144 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:05.503743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:05.566437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f893ea-0816-424c-9c06-7c38fea352c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:05.567054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f893ea-0816-424c-9c06-7c38fea352c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:05.567343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f893ea-0816-424c-9c06-7c38fea352c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:05.567614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f893ea-0816-424c-9c06-7c38fea352c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:05.569242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-46f893ea-0816-424c-9c06-7c38fea352c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:05.683051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f893ea-0816-424c-9c06-7c38fea352c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:05.684510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f893ea-0816-424c-9c06-7c38fea352c4 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:05.703088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 655/1325] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:07.801459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aff6bc-87ec-4402-9039-d1474d017115 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:07.801972 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aff6bc-87ec-4402-9039-d1474d017115 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:07.802066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aff6bc-87ec-4402-9039-d1474d017115 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:07.803435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 671/1326] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:07.808683 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f42d-b982-4fc3-9834-3044da1df2a8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:07.809137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f42d-b982-4fc3-9834-3044da1df2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:07.809232 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f42d-b982-4fc3-9834-3044da1df2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:07.856609 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:07.875270 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-63c2f42d-b982-4fc3-9834-3044da1df2a8 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:07.876496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-63c2f42d-b982-4fc3-9834-3044da1df2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:07.971925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 656/1327] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:08.009487 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aff6bc-87ec-4402-9039-d1474d017115 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:08.011094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-21aff6bc-87ec-4402-9039-d1474d017115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:08.114794 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aff6bc-87ec-4402-9039-d1474d017115 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:08.188503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d3113-21ea-4088-b129-2e040a04e6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:08.189129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d3113-21ea-4088-b129-2e040a04e6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:08.189437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d3113-21ea-4088-b129-2e040a04e6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:08.189715 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d3113-21ea-4088-b129-2e040a04e6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:08.191380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-427d3113-21ea-4088-b129-2e040a04e6b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:08.211251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:08.308276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d3113-21ea-4088-b129-2e040a04e6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:08.309709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d3113-21ea-4088-b129-2e040a04e6b0 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:08.327928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 672/1328] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:10.392437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2052e5-5a39-48f2-b3bc-a9b1d2255ff7 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:10.393580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2052e5-5a39-48f2-b3bc-a9b1d2255ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:10.393580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2052e5-5a39-48f2-b3bc-a9b1d2255ff7 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:10.394919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 657/1329] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:10.400201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a097-5662-4a42-8b54-a9e7fb5586f3 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:10.400656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a097-5662-4a42-8b54-a9e7fb5586f3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:10.400894 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a097-5662-4a42-8b54-a9e7fb5586f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:10.466435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b0a5a097-5662-4a42-8b54-a9e7fb5586f3 None None] MFA Rules not processed for user `f1e2907aa13946e8a0176f034f6fb069`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:10.467642 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b0a5a097-5662-4a42-8b54-a9e7fb5586f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:10.533586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:10.573328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 673/1330] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:10.610910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2052e5-5a39-48f2-b3bc-a9b1d2255ff7 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:10.613216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7e2052e5-5a39-48f2-b3bc-a9b1d2255ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:10.721508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2052e5-5a39-48f2-b3bc-a9b1d2255ff7 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:10.741779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:10.795068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a71a7-de01-4f9a-b766-2306114eafb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:10.795603 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a71a7-de01-4f9a-b766-2306114eafb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:10.795912 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a71a7-de01-4f9a-b766-2306114eafb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:10.796188 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a71a7-de01-4f9a-b766-2306114eafb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:10.797782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fa2a71a7-de01-4f9a-b766-2306114eafb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:10.907273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a71a7-de01-4f9a-b766-2306114eafb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:10.909315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a71a7-de01-4f9a-b766-2306114eafb7 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:10.929399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 658/1331] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:13.185909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a002-a061-4e6f-8cb3-858d38b8253e None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:13.186427 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a002-a061-4e6f-8cb3-858d38b8253e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:13.186427 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a002-a061-4e6f-8cb3-858d38b8253e None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:13.187750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 674/1332] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:13.193530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf3754-b1f0-4a06-94af-3f827e914ccb None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:13.193918 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf3754-b1f0-4a06-94af-3f827e914ccb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:13.194075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf3754-b1f0-4a06-94af-3f827e914ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:13.255875 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:13.258829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-72cf3754-b1f0-4a06-94af-3f827e914ccb None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:13.260661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-72cf3754-b1f0-4a06-94af-3f827e914ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:13.355510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 659/1333] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:13.391929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a002-a061-4e6f-8cb3-858d38b8253e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:13.394372 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-26f4a002-a061-4e6f-8cb3-858d38b8253e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:13.495645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a002-a061-4e6f-8cb3-858d38b8253e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:13.566626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f8b24-7877-458b-9e05-8189e1089ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:13.567235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f8b24-7877-458b-9e05-8189e1089ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:13.567516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f8b24-7877-458b-9e05-8189e1089ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:13.567788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f8b24-7877-458b-9e05-8189e1089ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:13.569416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-448f8b24-7877-458b-9e05-8189e1089ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:13.595557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:13.679592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f8b24-7877-458b-9e05-8189e1089ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:13.681086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f8b24-7877-458b-9e05-8189e1089ab3 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:13.700504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 675/1334] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:15.785724 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055515f-9be5-44ec-acb8-ecd6bd199758 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:15.786316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055515f-9be5-44ec-acb8-ecd6bd199758 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:15.786316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055515f-9be5-44ec-acb8-ecd6bd199758 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:15.787610 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 660/1335] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:26:15.792688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787948ce-e5cc-4a59-91c1-fd8f5ce98f33 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:15.793086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787948ce-e5cc-4a59-91c1-fd8f5ce98f33 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:15.793247 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787948ce-e5cc-4a59-91c1-fd8f5ce98f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:15.857168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-787948ce-e5cc-4a59-91c1-fd8f5ce98f33 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:15.858359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-787948ce-e5cc-4a59-91c1-fd8f5ce98f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:15.930493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:15.952411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 676/1336] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:15.992755 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055515f-9be5-44ec-acb8-ecd6bd199758 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:15.994265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b055515f-9be5-44ec-acb8-ecd6bd199758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:16.095445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055515f-9be5-44ec-acb8-ecd6bd199758 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:16.123852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:16.168427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f198f9-171d-4006-8ce1-663b76f6601a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:16.169048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f198f9-171d-4006-8ce1-663b76f6601a service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:16.169332 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f198f9-171d-4006-8ce1-663b76f6601a service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:16.169608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f198f9-171d-4006-8ce1-663b76f6601a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:16.171222 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b9f198f9-171d-4006-8ce1-663b76f6601a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:16.277510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f198f9-171d-4006-8ce1-663b76f6601a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:16.278929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f198f9-171d-4006-8ce1-663b76f6601a service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:16.298089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 661/1337] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:18.711988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8626e-6fb8-4c6c-86d0-694d67538957 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:18.712526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8626e-6fb8-4c6c-86d0-694d67538957 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:18.712630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8626e-6fb8-4c6c-86d0-694d67538957 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:18.713912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 677/1338] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:18.719264 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba013655-9a19-4999-8fef-75c371f25350 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:18.719647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba013655-9a19-4999-8fef-75c371f25350 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:18.719814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba013655-9a19-4999-8fef-75c371f25350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:18.786109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ba013655-9a19-4999-8fef-75c371f25350 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:18.787314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ba013655-9a19-4999-8fef-75c371f25350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:18.795378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:18.882768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 662/1339] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:18.919413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8626e-6fb8-4c6c-86d0-694d67538957 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:18.920999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4bc8626e-6fb8-4c6c-86d0-694d67538957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:19.025379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8626e-6fb8-4c6c-86d0-694d67538957 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:19.097535 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19d5f9-8f51-4f3e-823e-41899d7b8110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:19.098150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19d5f9-8f51-4f3e-823e-41899d7b8110 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:19.098435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19d5f9-8f51-4f3e-823e-41899d7b8110 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:19.098712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19d5f9-8f51-4f3e-823e-41899d7b8110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:19.100358 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4a19d5f9-8f51-4f3e-823e-41899d7b8110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:19.135956 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:19.211112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19d5f9-8f51-4f3e-823e-41899d7b8110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:19.212582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19d5f9-8f51-4f3e-823e-41899d7b8110 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:19.231310 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 678/1340] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:23.140335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372472-bc80-47d3-8b2c-356ab2a27ba3 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:23.140859 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372472-bc80-47d3-8b2c-356ab2a27ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:23.140859 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372472-bc80-47d3-8b2c-356ab2a27ba3 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:23.142220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 663/1341] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:23.147695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a5f8c-2210-4ec1-b21d-eb333eafaabe None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:23.148180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a5f8c-2210-4ec1-b21d-eb333eafaabe None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:23.148294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a5f8c-2210-4ec1-b21d-eb333eafaabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:23.216014 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-006a5f8c-2210-4ec1-b21d-eb333eafaabe None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:23.217230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-006a5f8c-2210-4ec1-b21d-eb333eafaabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:23.304080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:23.316142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 679/1342] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:23.356634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372472-bc80-47d3-8b2c-356ab2a27ba3 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:23.358192 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-40372472-bc80-47d3-8b2c-356ab2a27ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:23.463103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372472-bc80-47d3-8b2c-356ab2a27ba3 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:23.501217 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:23.538836 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fe0ab-bc2d-4aea-832f-b7f25478c670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:23.539465 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fe0ab-bc2d-4aea-832f-b7f25478c670 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:23.539753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fe0ab-bc2d-4aea-832f-b7f25478c670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:23.540060 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fe0ab-bc2d-4aea-832f-b7f25478c670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:23.541727 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4d2fe0ab-bc2d-4aea-832f-b7f25478c670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:23.652097 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fe0ab-bc2d-4aea-832f-b7f25478c670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:23.653539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fe0ab-bc2d-4aea-832f-b7f25478c670 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:23.673050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 664/1343] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:26.356547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4972eae-1585-41cb-9b81-e254f2ebfef5 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:26.357153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4972eae-1585-41cb-9b81-e254f2ebfef5 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:26.357153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4972eae-1585-41cb-9b81-e254f2ebfef5 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:26.358419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 680/1344] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:26.364945 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efdbd1-c971-440b-8517-df519efb9e85 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:26.365456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efdbd1-c971-440b-8517-df519efb9e85 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:26.365564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efdbd1-c971-440b-8517-df519efb9e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:26.445290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b7efdbd1-c971-440b-8517-df519efb9e85 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:26.446506 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b7efdbd1-c971-440b-8517-df519efb9e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:26.465756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:26.544869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 665/1345] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:26.582487 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4972eae-1585-41cb-9b81-e254f2ebfef5 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:26.584100 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e4972eae-1585-41cb-9b81-e254f2ebfef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:26.691732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4972eae-1585-41cb-9b81-e254f2ebfef5 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:26.764175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a337d6-0e35-4fff-a04e-9f25df275f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:26.764790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a337d6-0e35-4fff-a04e-9f25df275f69 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:26.765070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a337d6-0e35-4fff-a04e-9f25df275f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:26.765343 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a337d6-0e35-4fff-a04e-9f25df275f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:26.766948 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-29a337d6-0e35-4fff-a04e-9f25df275f69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:26.809588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:26.877377 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a337d6-0e35-4fff-a04e-9f25df275f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:26.879843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a337d6-0e35-4fff-a04e-9f25df275f69 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:26.899166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 681/1346] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:30.878984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8a3f8-2104-4191-a600-c496a01feb68 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:30.879527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8a3f8-2104-4191-a600-c496a01feb68 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:30.879527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8a3f8-2104-4191-a600-c496a01feb68 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:30.880955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 666/1347] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:30.886878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc4358-bb3a-45a3-8fd1-34bc61eaa048 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:30.887324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc4358-bb3a-45a3-8fd1-34bc61eaa048 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:30.887437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc4358-bb3a-45a3-8fd1-34bc61eaa048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:30.957081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-acfc4358-bb3a-45a3-8fd1-34bc61eaa048 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:30.958026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-acfc4358-bb3a-45a3-8fd1-34bc61eaa048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:31.075057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:31.078413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 682/1348] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:31.117949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8a3f8-2104-4191-a600-c496a01feb68 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:31.119492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d2b8a3f8-2104-4191-a600-c496a01feb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:31.232358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8a3f8-2104-4191-a600-c496a01feb68 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:31.281874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:31.309760 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f7fa7-4f8f-4d03-a9d1-ff5b149390dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:31.310388 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f7fa7-4f8f-4d03-a9d1-ff5b149390dc service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:31.310670 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f7fa7-4f8f-4d03-a9d1-ff5b149390dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:31.310947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f7fa7-4f8f-4d03-a9d1-ff5b149390dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:31.312637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5e8f7fa7-4f8f-4d03-a9d1-ff5b149390dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:31.427790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f7fa7-4f8f-4d03-a9d1-ff5b149390dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:31.429257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f7fa7-4f8f-4d03-a9d1-ff5b149390dc service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:31.448888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 667/1349] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:36.328910 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409e4f-6293-4834-9982-93a15111e07c None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:36.329438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409e4f-6293-4834-9982-93a15111e07c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:36.329680 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34409e4f-6293-4834-9982-93a15111e07c None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:36.332517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 683/1350] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:36.356947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840e68e-903b-49c4-b313-5f0414e2c9c5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:36.357412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840e68e-903b-49c4-b313-5f0414e2c9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:36.357528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840e68e-903b-49c4-b313-5f0414e2c9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:36.505952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6840e68e-903b-49c4-b313-5f0414e2c9c5 None None] MFA Rules not processed for user `f602decb26be477b867493429352bd03`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:36.507364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6840e68e-903b-49c4-b313-5f0414e2c9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:36.531218 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:36.643378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 668/1351] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:26:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:40.705992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878461e-661a-4047-839c-4d91788b17e7 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:40.707400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878461e-661a-4047-839c-4d91788b17e7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:40.708002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878461e-661a-4047-839c-4d91788b17e7 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:40.709529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 684/1352] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:26:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:40.714672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a43e8-fbc3-42c6-8e7f-6a3ecc543c54 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:40.715104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a43e8-fbc3-42c6-8e7f-6a3ecc543c54 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:40.715260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a43e8-fbc3-42c6-8e7f-6a3ecc543c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:40.798756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e59a43e8-fbc3-42c6-8e7f-6a3ecc543c54 None None] MFA Rules not processed for user `f602decb26be477b867493429352bd03`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:40.800116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e59a43e8-fbc3-42c6-8e7f-6a3ecc543c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:40.877663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:40.917187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 669/1353] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:26:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:42.289436 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639d926-2396-46af-81ea-8afbb6b26f75 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:42.290114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639d926-2396-46af-81ea-8afbb6b26f75 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:42.290114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639d926-2396-46af-81ea-8afbb6b26f75 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:42.291347 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 685/1354] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:42.296520 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669bac3-8e4c-4c87-b28c-61f05916a838 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:42.296921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669bac3-8e4c-4c87-b28c-61f05916a838 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:42.297066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669bac3-8e4c-4c87-b28c-61f05916a838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:42.373071 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2669bac3-8e4c-4c87-b28c-61f05916a838 None None] MFA Rules not processed for user `f602decb26be477b867493429352bd03`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:42.374187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2669bac3-8e4c-4c87-b28c-61f05916a838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:42.484818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 670/1355] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:26:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:26:45.982926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe78532-28f6-46aa-a02f-7314d33c8b17 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:45.983848 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe78532-28f6-46aa-a02f-7314d33c8b17 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:45.984328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe78532-28f6-46aa-a02f-7314d33c8b17 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:45.990879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 686/1356] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:45.992248 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fd90c-3f0f-45a4-b828-c1df74ee2110 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:45.992706 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fd90c-3f0f-45a4-b828-c1df74ee2110 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:45.992816 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fd90c-3f0f-45a4-b828-c1df74ee2110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:46.031084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:46.068708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1e0fd90c-3f0f-45a4-b828-c1df74ee2110 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:46.069921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1e0fd90c-3f0f-45a4-b828-c1df74ee2110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:46.170651 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 671/1357] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:46.226460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b3b0-ecc3-44e9-8ac2-d74af6bfe05f None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:46.226749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b3b0-ecc3-44e9-8ac2-d74af6bfe05f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:46.227026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b3b0-ecc3-44e9-8ac2-d74af6bfe05f None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:46.228701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 687/1358] 10.222.0.67 () {54 vars in 962 bytes} [Wed Jul 27 16:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:46.238617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb0cfe-b19a-4997-b356-1fcf472361a1 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:46.238975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb0cfe-b19a-4997-b356-1fcf472361a1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:46.239258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb0cfe-b19a-4997-b356-1fcf472361a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:46.328223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-9aeb0cfe-b19a-4997-b356-1fcf472361a1 None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:46.329623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9aeb0cfe-b19a-4997-b356-1fcf472361a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:46.384918 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:46.491517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 672/1359] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Jul 27 16:26:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:46.500320 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40b3b0-ecc3-44e9-8ac2-d74af6bfe05f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:46.501932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-da40b3b0-ecc3-44e9-8ac2-d74af6bfe05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:46.660042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40b3b0-ecc3-44e9-8ac2-d74af6bfe05f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:46.737025 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:46.780151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d3abe-af04-45b9-aeb5-cbb6a75a8e8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:46.780702 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d3abe-af04-45b9-aeb5-cbb6a75a8e8e service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:46.780992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d3abe-af04-45b9-aeb5-cbb6a75a8e8e service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:46.781272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d3abe-af04-45b9-aeb5-cbb6a75a8e8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:46.782894 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cb0d3abe-af04-45b9-aeb5-cbb6a75a8e8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:46.884500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d3abe-af04-45b9-aeb5-cbb6a75a8e8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:46.886611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d3abe-af04-45b9-aeb5-cbb6a75a8e8e service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:46.907018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 688/1360] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:49.169716 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847353ef-81fc-4e3e-8098-15ad911b5c7e None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:49.170220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847353ef-81fc-4e3e-8098-15ad911b5c7e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:49.170220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847353ef-81fc-4e3e-8098-15ad911b5c7e None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:49.171841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 673/1361] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:49.177238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f132-bb8e-42cd-b76d-28264b605bf3 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:49.177734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f132-bb8e-42cd-b76d-28264b605bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:49.177828 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f132-bb8e-42cd-b76d-28264b605bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:49.252366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-dba5f132-bb8e-42cd-b76d-28264b605bf3 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:49.254165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-dba5f132-bb8e-42cd-b76d-28264b605bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:49.297685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:49.368611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 689/1362] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:49.416148 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847353ef-81fc-4e3e-8098-15ad911b5c7e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:49.417753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-847353ef-81fc-4e3e-8098-15ad911b5c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:49.586863 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847353ef-81fc-4e3e-8098-15ad911b5c7e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:49.638722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:49.734225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909b9b-eb71-4f08-81c4-0e0f6a38fd6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:49.734882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b9b-eb71-4f08-81c4-0e0f6a38fd6f service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:49.735167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b9b-eb71-4f08-81c4-0e0f6a38fd6f service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:49.735445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909b9b-eb71-4f08-81c4-0e0f6a38fd6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:49.737109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6a909b9b-eb71-4f08-81c4-0e0f6a38fd6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:49.830824 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a909b9b-eb71-4f08-81c4-0e0f6a38fd6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:49.833075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a909b9b-eb71-4f08-81c4-0e0f6a38fd6f service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:49.852647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 674/1363] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:52.255588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f53c4-367a-438b-be67-5e2e2d27cd76 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:52.256158 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f53c4-367a-438b-be67-5e2e2d27cd76 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:52.256158 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f53c4-367a-438b-be67-5e2e2d27cd76 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:52.257699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 690/1364] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:52.262733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217ec9-a700-444c-82ed-a2629d581293 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:52.263134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217ec9-a700-444c-82ed-a2629d581293 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:52.263274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217ec9-a700-444c-82ed-a2629d581293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:52.280143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:52.335570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-03217ec9-a700-444c-82ed-a2629d581293 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:52.336725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-03217ec9-a700-444c-82ed-a2629d581293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:52.441710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 675/1365] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:52.490776 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0314d-62f4-4845-ad7b-189b18f1ef79 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:52.491227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0314d-62f4-4845-ad7b-189b18f1ef79 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:52.491661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0314d-62f4-4845-ad7b-189b18f1ef79 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:52.506392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 691/1366] 10.222.0.67 () {54 vars in 962 bytes} [Wed Jul 27 16:26:52 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:52.512617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1de630-8720-4107-9182-99736f3fb474 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:52.512930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1de630-8720-4107-9182-99736f3fb474 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:52.513196 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1de630-8720-4107-9182-99736f3fb474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:52.595909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-9d1de630-8720-4107-9182-99736f3fb474 None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:52.596647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9d1de630-8720-4107-9182-99736f3fb474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:52.640301 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:52.734154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 676/1367] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Jul 27 16:26:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:52.742666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0314d-62f4-4845-ad7b-189b18f1ef79 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:52.744601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-57b0314d-62f4-4845-ad7b-189b18f1ef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:52.902842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0314d-62f4-4845-ad7b-189b18f1ef79 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:52.924178 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:53.023119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c83fa4-75ea-4a8a-8f50-bab65af45c67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:53.024386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c83fa4-75ea-4a8a-8f50-bab65af45c67 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:53.024669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c83fa4-75ea-4a8a-8f50-bab65af45c67 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:53.024941 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c83fa4-75ea-4a8a-8f50-bab65af45c67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:53.026556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d8c83fa4-75ea-4a8a-8f50-bab65af45c67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:53.121332 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c83fa4-75ea-4a8a-8f50-bab65af45c67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:53.122940 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c83fa4-75ea-4a8a-8f50-bab65af45c67 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:53.142527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 692/1368] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:26:54.183105 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e4acb-3ec2-4d77-a90b-ddc45bc7d3f5 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:54.183637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e4acb-3ec2-4d77-a90b-ddc45bc7d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:54.183750 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e4acb-3ec2-4d77-a90b-ddc45bc7d3f5 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:54.185129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 677/1369] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:54.192834 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457192d-cd85-4967-8e64-06abf7d99fcf None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:54.193343 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457192d-cd85-4967-8e64-06abf7d99fcf None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:54.193426 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457192d-cd85-4967-8e64-06abf7d99fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:54.231329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:54.284045 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5457192d-cd85-4967-8e64-06abf7d99fcf None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:54.286156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5457192d-cd85-4967-8e64-06abf7d99fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:54.406117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 693/1370] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:54.773137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ee34-0994-4fd8-b1f1-b2b90aa547e5 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:54.773137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ee34-0994-4fd8-b1f1-b2b90aa547e5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:54.773137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ee34-0994-4fd8-b1f1-b2b90aa547e5 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:54.774318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 678/1371] 10.222.0.67 () {54 vars in 964 bytes} [Wed Jul 27 16:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:54.778541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969b046-6c26-429a-894e-6ead306bbfab None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:54.778955 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969b046-6c26-429a-894e-6ead306bbfab None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:54.779338 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969b046-6c26-429a-894e-6ead306bbfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:54.865316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a969b046-6c26-429a-894e-6ead306bbfab None None] MFA Rules not processed for user `96c5238a91b540b7ba3921a9d561e255`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:54.866696 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a969b046-6c26-429a-894e-6ead306bbfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:54.917343 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:54.951383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 694/1372] 10.222.0.67 () {58 vars in 1061 bytes} [Wed Jul 27 16:26:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:54.959365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660ee34-0994-4fd8-b1f1-b2b90aa547e5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:54.960946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c660ee34-0994-4fd8-b1f1-b2b90aa547e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:55.073411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660ee34-0994-4fd8-b1f1-b2b90aa547e5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:55.117014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:55.153320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0adeb-4a72-4631-9686-2af3c16e54f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:55.153942 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0adeb-4a72-4631-9686-2af3c16e54f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:55.154225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0adeb-4a72-4631-9686-2af3c16e54f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:55.154497 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0adeb-4a72-4631-9686-2af3c16e54f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:55.156134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bfb0adeb-4a72-4631-9686-2af3c16e54f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:55.272865 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0adeb-4a72-4631-9686-2af3c16e54f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:55.274312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0adeb-4a72-4631-9686-2af3c16e54f2 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:55.312231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 679/1373] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:55.370072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260db4c-de10-4fd4-9a59-001124d6bb03 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:55.371411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260db4c-de10-4fd4-9a59-001124d6bb03 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:55.371411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260db4c-de10-4fd4-9a59-001124d6bb03 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:55.373690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 695/1374] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:55.377469 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbf016-bd8c-4981-aa24-49829431736d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:55.377774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbf016-bd8c-4981-aa24-49829431736d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:55.378133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbf016-bd8c-4981-aa24-49829431736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:55.451991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1cfbf016-bd8c-4981-aa24-49829431736d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:55.453112 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1cfbf016-bd8c-4981-aa24-49829431736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:55.477162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:55.556896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 680/1375] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:55.600030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260db4c-de10-4fd4-9a59-001124d6bb03 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:55.601562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c260db4c-de10-4fd4-9a59-001124d6bb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:55.770385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260db4c-de10-4fd4-9a59-001124d6bb03 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:55.822841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:55.884981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b413053-502c-43ea-9829-247dab301238 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:55.885604 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b413053-502c-43ea-9829-247dab301238 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:55.885887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b413053-502c-43ea-9829-247dab301238 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:55.886163 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b413053-502c-43ea-9829-247dab301238 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:55.887791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4b413053-502c-43ea-9829-247dab301238 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:55.980816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b413053-502c-43ea-9829-247dab301238 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:55.982715 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b413053-502c-43ea-9829-247dab301238 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:56.004141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 696/1376] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:26:58.066319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f19cd-76ae-466e-bb53-4905879ef75a None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:58.066984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f19cd-76ae-466e-bb53-4905879ef75a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:58.066984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f19cd-76ae-466e-bb53-4905879ef75a None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:58.068407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 681/1377] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:26:58.074132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91c624-2106-41d2-8b63-3176baef02ab None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:58.074516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91c624-2106-41d2-8b63-3176baef02ab None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:58.074831 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91c624-2106-41d2-8b63-3176baef02ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:58.147015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-dc91c624-2106-41d2-8b63-3176baef02ab None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:26:58.148232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-dc91c624-2106-41d2-8b63-3176baef02ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:58.154724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:58.256518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 697/1378] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:26:58.307730 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f19cd-76ae-466e-bb53-4905879ef75a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:26:58.309285 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c00f19cd-76ae-466e-bb53-4905879ef75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:58.459258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f19cd-76ae-466e-bb53-4905879ef75a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:26:58.462901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:26:58.580398 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320f16c-668a-46a2-9876-8bd233364928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:26:58.581023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320f16c-668a-46a2-9876-8bd233364928 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:26:58.581305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320f16c-668a-46a2-9876-8bd233364928 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:26:58.581576 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320f16c-668a-46a2-9876-8bd233364928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:26:58.584310 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3320f16c-668a-46a2-9876-8bd233364928 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:26:58.686435 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320f16c-668a-46a2-9876-8bd233364928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:26:58.688154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320f16c-668a-46a2-9876-8bd233364928 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:26:58.716098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 682/1379] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:00.837807 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c9e5d-2348-43dc-b18a-dc24bccb053f None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:00.838357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c9e5d-2348-43dc-b18a-dc24bccb053f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:00.838357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c9e5d-2348-43dc-b18a-dc24bccb053f None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:00.839935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 698/1380] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:00.846262 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1cb9-88be-4e54-ad4a-bfeb8ea03d3d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:00.846913 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1cb9-88be-4e54-ad4a-bfeb8ea03d3d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:00.846913 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1cb9-88be-4e54-ad4a-bfeb8ea03d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:00.860139 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:00.921366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4aca1cb9-88be-4e54-ad4a-bfeb8ea03d3d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:00.922682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4aca1cb9-88be-4e54-ad4a-bfeb8ea03d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:01.028018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 683/1381] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:01.072889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c9e5d-2348-43dc-b18a-dc24bccb053f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:01.074671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c87c9e5d-2348-43dc-b18a-dc24bccb053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:01.225588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:01.237652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c9e5d-2348-43dc-b18a-dc24bccb053f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:01.359694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27accf-5e6b-4a26-ba2e-0aa4d502c1c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:01.360757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27accf-5e6b-4a26-ba2e-0aa4d502c1c8 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:01.361323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27accf-5e6b-4a26-ba2e-0aa4d502c1c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:01.361812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27accf-5e6b-4a26-ba2e-0aa4d502c1c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:01.363915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fe27accf-5e6b-4a26-ba2e-0aa4d502c1c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:01.468106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27accf-5e6b-4a26-ba2e-0aa4d502c1c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:01.470318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27accf-5e6b-4a26-ba2e-0aa4d502c1c8 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:01.483706 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:01.494338 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 699/1382] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:03.815367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e5de9-0874-40f7-90f0-e94955a53aa6 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:03.816058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e5de9-0874-40f7-90f0-e94955a53aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:03.816170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e5de9-0874-40f7-90f0-e94955a53aa6 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:03.819909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 684/1383] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:27:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:03.823811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374117-3414-4e52-a8ca-f2ac721e5645 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:03.824254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374117-3414-4e52-a8ca-f2ac721e5645 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:03.824429 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374117-3414-4e52-a8ca-f2ac721e5645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:03.896707 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c4374117-3414-4e52-a8ca-f2ac721e5645 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:03.897988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c4374117-3414-4e52-a8ca-f2ac721e5645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:04.015876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 700/1384] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:04.063085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e5de9-0874-40f7-90f0-e94955a53aa6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:04.064674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-468e5de9-0874-40f7-90f0-e94955a53aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:04.154366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:04.218788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e5de9-0874-40f7-90f0-e94955a53aa6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:04.334722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a588c-df0f-4c88-b15c-f1fecbd6f5d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:04.335272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a588c-df0f-4c88-b15c-f1fecbd6f5d3 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:04.335557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a588c-df0f-4c88-b15c-f1fecbd6f5d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:04.335833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a588c-df0f-4c88-b15c-f1fecbd6f5d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:04.337505 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f36a588c-df0f-4c88-b15c-f1fecbd6f5d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:04.389967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:04.444868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a588c-df0f-4c88-b15c-f1fecbd6f5d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:04.446503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a588c-df0f-4c88-b15c-f1fecbd6f5d3 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:04.465439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 685/1385] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:06.690609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c44fa1-d713-4c9a-83e3-9e60f94d6ca8 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:06.691123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c44fa1-d713-4c9a-83e3-9e60f94d6ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:06.691327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c44fa1-d713-4c9a-83e3-9e60f94d6ca8 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:06.693668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 701/1386] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:27:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:06.698627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5966e0-6998-40a5-928c-bc09d24dac24 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:06.699068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5966e0-6998-40a5-928c-bc09d24dac24 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:06.699177 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5966e0-6998-40a5-928c-bc09d24dac24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:06.774547 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3f5966e0-6998-40a5-928c-bc09d24dac24 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:06.775944 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3f5966e0-6998-40a5-928c-bc09d24dac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:06.894227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 686/1387] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:06.945981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c44fa1-d713-4c9a-83e3-9e60f94d6ca8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:06.947723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-00c44fa1-d713-4c9a-83e3-9e60f94d6ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:07.041712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:07.120834 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c44fa1-d713-4c9a-83e3-9e60f94d6ca8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:07.244390 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37478bc-8bcd-4ee9-8ac4-c03a2962e087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:07.245060 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37478bc-8bcd-4ee9-8ac4-c03a2962e087 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:07.245362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37478bc-8bcd-4ee9-8ac4-c03a2962e087 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:07.245639 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37478bc-8bcd-4ee9-8ac4-c03a2962e087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:07.247386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b37478bc-8bcd-4ee9-8ac4-c03a2962e087 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:07.289124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:07.343019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37478bc-8bcd-4ee9-8ac4-c03a2962e087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:07.344738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37478bc-8bcd-4ee9-8ac4-c03a2962e087 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:07.365600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 702/1388] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:09.616508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf0ed3-5e71-466a-803b-ad0eee4f0fa6 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:09.617083 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf0ed3-5e71-466a-803b-ad0eee4f0fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:09.617083 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf0ed3-5e71-466a-803b-ad0eee4f0fa6 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:09.618430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 687/1389] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:09.623514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ae191-a17d-497e-a74c-3c870d374849 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:09.623983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ae191-a17d-497e-a74c-3c870d374849 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:09.624216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ae191-a17d-497e-a74c-3c870d374849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:09.692125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b66ae191-a17d-497e-a74c-3c870d374849 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:09.693327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b66ae191-a17d-497e-a74c-3c870d374849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:09.790651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 703/1390] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:09.834347 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf0ed3-5e71-466a-803b-ad0eee4f0fa6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:09.835879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4cbf0ed3-5e71-466a-803b-ad0eee4f0fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:09.867952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:09.981306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf0ed3-5e71-466a-803b-ad0eee4f0fa6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:10.082038 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:10.094667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d39a1-d807-48cb-b5bd-7e53cdde3eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:10.095290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d39a1-d807-48cb-b5bd-7e53cdde3eec service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:10.095565 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d39a1-d807-48cb-b5bd-7e53cdde3eec service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:10.095838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d39a1-d807-48cb-b5bd-7e53cdde3eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:10.097461 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-173d39a1-d807-48cb-b5bd-7e53cdde3eec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:10.188632 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d39a1-d807-48cb-b5bd-7e53cdde3eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:10.190132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d39a1-d807-48cb-b5bd-7e53cdde3eec service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:10.209368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 688/1391] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:10.350534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208d261-a092-4d78-9ff9-ec7b1dcd9bb8 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:10.350824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208d261-a092-4d78-9ff9-ec7b1dcd9bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:10.351128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208d261-a092-4d78-9ff9-ec7b1dcd9bb8 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:10.352570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 704/1392] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:10.358915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6415035-865f-4442-9c44-e98234dd9f83 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:10.359208 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6415035-865f-4442-9c44-e98234dd9f83 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:10.359518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6415035-865f-4442-9c44-e98234dd9f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:10.433414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d6415035-865f-4442-9c44-e98234dd9f83 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:10.434648 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d6415035-865f-4442-9c44-e98234dd9f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:10.494479 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:10.534051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 689/1393] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:10.590294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de06da-a5db-4bb1-aa05-34954bb1b8f4 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:10.590576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de06da-a5db-4bb1-aa05-34954bb1b8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:10.590858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de06da-a5db-4bb1-aa05-34954bb1b8f4 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:10.592276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 705/1394] 10.222.0.67 () {54 vars in 966 bytes} [Wed Jul 27 16:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:10.597446 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7342-1e17-4289-b721-90b2dd755125 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:10.597739 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7342-1e17-4289-b721-90b2dd755125 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:10.598074 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7342-1e17-4289-b721-90b2dd755125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:10.678566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4c0d7342-1e17-4289-b721-90b2dd755125 None None] MFA Rules not processed for user `b1832d9988604b81bcb075ae77db6d80`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:10.679903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4c0d7342-1e17-4289-b721-90b2dd755125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:10.757903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 690/1395] 10.222.0.67 () {58 vars in 1063 bytes} [Wed Jul 27 16:27:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:10.765592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de06da-a5db-4bb1-aa05-34954bb1b8f4 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:10.767100 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-91de06da-a5db-4bb1-aa05-34954bb1b8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:10.780873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:10.873030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de06da-a5db-4bb1-aa05-34954bb1b8f4 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:10.949631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965fbc2-1e82-4aae-8bcd-3237726fa940 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1832d9988604b81bcb075ae77db6d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:10.950260 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965fbc2-1e82-4aae-8bcd-3237726fa940 service glance] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:10.950546 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965fbc2-1e82-4aae-8bcd-3237726fa940 service glance] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:10.950825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965fbc2-1e82-4aae-8bcd-3237726fa940 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:10.952475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7965fbc2-1e82-4aae-8bcd-3237726fa940 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:11.020896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:11.062843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965fbc2-1e82-4aae-8bcd-3237726fa940 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:11.064319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965fbc2-1e82-4aae-8bcd-3237726fa940 service glance] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:11.083338 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 706/1396] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:11.817792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa1a2a-dac8-4714-80bb-a83d051473ea None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:11.818559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa1a2a-dac8-4714-80bb-a83d051473ea None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:11.818559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa1a2a-dac8-4714-80bb-a83d051473ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:11.885041 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f1aa1a2a-dac8-4714-80bb-a83d051473ea None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:11.886259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f1aa1a2a-dac8-4714-80bb-a83d051473ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:11.894550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:11.972827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 691/1397] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:27:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:12.020591 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d91d9-4121-430b-9084-70d9375d09f6 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:12.021076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d91d9-4121-430b-9084-70d9375d09f6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:12.021177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d91d9-4121-430b-9084-70d9375d09f6 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:12.022538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 707/1398] 10.222.0.67 () {54 vars in 943 bytes} [Wed Jul 27 16:27:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:12.028817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d2c17-931c-4504-b975-5ab8a943ae52 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:12.029176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d2c17-931c-4504-b975-5ab8a943ae52 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:12.029461 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d2c17-931c-4504-b975-5ab8a943ae52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:12.104898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-390d2c17-931c-4504-b975-5ab8a943ae52 None None] MFA Rules not processed for user `c48ede3f01be42c39a55c1beeeb85f26`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:12.106092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-390d2c17-931c-4504-b975-5ab8a943ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:12.194172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:12.226799 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 692/1399] 10.222.0.67 () {58 vars in 1040 bytes} [Wed Jul 27 16:27:12 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:12.236396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d91d9-4121-430b-9084-70d9375d09f6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:12.237918 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9c7d91d9-4121-430b-9084-70d9375d09f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:12.269843 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b5743-9556-42ec-b2b7-6da2c4a701ee None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:12.270685 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b5743-9556-42ec-b2b7-6da2c4a701ee None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:12.270968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b5743-9556-42ec-b2b7-6da2c4a701ee None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:12.272513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 693/1400] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:27:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:27:12.277469 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a59899-84ee-457a-a7d7-3739d88070bb None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:12.277765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a59899-84ee-457a-a7d7-3739d88070bb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:12.278045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a59899-84ee-457a-a7d7-3739d88070bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:12.345750 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c0a59899-84ee-457a-a7d7-3739d88070bb None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:12.346884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c0a59899-84ee-457a-a7d7-3739d88070bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:12.378581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d91d9-4121-430b-9084-70d9375d09f6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:12.417248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:12.453138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 694/1401] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:27:12.494880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce736c-5cd6-4fb9-8f86-ee2cae72879d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:12.495510 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce736c-5cd6-4fb9-8f86-ee2cae72879d service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:12.495791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce736c-5cd6-4fb9-8f86-ee2cae72879d service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:12.496096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce736c-5cd6-4fb9-8f86-ee2cae72879d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:12.497748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-58ce736c-5cd6-4fb9-8f86-ee2cae72879d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:12.500566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a59899-84ee-457a-a7d7-3739d88070bb None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:12.502096 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c0a59899-84ee-457a-a7d7-3739d88070bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:12.568687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:12.581378 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce736c-5cd6-4fb9-8f86-ee2cae72879d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:12.582999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce736c-5cd6-4fb9-8f86-ee2cae72879d service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:12.591208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 708/1402] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:27:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 16:27:12.623525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a59899-84ee-457a-a7d7-3739d88070bb None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:12.755446 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e361dc9-5fe9-474f-8bf1-e0481b70a881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:12.756315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361dc9-5fe9-474f-8bf1-e0481b70a881 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:12.756664 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361dc9-5fe9-474f-8bf1-e0481b70a881 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:12.757004 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361dc9-5fe9-474f-8bf1-e0481b70a881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:12.758699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7e361dc9-5fe9-474f-8bf1-e0481b70a881 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:12.824090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:12.859000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e361dc9-5fe9-474f-8bf1-e0481b70a881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:12.860575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e361dc9-5fe9-474f-8bf1-e0481b70a881 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:12.883190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 695/1403] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:27:14.964440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2b4b1-08c8-40bc-bc40-a2feae10c69f None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:14.965000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2b4b1-08c8-40bc-bc40-a2feae10c69f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:14.965000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2b4b1-08c8-40bc-bc40-a2feae10c69f None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:14.966436 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 709/1404] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:14.971432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa66cc-04ef-43b1-a0b1-81c1b5198ee5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:14.971881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa66cc-04ef-43b1-a0b1-81c1b5198ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:14.972029 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa66cc-04ef-43b1-a0b1-81c1b5198ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:15.046575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0dfa66cc-04ef-43b1-a0b1-81c1b5198ee5 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:15.047801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0dfa66cc-04ef-43b1-a0b1-81c1b5198ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:15.151070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 696/1405] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:15.195524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2b4b1-08c8-40bc-bc40-a2feae10c69f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:15.197266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9bd2b4b1-08c8-40bc-bc40-a2feae10c69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:15.278787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:15.360123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2b4b1-08c8-40bc-bc40-a2feae10c69f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:15.492461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f399fea-8a53-4c7d-8a2f-ef0479837552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:15.493087 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399fea-8a53-4c7d-8a2f-ef0479837552 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:15.493374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399fea-8a53-4c7d-8a2f-ef0479837552 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:15.493652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399fea-8a53-4c7d-8a2f-ef0479837552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:15.495308 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9f399fea-8a53-4c7d-8a2f-ef0479837552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:15.530306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:15.598645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f399fea-8a53-4c7d-8a2f-ef0479837552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:15.600505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f399fea-8a53-4c7d-8a2f-ef0479837552 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:15.619661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 710/1406] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:17.685554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8be83-db19-4924-bb3b-c17e59cbe1ab None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:17.686086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8be83-db19-4924-bb3b-c17e59cbe1ab None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:17.686086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8be83-db19-4924-bb3b-c17e59cbe1ab None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:17.687720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 697/1407] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:17.693508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b667a-61c7-49e4-8d1a-158bf873fe09 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:17.695587 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b667a-61c7-49e4-8d1a-158bf873fe09 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:17.695896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b667a-61c7-49e4-8d1a-158bf873fe09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:17.771247 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-345b667a-61c7-49e4-8d1a-158bf873fe09 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:17.772627 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-345b667a-61c7-49e4-8d1a-158bf873fe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:17.890372 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 711/1408] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:17.935330 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8be83-db19-4924-bb3b-c17e59cbe1ab None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:17.936934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a7e8be83-db19-4924-bb3b-c17e59cbe1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:17.978111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:18.096884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8be83-db19-4924-bb3b-c17e59cbe1ab None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:18.215663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:18.221534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2fb09-13d1-4018-9c54-c82ccff0a8c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:18.222155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2fb09-13d1-4018-9c54-c82ccff0a8c8 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:18.222434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2fb09-13d1-4018-9c54-c82ccff0a8c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:18.222703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2fb09-13d1-4018-9c54-c82ccff0a8c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:18.225099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-35c2fb09-13d1-4018-9c54-c82ccff0a8c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:18.325148 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2fb09-13d1-4018-9c54-c82ccff0a8c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:18.326931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2fb09-13d1-4018-9c54-c82ccff0a8c8 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:18.347069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 698/1409] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:27.886918 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:28.344628 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=47 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:34.912678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e3ce9-10f7-4288-951b-495f1ec1f896 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:34.913213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e3ce9-10f7-4288-951b-495f1ec1f896 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:34.913213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e3ce9-10f7-4288-951b-495f1ec1f896 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:34.914496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 712/1410] 10.222.0.67 () {54 vars in 918 bytes} [Wed Jul 27 16:27:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:34.919639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e4b1-ed56-439b-9be3-bd486007019f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:34.920121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e4b1-ed56-439b-9be3-bd486007019f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:34.920227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e4b1-ed56-439b-9be3-bd486007019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:34.996229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2b66e4b1-ed56-439b-9be3-bd486007019f None None] MFA Rules not processed for user `f602decb26be477b867493429352bd03`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:34.997436 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2b66e4b1-ed56-439b-9be3-bd486007019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:35.100364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 699/1411] 10.222.0.67 () {58 vars in 1015 bytes} [Wed Jul 27 16:27:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:35.114699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcfe9b-b6ae-4bca-b77b-9a0bf2d8b95e None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:35.115660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcfe9b-b6ae-4bca-b77b-9a0bf2d8b95e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:35.116018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcfe9b-b6ae-4bca-b77b-9a0bf2d8b95e None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:35.117360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 713/1412] 10.222.0.67 () {54 vars in 918 bytes} [Wed Jul 27 16:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:35.121999 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1427c4b-28aa-443f-9293-f34ab82aa336 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:35.122296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1427c4b-28aa-443f-9293-f34ab82aa336 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:35.122575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1427c4b-28aa-443f-9293-f34ab82aa336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:35.195498 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:35.197864 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e1427c4b-28aa-443f-9293-f34ab82aa336 None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:35.199663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e1427c4b-28aa-443f-9293-f34ab82aa336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:35.316378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 700/1413] 10.222.0.67 () {58 vars in 1015 bytes} [Wed Jul 27 16:27:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:37.792465 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36553ec-e1f2-4878-bb38-2c2c872fb74e None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:37.793000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36553ec-e1f2-4878-bb38-2c2c872fb74e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:37.793000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36553ec-e1f2-4878-bb38-2c2c872fb74e None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:37.794370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:37.799720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a92ee-e97d-4a6f-b30a-373fd47bb764 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:37.800186 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a92ee-e97d-4a6f-b30a-373fd47bb764 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:37.800324 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a92ee-e97d-4a6f-b30a-373fd47bb764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:37.870661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-da3a92ee-e97d-4a6f-b30a-373fd47bb764 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:37.872492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-da3a92ee-e97d-4a6f-b30a-373fd47bb764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:37.932167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:37.974943 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:38.017897 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36553ec-e1f2-4878-bb38-2c2c872fb74e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:38.019671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d36553ec-e1f2-4878-bb38-2c2c872fb74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:38.165375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36553ec-e1f2-4878-bb38-2c2c872fb74e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:38.237453 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:38.278914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859a9ec-e04b-4906-ad36-1531e8d28927 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:38.279536 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a9ec-e04b-4906-ad36-1531e8d28927 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:38.279822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a9ec-e04b-4906-ad36-1531e8d28927 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:38.280129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a9ec-e04b-4906-ad36-1531e8d28927 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:38.281765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e859a9ec-e04b-4906-ad36-1531e8d28927 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:38.370411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859a9ec-e04b-4906-ad36-1531e8d28927 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:38.371977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859a9ec-e04b-4906-ad36-1531e8d28927 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:38.390211 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 715/1416] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:39.303109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fecd07-1729-449f-b226-13f2e1060f0b None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:39.303691 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fecd07-1729-449f-b226-13f2e1060f0b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:39.303789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fecd07-1729-449f-b226-13f2e1060f0b None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:39.305128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:39.310094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafc84f-57b5-4346-af43-542df9754fe1 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:39.310536 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafc84f-57b5-4346-af43-542df9754fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:39.310653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafc84f-57b5-4346-af43-542df9754fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:39.386790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ffafc84f-57b5-4346-af43-542df9754fe1 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:39.388055 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ffafc84f-57b5-4346-af43-542df9754fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:39.416431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:39.487852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:39.640979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fecd07-1729-449f-b226-13f2e1060f0b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:39.642413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-46fecd07-1729-449f-b226-13f2e1060f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:39.787598 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fecd07-1729-449f-b226-13f2e1060f0b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:39.826115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:39.898259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768953b-8228-4e4f-a9c0-2f27bb52f419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:39.898796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768953b-8228-4e4f-a9c0-2f27bb52f419 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:39.899075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768953b-8228-4e4f-a9c0-2f27bb52f419 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:39.899344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768953b-8228-4e4f-a9c0-2f27bb52f419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:39.900988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f768953b-8228-4e4f-a9c0-2f27bb52f419 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:39.988691 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768953b-8228-4e4f-a9c0-2f27bb52f419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:39.990409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768953b-8228-4e4f-a9c0-2f27bb52f419 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:40.007933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 703/1419] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:40.892702 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a91874-52f0-4b98-9b43-e06036fd1856 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:40.893242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a91874-52f0-4b98-9b43-e06036fd1856 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:40.893355 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a91874-52f0-4b98-9b43-e06036fd1856 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:40.894688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:27:40.900352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a6317-9fe7-4f07-bcb6-55a71cee4d87 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:40.900782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a6317-9fe7-4f07-bcb6-55a71cee4d87 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:40.900938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a6317-9fe7-4f07-bcb6-55a71cee4d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:40.955126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:40.977331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e70a6317-9fe7-4f07-bcb6-55a71cee4d87 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:40.978542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e70a6317-9fe7-4f07-bcb6-55a71cee4d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:41.073929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:41.234734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a91874-52f0-4b98-9b43-e06036fd1856 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:41.236950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-19a91874-52f0-4b98-9b43-e06036fd1856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:41.381983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a91874-52f0-4b98-9b43-e06036fd1856 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:41.394506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:41.495266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ac3a0-0c53-4aab-b8e5-9c9afee64894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:41.495799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac3a0-0c53-4aab-b8e5-9c9afee64894 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:41.496117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac3a0-0c53-4aab-b8e5-9c9afee64894 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:41.496393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac3a0-0c53-4aab-b8e5-9c9afee64894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:41.498011 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cd9ac3a0-0c53-4aab-b8e5-9c9afee64894 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:41.585773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ac3a0-0c53-4aab-b8e5-9c9afee64894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:41.587365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ac3a0-0c53-4aab-b8e5-9c9afee64894 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:41.604882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 718/1422] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:42.480167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d0323-56ad-4198-9d35-3a53c9fd71bb None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:42.480711 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d0323-56ad-4198-9d35-3a53c9fd71bb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:42.480711 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d0323-56ad-4198-9d35-3a53c9fd71bb None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:42.482105 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:42.487366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b0b22-f4a6-4255-bc22-c3d121040688 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:42.487773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b0b22-f4a6-4255-bc22-c3d121040688 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:42.488011 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b0b22-f4a6-4255-bc22-c3d121040688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:42.508054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:42.563454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3e3b0b22-f4a6-4255-bc22-c3d121040688 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:42.564697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3e3b0b22-f4a6-4255-bc22-c3d121040688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:42.661451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:42.811252 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d0323-56ad-4198-9d35-3a53c9fd71bb None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:42.812741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6d4d0323-56ad-4198-9d35-3a53c9fd71bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:42.921772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:42.957735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d0323-56ad-4198-9d35-3a53c9fd71bb None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:43.068226 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025b173-bd95-4f83-98a5-c4ecf816b6f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:43.069566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025b173-bd95-4f83-98a5-c4ecf816b6f2 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:43.069848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025b173-bd95-4f83-98a5-c4ecf816b6f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:43.070118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025b173-bd95-4f83-98a5-c4ecf816b6f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:43.071721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1025b173-bd95-4f83-98a5-c4ecf816b6f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:43.146115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:43.160179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025b173-bd95-4f83-98a5-c4ecf816b6f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:43.161765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025b173-bd95-4f83-98a5-c4ecf816b6f2 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:43.180416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 706/1425] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:44.045599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc366570-e7d2-434f-b01c-2a0b38508e0d None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:44.046159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc366570-e7d2-434f-b01c-2a0b38508e0d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:44.046259 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc366570-e7d2-434f-b01c-2a0b38508e0d None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:44.047540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:44.053359 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d9e47-77ec-4c3a-a229-b9e37572850d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:44.053831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d9e47-77ec-4c3a-a229-b9e37572850d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:44.053926 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d9e47-77ec-4c3a-a229-b9e37572850d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:44.129167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-438d9e47-77ec-4c3a-a229-b9e37572850d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:44.130379 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-438d9e47-77ec-4c3a-a229-b9e37572850d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:44.226062 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:44.378105 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc366570-e7d2-434f-b01c-2a0b38508e0d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:44.379586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fc366570-e7d2-434f-b01c-2a0b38508e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:44.464646 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:44.526734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc366570-e7d2-434f-b01c-2a0b38508e0d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:44.637288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826c380-e8f7-4e37-a6c5-a9a002300dc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:44.637827 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c380-e8f7-4e37-a6c5-a9a002300dc7 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:44.638106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c380-e8f7-4e37-a6c5-a9a002300dc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:44.638377 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c380-e8f7-4e37-a6c5-a9a002300dc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:44.640033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a826c380-e8f7-4e37-a6c5-a9a002300dc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:44.687968 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:44.729033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826c380-e8f7-4e37-a6c5-a9a002300dc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:44.730618 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826c380-e8f7-4e37-a6c5-a9a002300dc7 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:44.749138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 721/1428] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:45.558453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268361a6-fd5a-4eeb-a10b-40d47ed15726 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:45.559117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268361a6-fd5a-4eeb-a10b-40d47ed15726 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:45.559117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268361a6-fd5a-4eeb-a10b-40d47ed15726 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:45.560413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:27:45.565474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795da9-be40-4589-a2ee-9e55aa1f6d5c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:45.565937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795da9-be40-4589-a2ee-9e55aa1f6d5c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:45.566051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795da9-be40-4589-a2ee-9e55aa1f6d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:45.643421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c3795da9-be40-4589-a2ee-9e55aa1f6d5c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:45.644660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c3795da9-be40-4589-a2ee-9e55aa1f6d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:45.742690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:45.897129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268361a6-fd5a-4eeb-a10b-40d47ed15726 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:45.898783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-268361a6-fd5a-4eeb-a10b-40d47ed15726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:45.947064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:46.042712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268361a6-fd5a-4eeb-a10b-40d47ed15726 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:46.152824 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22399fc3-0ff8-4aa7-8701-6bf1f461ab29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:46.153383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22399fc3-0ff8-4aa7-8701-6bf1f461ab29 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:46.153662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22399fc3-0ff8-4aa7-8701-6bf1f461ab29 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:46.153932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22399fc3-0ff8-4aa7-8701-6bf1f461ab29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:46.155525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-22399fc3-0ff8-4aa7-8701-6bf1f461ab29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:46.162795 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:46.245059 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22399fc3-0ff8-4aa7-8701-6bf1f461ab29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:46.246633 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22399fc3-0ff8-4aa7-8701-6bf1f461ab29 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:46.264274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 709/1431] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:47.059195 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e97fc2-9a29-42ff-baa1-7ef191958168 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:47.059790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e97fc2-9a29-42ff-baa1-7ef191958168 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:47.059790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e97fc2-9a29-42ff-baa1-7ef191958168 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:47.061160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:47.065921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522db630-79b3-432c-9840-50e770ed6c29 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:47.066367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522db630-79b3-432c-9840-50e770ed6c29 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:47.066475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522db630-79b3-432c-9840-50e770ed6c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:47.144180 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-522db630-79b3-432c-9840-50e770ed6c29 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:47.145374 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-522db630-79b3-432c-9840-50e770ed6c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:47.210794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:47.246758 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:47.397518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e97fc2-9a29-42ff-baa1-7ef191958168 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:47.399119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-71e97fc2-9a29-42ff-baa1-7ef191958168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:47.417423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:47.548896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e97fc2-9a29-42ff-baa1-7ef191958168 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:47.635652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:47.661692 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debef98c-3666-4b7f-be55-b11dd59deb19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:47.663017 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debef98c-3666-4b7f-be55-b11dd59deb19 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:47.663305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debef98c-3666-4b7f-be55-b11dd59deb19 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:47.663579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debef98c-3666-4b7f-be55-b11dd59deb19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:47.665223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-debef98c-3666-4b7f-be55-b11dd59deb19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:47.752059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debef98c-3666-4b7f-be55-b11dd59deb19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:47.753667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debef98c-3666-4b7f-be55-b11dd59deb19 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:47.772586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 724/1434] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:48.574958 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4a489-86a0-4257-9e15-05e794cb55fd None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:48.575509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4a489-86a0-4257-9e15-05e794cb55fd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:48.575509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4a489-86a0-4257-9e15-05e794cb55fd None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:48.576924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:48.581741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adca85-ea93-4735-90c1-931899359e66 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:48.582167 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adca85-ea93-4735-90c1-931899359e66 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:48.582409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adca85-ea93-4735-90c1-931899359e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:48.661597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f8adca85-ea93-4735-90c1-931899359e66 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:48.662979 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f8adca85-ea93-4735-90c1-931899359e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:48.704750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:48.761311 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:48.913684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4a489-86a0-4257-9e15-05e794cb55fd None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:48.915107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d2a4a489-86a0-4257-9e15-05e794cb55fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:49.058128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4a489-86a0-4257-9e15-05e794cb55fd None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:49.111388 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:49.171689 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9f6ff-4b0a-4206-99f7-6855c47fcab4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:49.172581 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9f6ff-4b0a-4206-99f7-6855c47fcab4 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:49.172902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9f6ff-4b0a-4206-99f7-6855c47fcab4 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:49.173309 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9f6ff-4b0a-4206-99f7-6855c47fcab4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:49.175575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-eec9f6ff-4b0a-4206-99f7-6855c47fcab4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:49.267416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9f6ff-4b0a-4206-99f7-6855c47fcab4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:49.269026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9f6ff-4b0a-4206-99f7-6855c47fcab4 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:49.287692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 712/1437] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:50.092506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6fcf-21cc-4d9b-a7cf-caea927e03bc None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:50.093077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6fcf-21cc-4d9b-a7cf-caea927e03bc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:50.093077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6fcf-21cc-4d9b-a7cf-caea927e03bc None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:50.094443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:50.099427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4dab8-ed21-4a7c-be3c-6f32cd40935b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:50.099891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4dab8-ed21-4a7c-be3c-6f32cd40935b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:50.100134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4dab8-ed21-4a7c-be3c-6f32cd40935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:50.176522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7bb4dab8-ed21-4a7c-be3c-6f32cd40935b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:50.177724 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7bb4dab8-ed21-4a7c-be3c-6f32cd40935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:50.179758 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:50.274382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:50.426713 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6fcf-21cc-4d9b-a7cf-caea927e03bc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:50.428718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5bad6fcf-21cc-4d9b-a7cf-caea927e03bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:50.581088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6fcf-21cc-4d9b-a7cf-caea927e03bc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:50.607391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:50.696154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6fb99-482d-49a5-ade2-caf1db96a361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:50.696720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6fb99-482d-49a5-ade2-caf1db96a361 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:50.697006 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6fb99-482d-49a5-ade2-caf1db96a361 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:50.697282 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6fb99-482d-49a5-ade2-caf1db96a361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:50.698920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-92e6fb99-482d-49a5-ade2-caf1db96a361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:50.788147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6fb99-482d-49a5-ade2-caf1db96a361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:50.789750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6fb99-482d-49a5-ade2-caf1db96a361 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:50.808102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 727/1440] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:52.747237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ac3b-773e-4258-a4c2-41499bb2409a None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:52.747818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ac3b-773e-4258-a4c2-41499bb2409a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:52.747818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ac3b-773e-4258-a4c2-41499bb2409a None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:52.749189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:52.754371 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf05899-3153-4dad-947e-c2bf2a8fcc5d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:52.754767 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf05899-3153-4dad-947e-c2bf2a8fcc5d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:52.754944 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf05899-3153-4dad-947e-c2bf2a8fcc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:52.796190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:52.822144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6cf05899-3153-4dad-947e-c2bf2a8fcc5d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:52.823337 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6cf05899-3153-4dad-947e-c2bf2a8fcc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:52.918775 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:52.957246 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8ac3b-773e-4258-a4c2-41499bb2409a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:52.958779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9fe8ac3b-773e-4258-a4c2-41499bb2409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:53.060957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8ac3b-773e-4258-a4c2-41499bb2409a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:53.091838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:53.133593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0a690-6c54-4cf0-8dd8-dbcbbfca6a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:53.134207 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0a690-6c54-4cf0-8dd8-dbcbbfca6a69 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:53.134491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0a690-6c54-4cf0-8dd8-dbcbbfca6a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:53.134770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0a690-6c54-4cf0-8dd8-dbcbbfca6a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:53.136406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0dc0a690-6c54-4cf0-8dd8-dbcbbfca6a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:53.243398 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0a690-6c54-4cf0-8dd8-dbcbbfca6a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:53.244928 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0a690-6c54-4cf0-8dd8-dbcbbfca6a69 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:53.270013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 715/1443] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:55.547271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0431283-c80f-4b5c-b0ce-4b4bf5baef59 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:55.547853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0431283-c80f-4b5c-b0ce-4b4bf5baef59 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:55.547853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0431283-c80f-4b5c-b0ce-4b4bf5baef59 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:55.549274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:55.554499 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270414b-8a44-4fd8-a781-435fe389ce09 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:55.554952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270414b-8a44-4fd8-a781-435fe389ce09 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:55.555046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270414b-8a44-4fd8-a781-435fe389ce09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:55.621381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e270414b-8a44-4fd8-a781-435fe389ce09 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:55.622593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e270414b-8a44-4fd8-a781-435fe389ce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:55.635549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:55.721129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:55.759445 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0431283-c80f-4b5c-b0ce-4b4bf5baef59 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:55.761028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a0431283-c80f-4b5c-b0ce-4b4bf5baef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:55.863249 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0431283-c80f-4b5c-b0ce-4b4bf5baef59 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:55.875412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:55.935829 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63253101-3482-4b63-8320-9dc3180cf29c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:55.936477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63253101-3482-4b63-8320-9dc3180cf29c service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:55.936759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63253101-3482-4b63-8320-9dc3180cf29c service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:55.937032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63253101-3482-4b63-8320-9dc3180cf29c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:55.938669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-63253101-3482-4b63-8320-9dc3180cf29c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:56.045337 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63253101-3482-4b63-8320-9dc3180cf29c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:56.046779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63253101-3482-4b63-8320-9dc3180cf29c service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:56.064357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 730/1446] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:27:58.374375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef5057-c6bb-4997-8ea2-62c9dff4f86d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:58.374909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef5057-c6bb-4997-8ea2-62c9dff4f86d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:58.374909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef5057-c6bb-4997-8ea2-62c9dff4f86d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:58.376326 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:27:58.382399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051898df-410e-4c1e-9133-f0f6d0802f07 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:58.382825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051898df-410e-4c1e-9133-f0f6d0802f07 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:58.382961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051898df-410e-4c1e-9133-f0f6d0802f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:58.432944 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:58.451449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-051898df-410e-4c1e-9133-f0f6d0802f07 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:27:58.452725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-051898df-410e-4c1e-9133-f0f6d0802f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:58.547577 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:27:58.586657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef5057-c6bb-4997-8ea2-62c9dff4f86d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:27:58.588257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f7ef5057-c6bb-4997-8ea2-62c9dff4f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:58.696300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef5057-c6bb-4997-8ea2-62c9dff4f86d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:27:58.735470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:27:58.770599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77428a34-d550-45a5-8891-71b3eeb86604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:27:58.771219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77428a34-d550-45a5-8891-71b3eeb86604 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:27:58.771503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77428a34-d550-45a5-8891-71b3eeb86604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:27:58.771774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77428a34-d550-45a5-8891-71b3eeb86604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:27:58.773525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-77428a34-d550-45a5-8891-71b3eeb86604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:27:58.879360 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77428a34-d550-45a5-8891-71b3eeb86604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:27:58.880818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77428a34-d550-45a5-8891-71b3eeb86604 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:27:58.899318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 718/1449] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:01.023171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0893-2f42-4da0-b6b1-a4d45def09c0 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:01.023729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0893-2f42-4da0-b6b1-a4d45def09c0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:01.023729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0893-2f42-4da0-b6b1-a4d45def09c0 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:01.025124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:01.030367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bba2f4-d5e9-41c9-8a01-c86791348dae None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:01.030784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bba2f4-d5e9-41c9-8a01-c86791348dae None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:01.030934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bba2f4-d5e9-41c9-8a01-c86791348dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:01.095786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-48bba2f4-d5e9-41c9-8a01-c86791348dae None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:01.097017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-48bba2f4-d5e9-41c9-8a01-c86791348dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:01.118114 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:01.194796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:28:01.234109 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0893-2f42-4da0-b6b1-a4d45def09c0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:01.235665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-50ff0893-2f42-4da0-b6b1-a4d45def09c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:01.342228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0893-2f42-4da0-b6b1-a4d45def09c0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:01.361269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:01.414262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d80146-659c-4179-b7b2-a2a4f5cf12e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:01.414883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d80146-659c-4179-b7b2-a2a4f5cf12e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:01.415174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d80146-659c-4179-b7b2-a2a4f5cf12e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:01.415456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d80146-659c-4179-b7b2-a2a4f5cf12e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:01.417122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-20d80146-659c-4179-b7b2-a2a4f5cf12e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:01.526620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d80146-659c-4179-b7b2-a2a4f5cf12e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:01.528127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d80146-659c-4179-b7b2-a2a4f5cf12e6 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:01.546665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 733/1452] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:03.841565 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58df7b-f1b4-4f4c-8cab-1aa7eeeaed5c None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:03.842190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58df7b-f1b4-4f4c-8cab-1aa7eeeaed5c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:03.842190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58df7b-f1b4-4f4c-8cab-1aa7eeeaed5c None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:03.843463 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:03.848918 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c514a-348d-4da8-b4ec-5f3a13bf8b98 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:03.849372 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c514a-348d-4da8-b4ec-5f3a13bf8b98 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:03.849484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c514a-348d-4da8-b4ec-5f3a13bf8b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:03.912972 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:03.916427 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5e2c514a-348d-4da8-b4ec-5f3a13bf8b98 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:03.918235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5e2c514a-348d-4da8-b4ec-5f3a13bf8b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:04.013398 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:04.051792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58df7b-f1b4-4f4c-8cab-1aa7eeeaed5c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:04.053347 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7a58df7b-f1b4-4f4c-8cab-1aa7eeeaed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:04.157296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58df7b-f1b4-4f4c-8cab-1aa7eeeaed5c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:04.205860 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:04.230439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff4e3a-05a7-4236-adc4-73b62696f335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:04.231064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff4e3a-05a7-4236-adc4-73b62696f335 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:04.231350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff4e3a-05a7-4236-adc4-73b62696f335 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:04.231630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff4e3a-05a7-4236-adc4-73b62696f335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:04.233295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0aff4e3a-05a7-4236-adc4-73b62696f335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:04.340225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff4e3a-05a7-4236-adc4-73b62696f335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:04.341644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff4e3a-05a7-4236-adc4-73b62696f335 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:04.360231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 721/1455] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:06.483878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4073952-3bc6-4b58-aade-25de6e883b78 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:06.484484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4073952-3bc6-4b58-aade-25de6e883b78 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:06.484484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4073952-3bc6-4b58-aade-25de6e883b78 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:06.485856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:06.493489 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85979b-bc74-4aae-bad8-2fbfdfb04729 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:06.493968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85979b-bc74-4aae-bad8-2fbfdfb04729 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:06.494066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85979b-bc74-4aae-bad8-2fbfdfb04729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:06.560388 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5d85979b-bc74-4aae-bad8-2fbfdfb04729 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:06.561594 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5d85979b-bc74-4aae-bad8-2fbfdfb04729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:06.590122 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:06.660850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:06.699330 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4073952-3bc6-4b58-aade-25de6e883b78 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:06.700957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e4073952-3bc6-4b58-aade-25de6e883b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:06.803946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4073952-3bc6-4b58-aade-25de6e883b78 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:06.831106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:06.876402 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3393cd5-fe59-4d58-a35f-e02a7ee5ac98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:06.877019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393cd5-fe59-4d58-a35f-e02a7ee5ac98 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:06.877327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393cd5-fe59-4d58-a35f-e02a7ee5ac98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:06.877599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393cd5-fe59-4d58-a35f-e02a7ee5ac98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:06.879220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c3393cd5-fe59-4d58-a35f-e02a7ee5ac98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:06.989008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3393cd5-fe59-4d58-a35f-e02a7ee5ac98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:06.990442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3393cd5-fe59-4d58-a35f-e02a7ee5ac98 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:07.008121 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 736/1458] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:09.080079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f9246-9a25-4416-9e12-e3fea125f8b7 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:09.080605 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f9246-9a25-4416-9e12-e3fea125f8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:09.080728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f9246-9a25-4416-9e12-e3fea125f8b7 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:09.082050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:09.087473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f11571-2bd9-426c-b820-3941737131ca None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:09.087927 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f11571-2bd9-426c-b820-3941737131ca None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:09.088053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f11571-2bd9-426c-b820-3941737131ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:09.152474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a0f11571-2bd9-426c-b820-3941737131ca None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:09.153672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a0f11571-2bd9-426c-b820-3941737131ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:09.161679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:09.248976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:09.287383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f9246-9a25-4416-9e12-e3fea125f8b7 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:09.289097 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fb4f9246-9a25-4416-9e12-e3fea125f8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:09.394762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f9246-9a25-4416-9e12-e3fea125f8b7 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:09.450780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:09.469356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d31d73-5581-4ea5-8922-a937ce4de748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:09.469996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d31d73-5581-4ea5-8922-a937ce4de748 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:09.470260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d31d73-5581-4ea5-8922-a937ce4de748 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:09.470535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d31d73-5581-4ea5-8922-a937ce4de748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:09.472169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-09d31d73-5581-4ea5-8922-a937ce4de748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:09.579369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d31d73-5581-4ea5-8922-a937ce4de748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:09.580850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d31d73-5581-4ea5-8922-a937ce4de748 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:09.598905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 724/1461] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:11.669931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382d564-cce5-487e-a3d6-cfa2ced5e1f1 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:11.670377 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382d564-cce5-487e-a3d6-cfa2ced5e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:11.670482 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382d564-cce5-487e-a3d6-cfa2ced5e1f1 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:11.671842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:11.677157 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd6192-aca6-4f76-9156-98bfc9bd7171 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:11.677608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd6192-aca6-4f76-9156-98bfc9bd7171 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:11.677722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd6192-aca6-4f76-9156-98bfc9bd7171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:11.742242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-08fd6192-aca6-4f76-9156-98bfc9bd7171 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:11.743420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-08fd6192-aca6-4f76-9156-98bfc9bd7171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:11.781365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:11.838789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:11.875780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382d564-cce5-487e-a3d6-cfa2ced5e1f1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:11.877417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1382d564-cce5-487e-a3d6-cfa2ced5e1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:11.979637 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382d564-cce5-487e-a3d6-cfa2ced5e1f1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:12.016607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:12.052422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5706ca-4410-4b89-b601-4701ae173aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:12.053039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5706ca-4410-4b89-b601-4701ae173aef service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:12.053321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5706ca-4410-4b89-b601-4701ae173aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:12.053603 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5706ca-4410-4b89-b601-4701ae173aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:12.055732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1e5706ca-4410-4b89-b601-4701ae173aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:12.163201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5706ca-4410-4b89-b601-4701ae173aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:12.164923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5706ca-4410-4b89-b601-4701ae173aef service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:12.187386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 739/1464] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:14.215591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf513fd-3c2c-4b27-83e7-bcef3302d33f None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:14.216168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf513fd-3c2c-4b27-83e7-bcef3302d33f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:14.216168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf513fd-3c2c-4b27-83e7-bcef3302d33f None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:14.217560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:14.222872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823406e-5b8f-4dad-9acf-68b2bbecb9d2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:14.223312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823406e-5b8f-4dad-9acf-68b2bbecb9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:14.223421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823406e-5b8f-4dad-9acf-68b2bbecb9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:14.289972 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2823406e-5b8f-4dad-9acf-68b2bbecb9d2 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:14.291274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2823406e-5b8f-4dad-9acf-68b2bbecb9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:14.309753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:14.390103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:14.426810 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf513fd-3c2c-4b27-83e7-bcef3302d33f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:14.428363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5bf513fd-3c2c-4b27-83e7-bcef3302d33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:14.534241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf513fd-3c2c-4b27-83e7-bcef3302d33f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:14.599756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:14.607038 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a801b-f187-49fc-b325-5d3ca38e25e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:14.607658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a801b-f187-49fc-b325-5d3ca38e25e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:14.607977 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a801b-f187-49fc-b325-5d3ca38e25e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:14.608256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a801b-f187-49fc-b325-5d3ca38e25e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:14.609876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cc2a801b-f187-49fc-b325-5d3ca38e25e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:14.722630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a801b-f187-49fc-b325-5d3ca38e25e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:14.724088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a801b-f187-49fc-b325-5d3ca38e25e4 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:14.743933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 727/1467] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:16.789513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76781b2f-e2c5-4081-8962-850dee97cdc1 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:16.790136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76781b2f-e2c5-4081-8962-850dee97cdc1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:16.790136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76781b2f-e2c5-4081-8962-850dee97cdc1 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:16.791474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:16.796646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d50e55-082c-41a0-965f-de3a939a5090 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:16.797060 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d50e55-082c-41a0-965f-de3a939a5090 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:16.797207 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d50e55-082c-41a0-965f-de3a939a5090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:16.861736 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c4d50e55-082c-41a0-965f-de3a939a5090 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:16.862942 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c4d50e55-082c-41a0-965f-de3a939a5090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:16.911350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:16.959929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:16.998241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76781b2f-e2c5-4081-8962-850dee97cdc1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:16.999811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-76781b2f-e2c5-4081-8962-850dee97cdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:17.100611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76781b2f-e2c5-4081-8962-850dee97cdc1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:17.147464 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:17.173971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d87db-fd25-4cc8-b298-ed64cdffa057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:17.174555 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d87db-fd25-4cc8-b298-ed64cdffa057 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:17.174841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d87db-fd25-4cc8-b298-ed64cdffa057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:17.175122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d87db-fd25-4cc8-b298-ed64cdffa057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:17.176782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-499d87db-fd25-4cc8-b298-ed64cdffa057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:17.285278 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d87db-fd25-4cc8-b298-ed64cdffa057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:17.286717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d87db-fd25-4cc8-b298-ed64cdffa057 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:17.305175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 742/1470] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:26.958196 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=22 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:27.302770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=66 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:36.940235 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1addee-3511-4ed5-90b5-2f394778c8bb None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:36.940806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1addee-3511-4ed5-90b5-2f394778c8bb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:36.940806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1addee-3511-4ed5-90b5-2f394778c8bb None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:36.942167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 729/1471] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:36.948208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dddef-3454-4c6e-b084-8b576600b05e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:36.948668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dddef-3454-4c6e-b084-8b576600b05e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:36.948781 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dddef-3454-4c6e-b084-8b576600b05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:37.015562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-4d5dddef-3454-4c6e-b084-8b576600b05e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:37.016821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4d5dddef-3454-4c6e-b084-8b576600b05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:37.112012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 743/1472] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:37.195635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c07c-61d6-4331-a81f-1376fd594fc9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:37.195969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c07c-61d6-4331-a81f-1376fd594fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:37.196254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c07c-61d6-4331-a81f-1376fd594fc9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:37.197637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 730/1473] 10.222.0.67 () {54 vars in 966 bytes} [Wed Jul 27 16:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:37.202654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1994d-d101-4317-9247-64851e57f37b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:37.202948 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1994d-d101-4317-9247-64851e57f37b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:37.203232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1994d-d101-4317-9247-64851e57f37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:37.278004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-eac1994d-d101-4317-9247-64851e57f37b None None] MFA Rules not processed for user `b1832d9988604b81bcb075ae77db6d80`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:37.279207 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-eac1994d-d101-4317-9247-64851e57f37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:37.299757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:37.355170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 744/1474] 10.222.0.67 () {58 vars in 1063 bytes} [Wed Jul 27 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:37.362651 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c07c-61d6-4331-a81f-1376fd594fc9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:37.364234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4c73c07c-61d6-4331-a81f-1376fd594fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:37.468788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c07c-61d6-4331-a81f-1376fd594fc9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:37.542833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a2c5f-5f48-4a16-8dcb-36d18c9b43c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1832d9988604b81bcb075ae77db6d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:37.543450 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a2c5f-5f48-4a16-8dcb-36d18c9b43c1 service glance] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:37.543735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a2c5f-5f48-4a16-8dcb-36d18c9b43c1 service glance] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:37.544051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a2c5f-5f48-4a16-8dcb-36d18c9b43c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:37.545665 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f01a2c5f-5f48-4a16-8dcb-36d18c9b43c1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:37.599053 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:37.658067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a2c5f-5f48-4a16-8dcb-36d18c9b43c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:37.659505 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a2c5f-5f48-4a16-8dcb-36d18c9b43c1 service glance] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:37.679441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 731/1475] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:39.773289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5526d-8432-44f4-b5fc-ab9c36386cd9 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:39.773860 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5526d-8432-44f4-b5fc-ab9c36386cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:39.773860 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5526d-8432-44f4-b5fc-ab9c36386cd9 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:39.776359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 745/1476] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:39.781794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd01726-b5e7-4c27-8012-7df9016ea5b9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:39.782228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd01726-b5e7-4c27-8012-7df9016ea5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:39.782343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd01726-b5e7-4c27-8012-7df9016ea5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:39.848627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4fd01726-b5e7-4c27-8012-7df9016ea5b9 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:39.849836 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4fd01726-b5e7-4c27-8012-7df9016ea5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:39.945904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 732/1477] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:39.971165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5526d-8432-44f4-b5fc-ab9c36386cd9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:39.972783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-97b5526d-8432-44f4-b5fc-ab9c36386cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:40.098332 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5526d-8432-44f4-b5fc-ab9c36386cd9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:40.147849 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:40.193937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b4956-27f9-4ebe-9159-b6f53963f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:40.194554 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4956-27f9-4ebe-9159-b6f53963f591 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:40.194830 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4956-27f9-4ebe-9159-b6f53963f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:40.195097 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4956-27f9-4ebe-9159-b6f53963f591 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:40.195786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b4956-27f9-4ebe-9159-b6f53963f591 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:40.197678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-4a9b4956-27f9-4ebe-9159-b6f53963f591 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:28:40.197678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 27 16:28:40.197678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: Jul 27 16:28:40.198783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b4956-27f9-4ebe-9159-b6f53963f591 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:40.339175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 746/1478] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 16:28:39 2022] GET /identity/v3/projects => generated 2553 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:28:42.356087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a191-06a9-42da-80dd-6c1702bc915c None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:42.356666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a191-06a9-42da-80dd-6c1702bc915c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:42.356666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a191-06a9-42da-80dd-6c1702bc915c None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:42.358024 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 733/1479] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:42.363127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c8124-ad1d-46bd-8878-cd354ddfcf18 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:42.363572 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c8124-ad1d-46bd-8878-cd354ddfcf18 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:42.363682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c8124-ad1d-46bd-8878-cd354ddfcf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:42.434605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0c4c8124-ad1d-46bd-8878-cd354ddfcf18 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:42.435749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0c4c8124-ad1d-46bd-8878-cd354ddfcf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:42.530374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 747/1480] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:42.574438 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20a191-06a9-42da-80dd-6c1702bc915c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:42.576032 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7e20a191-06a9-42da-80dd-6c1702bc915c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:42.585673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:42.721254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20a191-06a9-42da-80dd-6c1702bc915c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:42.801794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:42.835166 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4099321-a273-482d-925b-519fd66dee05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:42.835789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4099321-a273-482d-925b-519fd66dee05 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:42.836098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4099321-a273-482d-925b-519fd66dee05 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:42.836371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4099321-a273-482d-925b-519fd66dee05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:42.838019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a4099321-a273-482d-925b-519fd66dee05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:42.927291 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4099321-a273-482d-925b-519fd66dee05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:42.928916 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4099321-a273-482d-925b-519fd66dee05 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:42.948519 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 734/1481] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:45.131625 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b03c-04cc-4b49-b443-eecbdb45b885 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:45.132237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b03c-04cc-4b49-b443-eecbdb45b885 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:45.132237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b03c-04cc-4b49-b443-eecbdb45b885 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:45.133636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 748/1482] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:45.139497 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279518d1-a819-4cb5-ade2-42effe5abbb7 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:45.139942 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279518d1-a819-4cb5-ade2-42effe5abbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:45.140101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279518d1-a819-4cb5-ade2-42effe5abbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:45.205378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-279518d1-a819-4cb5-ade2-42effe5abbb7 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:45.206588 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-279518d1-a819-4cb5-ade2-42effe5abbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:45.252700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:45.301854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 735/1483] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:45.339308 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10b03c-04cc-4b49-b443-eecbdb45b885 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:45.340953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5d10b03c-04cc-4b49-b443-eecbdb45b885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:45.364041 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:45.445634 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10b03c-04cc-4b49-b443-eecbdb45b885 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:45.518514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7adbbe-6ee0-48dc-9df9-7b8c264f95a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:45.519142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7adbbe-6ee0-48dc-9df9-7b8c264f95a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:45.519426 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7adbbe-6ee0-48dc-9df9-7b8c264f95a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:45.519706 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7adbbe-6ee0-48dc-9df9-7b8c264f95a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:45.521372 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2c7adbbe-6ee0-48dc-9df9-7b8c264f95a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:45.594621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:45.630329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7adbbe-6ee0-48dc-9df9-7b8c264f95a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:45.631789 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7adbbe-6ee0-48dc-9df9-7b8c264f95a3 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:45.650636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 749/1484] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:47.705946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaaee0-abbb-470d-b272-45f7c24b5f4f None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:47.705946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaaee0-abbb-470d-b272-45f7c24b5f4f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:47.705946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaaee0-abbb-470d-b272-45f7c24b5f4f None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:47.708015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 736/1485] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:47.714690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a188-abf8-404d-ae81-5f1f57f4f926 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:47.715149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a188-abf8-404d-ae81-5f1f57f4f926 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:47.715244 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a188-abf8-404d-ae81-5f1f57f4f926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:47.779476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-fef6a188-abf8-404d-ae81-5f1f57f4f926 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:47.780696 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fef6a188-abf8-404d-ae81-5f1f57f4f926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:47.875808 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 750/1486] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:47.916915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eaaee0-abbb-470d-b272-45f7c24b5f4f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:47.918552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-62eaaee0-abbb-470d-b272-45f7c24b5f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:48.021352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eaaee0-abbb-470d-b272-45f7c24b5f4f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:48.093289 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:48.095110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d0480-2324-4eae-b314-fa07e003b124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:48.095815 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0480-2324-4eae-b314-fa07e003b124 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:48.096317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0480-2324-4eae-b314-fa07e003b124 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:48.096642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0480-2324-4eae-b314-fa07e003b124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:48.098635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-532d0480-2324-4eae-b314-fa07e003b124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:48.206675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d0480-2324-4eae-b314-fa07e003b124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:48.208090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d0480-2324-4eae-b314-fa07e003b124 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:48.226896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 737/1487] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:50.401205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600624c-8f1f-4bbb-a806-cb00826ee575 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:50.401770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600624c-8f1f-4bbb-a806-cb00826ee575 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:50.401770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600624c-8f1f-4bbb-a806-cb00826ee575 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:50.403041 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 751/1488] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:50.408540 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1a0d-76b5-4f82-ad58-e9d3737f5177 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:50.408946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1a0d-76b5-4f82-ad58-e9d3737f5177 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:50.409101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1a0d-76b5-4f82-ad58-e9d3737f5177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:50.474812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-321e1a0d-76b5-4f82-ad58-e9d3737f5177 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:50.476054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-321e1a0d-76b5-4f82-ad58-e9d3737f5177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:50.528556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:50.573530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 738/1489] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:50.614491 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600624c-8f1f-4bbb-a806-cb00826ee575 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:50.616124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7600624c-8f1f-4bbb-a806-cb00826ee575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:50.660533 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:50.731909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600624c-8f1f-4bbb-a806-cb00826ee575 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:50.807788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20081564-2d08-4005-b091-9bdec4926b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:50.808442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20081564-2d08-4005-b091-9bdec4926b26 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:50.808735 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20081564-2d08-4005-b091-9bdec4926b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:50.809017 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20081564-2d08-4005-b091-9bdec4926b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:50.810656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-20081564-2d08-4005-b091-9bdec4926b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:50.890457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:50.919930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20081564-2d08-4005-b091-9bdec4926b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:50.921308 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20081564-2d08-4005-b091-9bdec4926b26 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:50.938838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 752/1490] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:28:53.252380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e506ab-f240-4ca9-a128-2004cd39484d None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:53.252987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e506ab-f240-4ca9-a128-2004cd39484d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:53.252987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e506ab-f240-4ca9-a128-2004cd39484d None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:53.254308 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 739/1491] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 16:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:28:53.260034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935e4e7-8d0c-4adc-878a-fdd366ea5e51 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:53.260483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935e4e7-8d0c-4adc-878a-fdd366ea5e51 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:53.260630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935e4e7-8d0c-4adc-878a-fdd366ea5e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:53.327878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d935e4e7-8d0c-4adc-878a-fdd366ea5e51 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:28:53.329101 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d935e4e7-8d0c-4adc-878a-fdd366ea5e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:53.423725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 753/1492] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:28:53.466734 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e506ab-f240-4ca9-a128-2004cd39484d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:28:53.468369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-20e506ab-f240-4ca9-a128-2004cd39484d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:53.571198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e506ab-f240-4ca9-a128-2004cd39484d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:28:53.644170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff95029-e209-43d9-b9e0-ed0336c24f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:28:53.644814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff95029-e209-43d9-b9e0-ed0336c24f89 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:28:53.645093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff95029-e209-43d9-b9e0-ed0336c24f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:28:53.645361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff95029-e209-43d9-b9e0-ed0336c24f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:28:53.646958 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fff95029-e209-43d9-b9e0-ed0336c24f89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:28:53.656693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:28:53.757740 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff95029-e209-43d9-b9e0-ed0336c24f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:28:53.759304 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff95029-e209-43d9-b9e0-ed0336c24f89 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:28:53.778437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 740/1493] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:29:03.421933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=82 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:29:03.776064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=50 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:20.989792 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaf78b-3567-40dd-a2d4-86d1b3e64c03 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:20.990375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaf78b-3567-40dd-a2d4-86d1b3e64c03 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:20.990375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaf78b-3567-40dd-a2d4-86d1b3e64c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:21.066391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-84eaf78b-3567-40dd-a2d4-86d1b3e64c03 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:30:21.067603 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-84eaf78b-3567-40dd-a2d4-86d1b3e64c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:21.163241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 754/1494] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:30:21.171363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c65eb-ed4f-4512-8a80-69674cdccb9c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:21.172438 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c65eb-ed4f-4512-8a80-69674cdccb9c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:21.172704 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c65eb-ed4f-4512-8a80-69674cdccb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:21.247476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c73c65eb-ed4f-4512-8a80-69674cdccb9c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:30:21.248621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c73c65eb-ed4f-4512-8a80-69674cdccb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:21.342035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 741/1495] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:30:21.346817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eaf78b-3567-40dd-a2d4-86d1b3e64c03 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:21.348076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-84eaf78b-3567-40dd-a2d4-86d1b3e64c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:21.359981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eaf78b-3567-40dd-a2d4-86d1b3e64c03 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:21.425322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:21.459345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44e771-98f8-4a3c-952b-797d21965559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:21.459985 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44e771-98f8-4a3c-952b-797d21965559 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:21.460266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44e771-98f8-4a3c-952b-797d21965559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:21.460537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44e771-98f8-4a3c-952b-797d21965559 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:21.461216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44e771-98f8-4a3c-952b-797d21965559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:30:21.461514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44e771-98f8-4a3c-952b-797d21965559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:21.462519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-1d44e771-98f8-4a3c-952b-797d21965559 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:30:21.462519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 27 16:30:21.462519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: Jul 27 16:30:21.463418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44e771-98f8-4a3c-952b-797d21965559 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:21.475194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 755/1496] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:30:21.483495 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c65eb-ed4f-4512-8a80-69674cdccb9c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:21.493573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c65eb-ed4f-4512-8a80-69674cdccb9c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:21.554479 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:21.587959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18c9f2-00f5-42e5-bc6f-7b3ecf59eb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:21.588599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18c9f2-00f5-42e5-bc6f-7b3ecf59eb07 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:21.588888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18c9f2-00f5-42e5-bc6f-7b3ecf59eb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:21.589169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18c9f2-00f5-42e5-bc6f-7b3ecf59eb07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:21.589851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18c9f2-00f5-42e5-bc6f-7b3ecf59eb07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:21.591674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-5e18c9f2-00f5-42e5-bc6f-7b3ecf59eb07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:30:21.591674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 27 16:30:21.591674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: Jul 27 16:30:21.592955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18c9f2-00f5-42e5-bc6f-7b3ecf59eb07 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:21.655690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 742/1497] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:30:21 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:30:21.657658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44e771-98f8-4a3c-952b-797d21965559 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:21.659185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1d44e771-98f8-4a3c-952b-797d21965559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:21.694171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44e771-98f8-4a3c-952b-797d21965559 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:21.789276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd28fd-d6d9-4081-9a8f-eadfce4e7f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:21.789897 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd28fd-d6d9-4081-9a8f-eadfce4e7f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:21.790183 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd28fd-d6d9-4081-9a8f-eadfce4e7f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:21.790460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd28fd-d6d9-4081-9a8f-eadfce4e7f71 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:21.791119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd28fd-d6d9-4081-9a8f-eadfce4e7f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:21.792194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-4efd28fd-d6d9-4081-9a8f-eadfce4e7f71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:30:21.792194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 27 16:30:21.792194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: Jul 27 16:30:21.793391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd28fd-d6d9-4081-9a8f-eadfce4e7f71 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:21.834963 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 756/1498] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:30:21 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:30:21.839066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18c9f2-00f5-42e5-bc6f-7b3ecf59eb07 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:21.840627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5e18c9f2-00f5-42e5-bc6f-7b3ecf59eb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:21.902721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18c9f2-00f5-42e5-bc6f-7b3ecf59eb07 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:21.985812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:21.998173 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8542b-ffc6-482a-832d-334f408e2293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:21.998796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8542b-ffc6-482a-832d-334f408e2293 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:21.999081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8542b-ffc6-482a-832d-334f408e2293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:21.999358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8542b-ffc6-482a-832d-334f408e2293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:22.000255 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8542b-ffc6-482a-832d-334f408e2293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:22.001440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-50b8542b-ffc6-482a-832d-334f408e2293 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:30:22.001440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 27 16:30:22.001440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: Jul 27 16:30:22.002354 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8542b-ffc6-482a-832d-334f408e2293 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:22.014727 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 743/1499] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:30:22.019410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd28fd-d6d9-4081-9a8f-eadfce4e7f71 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:22.021010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4efd28fd-d6d9-4081-9a8f-eadfce4e7f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:22.032924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd28fd-d6d9-4081-9a8f-eadfce4e7f71 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:22.057129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:22.126797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f3d65-45ec-41ad-a722-ca9461b658c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:22.127342 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f3d65-45ec-41ad-a722-ca9461b658c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:22.127624 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f3d65-45ec-41ad-a722-ca9461b658c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:22.127932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f3d65-45ec-41ad-a722-ca9461b658c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:22.128629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f3d65-45ec-41ad-a722-ca9461b658c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:22.129640 dv-cinder-849690-6-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-a23f3d65-45ec-41ad-a722-ca9461b658c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:30:22.129640 dv-cinder-849690-6-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 27 16:30:22.129640 dv-cinder-849690-6-smb devstack@keystone.service[80205]: Jul 27 16:30:22.130516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f3d65-45ec-41ad-a722-ca9461b658c0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:22.142734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 757/1500] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:30:22.147024 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8542b-ffc6-482a-832d-334f408e2293 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:22.148593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-50b8542b-ffc6-482a-832d-334f408e2293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:22.181928 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8542b-ffc6-482a-832d-334f408e2293 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:22.277425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad826e-9633-4581-8c93-51fc7c6d18fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:22.278103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad826e-9633-4581-8c93-51fc7c6d18fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:22.278388 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad826e-9633-4581-8c93-51fc7c6d18fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:22.278667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad826e-9633-4581-8c93-51fc7c6d18fd admin admin] PATH_INFO: `/v3/projects/2755d5471a1849b4b37f2a0f9f05fb51/users/98ae3a6b7708421a865197771ecfa311/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:22.301857 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad826e-9633-4581-8c93-51fc7c6d18fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2755d5471a1849b4b37f2a0f9f05fb51, user_id=98ae3a6b7708421a865197771ecfa311, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:22.302925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-afad826e-9633-4581-8c93-51fc7c6d18fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:30:22.302925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 27 16:30:22.302925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: Jul 27 16:30:22.304946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad826e-9633-4581-8c93-51fc7c6d18fd admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:22.330422 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 744/1501] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:30:22 2022] PUT /identity/v3/projects/2755d5471a1849b4b37f2a0f9f05fb51/users/98ae3a6b7708421a865197771ecfa311/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:30:22.342330 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0dd3e-2f15-4ddf-bd0d-0d37876b07aa None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:22.342622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0dd3e-2f15-4ddf-bd0d-0d37876b07aa None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:22.342906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0dd3e-2f15-4ddf-bd0d-0d37876b07aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:22.398909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-69b0dd3e-2f15-4ddf-bd0d-0d37876b07aa None None] MFA Rules not processed for user `98ae3a6b7708421a865197771ecfa311`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:30:22.400078 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-69b0dd3e-2f15-4ddf-bd0d-0d37876b07aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:22.478427 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 758/1502] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:30:22.492407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0489f-abfe-4217-8554-2de08398e3f0 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:22.492707 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0489f-abfe-4217-8554-2de08398e3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:22.493019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0489f-abfe-4217-8554-2de08398e3f0 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:22.494365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 745/1503] 10.222.0.67 () {54 vars in 964 bytes} [Wed Jul 27 16:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:30:22.499317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0e050-7140-4556-8284-5f77b444abb7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:22.499615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0e050-7140-4556-8284-5f77b444abb7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:22.500026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0e050-7140-4556-8284-5f77b444abb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:22.538217 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:22.582590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-28a0e050-7140-4556-8284-5f77b444abb7 None None] MFA Rules not processed for user `96c5238a91b540b7ba3921a9d561e255`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:30:22.583790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-28a0e050-7140-4556-8284-5f77b444abb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:22.660497 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 759/1504] 10.222.0.67 () {58 vars in 1061 bytes} [Wed Jul 27 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:30:22.668318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0489f-abfe-4217-8554-2de08398e3f0 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:22.669812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-edb0489f-abfe-4217-8554-2de08398e3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:22.719984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:22.774077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0489f-abfe-4217-8554-2de08398e3f0 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:22.847727 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c732a5-10e6-4de8-a2c5-6a654478b6bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:22.848381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c732a5-10e6-4de8-a2c5-6a654478b6bc service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:22.848670 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c732a5-10e6-4de8-a2c5-6a654478b6bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:22.848938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c732a5-10e6-4de8-a2c5-6a654478b6bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:22.850571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a9c732a5-10e6-4de8-a2c5-6a654478b6bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:22.949110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c732a5-10e6-4de8-a2c5-6a654478b6bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:22.950449 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c732a5-10e6-4de8-a2c5-6a654478b6bc service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:22.954019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:22.968471 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 746/1505] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:30:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:30:23.014400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad7350-8b10-4366-9171-f68bf3e6a6fc None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:23.014694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad7350-8b10-4366-9171-f68bf3e6a6fc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:23.014974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad7350-8b10-4366-9171-f68bf3e6a6fc None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:23.016475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 760/1506] 10.222.0.67 () {52 vars in 830 bytes} [Wed Jul 27 16:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:30:23.019996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c732a5-10e6-4de8-a2c5-6a654478b6bc service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:23.021199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a9c732a5-10e6-4de8-a2c5-6a654478b6bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:23.118080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c732a5-10e6-4de8-a2c5-6a654478b6bc service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:23.208359 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:23.209018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:23.209199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:23.209473 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] PATH_INFO: `/v3/users/98ae3a6b7708421a865197771ecfa311` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:23.222129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ae3a6b7708421a865197771ecfa311)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:23.223141 dv-cinder-849690-6-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:30:23.223141 dv-cinder-849690-6-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 27 16:30:23.223141 dv-cinder-849690-6-smb devstack@keystone.service[80206]: Jul 27 16:30:23.224397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:23.233937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:23.288802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ae3a6b7708421a865197771ecfa311'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:23.301155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ae3a6b7708421a865197771ecfa311'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:23.310092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ae3a6b7708421a865197771ecfa311'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:23.310661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ae3a6b7708421a865197771ecfa311'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:23.311082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ae3a6b7708421a865197771ecfa311'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:23.334943 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 747/1507] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:30:23 2022] DELETE /identity/v3/users/98ae3a6b7708421a865197771ecfa311 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:30:23.339333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13437772-d3eb-4045-a60e-ec808c895ce3 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:23.339832 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13437772-d3eb-4045-a60e-ec808c895ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:23.339973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13437772-d3eb-4045-a60e-ec808c895ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:23.396978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-13437772-d3eb-4045-a60e-ec808c895ce3 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:30:23.398186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-13437772-d3eb-4045-a60e-ec808c895ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:23.473873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:23.487732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 761/1508] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:30:23.497280 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:23.498543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:23.598298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990a70d-1e65-42c8-8074-191b35f4a8b2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:23.654089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:23.676224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b403eb-4ec4-462e-869f-71d45fa4f4b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:23.676853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b403eb-4ec4-462e-869f-71d45fa4f4b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:23.677140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b403eb-4ec4-462e-869f-71d45fa4f4b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:23.677418 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b403eb-4ec4-462e-869f-71d45fa4f4b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:23.679056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-53b403eb-4ec4-462e-869f-71d45fa4f4b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:23.788155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b403eb-4ec4-462e-869f-71d45fa4f4b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:23.789509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b403eb-4ec4-462e-869f-71d45fa4f4b9 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:23.808229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 748/1509] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:30:24.164210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13437772-d3eb-4045-a60e-ec808c895ce3 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:30:24.165494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-13437772-d3eb-4045-a60e-ec808c895ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:30:24.176864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13437772-d3eb-4045-a60e-ec808c895ce3 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:30:24.277344 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:30:24.277997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:30:24.278284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:30:24.278565 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69 admin admin] PATH_INFO: `/v3/projects/2755d5471a1849b4b37f2a0f9f05fb51` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:30:24.288972 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2755d5471a1849b4b37f2a0f9f05fb51)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:30:24.290036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:30:24.290036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 27 16:30:24.290036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: Jul 27 16:30:24.291237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:30:24.348266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2755d5471a1849b4b37f2a0f9f05fb51', 'request_id': 'req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:24.361400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2755d5471a1849b4b37f2a0f9f05fb51', 'request_id': 'req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:24.367761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2755d5471a1849b4b37f2a0f9f05fb51', 'request_id': 'req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:24.396113 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69 admin admin] The token cache is being invalidate because project 2755d5471a1849b4b37f2a0f9f05fb51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:30:24.396407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:24.396842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea0a1007-7f83-4654-a4bc-f60a56ce5d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:30:24.398316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 762/1510] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:30:24 2022] DELETE /identity/v3/projects/2755d5471a1849b4b37f2a0f9f05fb51 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:30:33.805867 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=62 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:30:34.393972 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:32:11.980435 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c566e-7fbd-4cf6-a0b2-293c55e907cd None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:11.981053 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c566e-7fbd-4cf6-a0b2-293c55e907cd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:11.981053 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c566e-7fbd-4cf6-a0b2-293c55e907cd None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:11.982350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:32:11.987666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8404ea-1b2b-467d-8007-b5b89a2444c6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:11.988145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8404ea-1b2b-467d-8007-b5b89a2444c6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:11.988250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8404ea-1b2b-467d-8007-b5b89a2444c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:12.074191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ba8404ea-1b2b-467d-8007-b5b89a2444c6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:32:12.075416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ba8404ea-1b2b-467d-8007-b5b89a2444c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:12.176362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:32:12.331833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c566e-7fbd-4cf6-a0b2-293c55e907cd None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:32:12.334009 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0e7c566e-7fbd-4cf6-a0b2-293c55e907cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:12.451794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c566e-7fbd-4cf6-a0b2-293c55e907cd None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:32:12.457293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d407a2-2ae6-4c53-b3f5-d07e2ba91c5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:32:12.457911 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d407a2-2ae6-4c53-b3f5-d07e2ba91c5d service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:12.458195 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d407a2-2ae6-4c53-b3f5-d07e2ba91c5d service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:12.458471 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d407a2-2ae6-4c53-b3f5-d07e2ba91c5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:12.466967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d407a2-2ae6-4c53-b3f5-d07e2ba91c5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:32:12.468588 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d407a2-2ae6-4c53-b3f5-d07e2ba91c5d service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:32:12.478425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 750/1513] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:32:13.305985 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de05267-d62a-457a-afe6-7a777dde521e None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:13.306579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de05267-d62a-457a-afe6-7a777dde521e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:13.306579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de05267-d62a-457a-afe6-7a777dde521e None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:13.307973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:32:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:32:13.313176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da31bfe-26e1-41d2-9e8f-572a6924dce6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:13.313641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da31bfe-26e1-41d2-9e8f-572a6924dce6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:13.313758 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da31bfe-26e1-41d2-9e8f-572a6924dce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:13.334572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5da31bfe-26e1-41d2-9e8f-572a6924dce6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:32:13.335989 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5da31bfe-26e1-41d2-9e8f-572a6924dce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:13.344430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:32:13.379636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73be1a7-c04b-44a6-842e-be08d8cb5f7b None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:13.380034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73be1a7-c04b-44a6-842e-be08d8cb5f7b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:13.380324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73be1a7-c04b-44a6-842e-be08d8cb5f7b None None] PATH_INFO: `/v3` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:13.381614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 765/1516] 10.222.0.55 () {54 vars in 925 bytes} [Wed Jul 27 16:32:13 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:32:13.387899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5683-5929-458c-9835-18d8f4046c8b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:13.388199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5683-5929-458c-9835-18d8f4046c8b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:13.388481 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5683-5929-458c-9835-18d8f4046c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:13.449432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3a3d5683-5929-458c-9835-18d8f4046c8b None None] MFA Rules not processed for user `f602decb26be477b867493429352bd03`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:32:13.450652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3a3d5683-5929-458c-9835-18d8f4046c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:13.496742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73be1a7-c04b-44a6-842e-be08d8cb5f7b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:32:13.502785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:32:13.511363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73be1a7-c04b-44a6-842e-be08d8cb5f7b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:32:13.516862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88693389-44ea-4226-8861-8e6336e0b520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:32:13.517484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88693389-44ea-4226-8861-8e6336e0b520 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:13.517772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88693389-44ea-4226-8861-8e6336e0b520 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:13.518050 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88693389-44ea-4226-8861-8e6336e0b520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:13.522173 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 752/1517] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Jul 27 16:32:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:32:13.526502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88693389-44ea-4226-8861-8e6336e0b520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:32:13.528356 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88693389-44ea-4226-8861-8e6336e0b520 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:32:13.537978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 766/1518] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:32:22.648117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60011a-db77-47a4-b92f-d6a3421c9fa9 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:22.649019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60011a-db77-47a4-b92f-d6a3421c9fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:22.649019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60011a-db77-47a4-b92f-d6a3421c9fa9 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:22.650087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 753/1519] 10.222.0.67 () {54 vars in 961 bytes} [Wed Jul 27 16:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:32:22.655452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb6115-256a-4281-9d99-20ec992d7812 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:22.655452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb6115-256a-4281-9d99-20ec992d7812 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:22.655969 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb6115-256a-4281-9d99-20ec992d7812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:22.675714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-9ecb6115-256a-4281-9d99-20ec992d7812 None None] MFA Rules not processed for user `f602decb26be477b867493429352bd03`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:32:22.676931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9ecb6115-256a-4281-9d99-20ec992d7812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:22.686057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 767/1520] 10.222.0.67 () {58 vars in 1058 bytes} [Wed Jul 27 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:32:22.693507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60011a-db77-47a4-b92f-d6a3421c9fa9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:32:22.706617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60011a-db77-47a4-b92f-d6a3421c9fa9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:32:22.711583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb5494-5c5c-4f71-bbe8-565d89ef8476 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f602decb26be477b867493429352bd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:32:22.712227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb5494-5c5c-4f71-bbe8-565d89ef8476 service placement] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:22.712513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb5494-5c5c-4f71-bbe8-565d89ef8476 service placement] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:22.712788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb5494-5c5c-4f71-bbe8-565d89ef8476 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:22.720909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb5494-5c5c-4f71-bbe8-565d89ef8476 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:32:22.722482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb5494-5c5c-4f71-bbe8-565d89ef8476 service placement] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:32:22.732804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 754/1521] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:32:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:32:24.764092 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4d404-cc99-43d3-8e16-495c1dc6e350 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:24.764658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4d404-cc99-43d3-8e16-495c1dc6e350 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:24.764658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4d404-cc99-43d3-8e16-495c1dc6e350 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:24.766012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:32:24.770769 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92376a28-6eaf-4ca7-9629-5c7f37cc18a9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:24.771192 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92376a28-6eaf-4ca7-9629-5c7f37cc18a9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:24.771446 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92376a28-6eaf-4ca7-9629-5c7f37cc18a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:24.791674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-92376a28-6eaf-4ca7-9629-5c7f37cc18a9 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:32:24.792877 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-92376a28-6eaf-4ca7-9629-5c7f37cc18a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:24.800678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:32:24.956741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4d404-cc99-43d3-8e16-495c1dc6e350 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:32:24.971902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4d404-cc99-43d3-8e16-495c1dc6e350 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:32:24.977390 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea82453-a8db-4bfc-ba3b-641c8f0b067b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:32:24.978203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea82453-a8db-4bfc-ba3b-641c8f0b067b service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:24.978687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea82453-a8db-4bfc-ba3b-641c8f0b067b service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:24.979122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea82453-a8db-4bfc-ba3b-641c8f0b067b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:24.987627 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea82453-a8db-4bfc-ba3b-641c8f0b067b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:32:24.989248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea82453-a8db-4bfc-ba3b-641c8f0b067b service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:32:24.998815 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 769/1524] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:32:25.821893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19525da-c6a7-4d76-b396-0e38bb6322be None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:25.822458 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19525da-c6a7-4d76-b396-0e38bb6322be None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:25.822743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19525da-c6a7-4d76-b396-0e38bb6322be None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:25.824164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 16:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:32:25.829015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144831f2-442f-444b-8a54-744939c13151 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:25.829447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144831f2-442f-444b-8a54-744939c13151 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:25.829602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144831f2-442f-444b-8a54-744939c13151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:25.848849 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-144831f2-442f-444b-8a54-744939c13151 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:32:25.850031 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-144831f2-442f-444b-8a54-744939c13151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:25.859038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:32:26.010478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19525da-c6a7-4d76-b396-0e38bb6322be None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:32:26.024532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19525da-c6a7-4d76-b396-0e38bb6322be None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:32:26.030451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10053b9-d43a-4daf-917f-8a997d39262a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:32:26.031060 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10053b9-d43a-4daf-917f-8a997d39262a service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:26.031344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10053b9-d43a-4daf-917f-8a997d39262a service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:26.031623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10053b9-d43a-4daf-917f-8a997d39262a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:26.039516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10053b9-d43a-4daf-917f-8a997d39262a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:32:26.041726 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10053b9-d43a-4daf-917f-8a997d39262a service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:32:26.051137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 757/1527] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:32:29.954575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493135bb-77a0-4efa-a839-d75595d82379 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:29.955104 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493135bb-77a0-4efa-a839-d75595d82379 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:29.955104 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493135bb-77a0-4efa-a839-d75595d82379 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:29.956445 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:32:29.961751 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f357-ed02-45c4-b9e9-7ec5d122c216 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:29.962203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f357-ed02-45c4-b9e9-7ec5d122c216 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:29.962562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f357-ed02-45c4-b9e9-7ec5d122c216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:29.982643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5ab2f357-ed02-45c4-b9e9-7ec5d122c216 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:32:29.984110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5ab2f357-ed02-45c4-b9e9-7ec5d122c216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:29.991762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:32:30.163060 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493135bb-77a0-4efa-a839-d75595d82379 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:32:30.164852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-493135bb-77a0-4efa-a839-d75595d82379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:30.198168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:32:30.244610 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493135bb-77a0-4efa-a839-d75595d82379 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:32:30.248227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c87011-c836-4708-8fcb-01fb4b02cdee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:32:30.248846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c87011-c836-4708-8fcb-01fb4b02cdee service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:30.249132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c87011-c836-4708-8fcb-01fb4b02cdee service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:30.249410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c87011-c836-4708-8fcb-01fb4b02cdee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:30.258215 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c87011-c836-4708-8fcb-01fb4b02cdee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:32:30.259746 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c87011-c836-4708-8fcb-01fb4b02cdee service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:32:30.269231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 772/1530] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:32:32.286057 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22830f2-19fa-410e-85e1-c38f55d2f40c None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:32.286514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22830f2-19fa-410e-85e1-c38f55d2f40c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:32.286631 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22830f2-19fa-410e-85e1-c38f55d2f40c None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:32.288006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:32:32.293757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259e55a-41c1-4ec1-b52a-45cf0738612a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:32.294180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259e55a-41c1-4ec1-b52a-45cf0738612a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:32.294347 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259e55a-41c1-4ec1-b52a-45cf0738612a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:32.314020 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7259e55a-41c1-4ec1-b52a-45cf0738612a None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:32:32.315196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7259e55a-41c1-4ec1-b52a-45cf0738612a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:32.323125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:32:32.359940 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22830f2-19fa-410e-85e1-c38f55d2f40c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:32:32.361611 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a22830f2-19fa-410e-85e1-c38f55d2f40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:32.375100 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22830f2-19fa-410e-85e1-c38f55d2f40c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:32:32.378604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82c6ac-d08c-45fc-b735-e37454fb1dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:32:32.379212 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c6ac-d08c-45fc-b735-e37454fb1dee service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:32.379496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c6ac-d08c-45fc-b735-e37454fb1dee service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:32.379801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c6ac-d08c-45fc-b735-e37454fb1dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:32.388796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82c6ac-d08c-45fc-b735-e37454fb1dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:32:32.390211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82c6ac-d08c-45fc-b735-e37454fb1dee service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:32:32.399450 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 760/1533] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:32:35.879565 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bc3dc-983a-48b5-b786-3d52207434de None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:35.880187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bc3dc-983a-48b5-b786-3d52207434de None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:35.880187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bc3dc-983a-48b5-b786-3d52207434de None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:35.881532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:32:35.887054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a60c6-f61a-4d1c-ab74-2802e41fb3cf None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:35.887488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a60c6-f61a-4d1c-ab74-2802e41fb3cf None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:35.887624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a60c6-f61a-4d1c-ab74-2802e41fb3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:35.907541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b00a60c6-f61a-4d1c-ab74-2802e41fb3cf None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:32:35.908733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b00a60c6-f61a-4d1c-ab74-2802e41fb3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:35.917731 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:32:36.228207 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bc3dc-983a-48b5-b786-3d52207434de None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:32:36.229892 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cf8bc3dc-983a-48b5-b786-3d52207434de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:36.308319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bc3dc-983a-48b5-b786-3d52207434de None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:32:36.311904 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52494-730c-4915-b845-aa4557493647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:32:36.312516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52494-730c-4915-b845-aa4557493647 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:36.312798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52494-730c-4915-b845-aa4557493647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:36.313072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52494-730c-4915-b845-aa4557493647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:36.322555 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52494-730c-4915-b845-aa4557493647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:32:36.324004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52494-730c-4915-b845-aa4557493647 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:32:36.333370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 775/1536] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:32:38.357602 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db33924-9e07-4c19-943e-5d32781a94eb None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:38.358407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db33924-9e07-4c19-943e-5d32781a94eb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:38.358407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db33924-9e07-4c19-943e-5d32781a94eb None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:38.359756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 16:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:32:38.364855 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620c4f1-ad49-4cf6-b2b4-212930cf0a6e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:38.365241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620c4f1-ad49-4cf6-b2b4-212930cf0a6e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:38.365417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620c4f1-ad49-4cf6-b2b4-212930cf0a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:38.385152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d620c4f1-ad49-4cf6-b2b4-212930cf0a6e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:32:38.386343 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d620c4f1-ad49-4cf6-b2b4-212930cf0a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:38.394098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 16:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:32:38.700754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db33924-9e07-4c19-943e-5d32781a94eb None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:32:38.702445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9db33924-9e07-4c19-943e-5d32781a94eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:32:38.715472 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db33924-9e07-4c19-943e-5d32781a94eb None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:32:38.719039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2f514-35fa-4cff-98f2-5abcdb76987f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:32:38.719661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2f514-35fa-4cff-98f2-5abcdb76987f service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:32:38.719978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2f514-35fa-4cff-98f2-5abcdb76987f service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:32:38.720260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2f514-35fa-4cff-98f2-5abcdb76987f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:32:38.729102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2f514-35fa-4cff-98f2-5abcdb76987f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:32:38.730522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2f514-35fa-4cff-98f2-5abcdb76987f service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:32:38.740110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 763/1539] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:32:48.379942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=63 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:32:48.735981 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=37 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:14.054053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc728ba-4a59-481d-a6b5-36f320a83b21 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.056384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc728ba-4a59-481d-a6b5-36f320a83b21 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.056384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc728ba-4a59-481d-a6b5-36f320a83b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.083900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-bbc728ba-4a59-481d-a6b5-36f320a83b21 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.085478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bbc728ba-4a59-481d-a6b5-36f320a83b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.099701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 777/1540] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.110205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e827-c2df-4a83-957a-09a65d74724d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.110800 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e827-c2df-4a83-957a-09a65d74724d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.110800 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e827-c2df-4a83-957a-09a65d74724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.140751 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c471e827-c2df-4a83-957a-09a65d74724d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.141987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c471e827-c2df-4a83-957a-09a65d74724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.151155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 764/1541] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.156291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc728ba-4a59-481d-a6b5-36f320a83b21 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.167419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc728ba-4a59-481d-a6b5-36f320a83b21 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.175845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25e137-4886-4269-a3e1-d7a59a9ea996 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.175845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25e137-4886-4269-a3e1-d7a59a9ea996 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.175845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25e137-4886-4269-a3e1-d7a59a9ea996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.183999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7121-a78f-4854-98f3-ffaac0959aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.184639 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7121-a78f-4854-98f3-ffaac0959aec admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.184926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7121-a78f-4854-98f3-ffaac0959aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.185203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7121-a78f-4854-98f3-ffaac0959aec admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.185912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c7121-a78f-4854-98f3-ffaac0959aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:34:14.186220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c7121-a78f-4854-98f3-ffaac0959aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.187833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c7121-a78f-4854-98f3-ffaac0959aec admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.211402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ed25e137-4886-4269-a3e1-d7a59a9ea996 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.214906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ed25e137-4886-4269-a3e1-d7a59a9ea996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.220091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 778/1542] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:34:14.239881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 765/1543] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:34:14.249833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7121-a78f-4854-98f3-ffaac0959aec admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.258116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeefcc-37b4-4935-9443-64041af36427 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.258439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeefcc-37b4-4935-9443-64041af36427 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.258756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeefcc-37b4-4935-9443-64041af36427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.270246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7121-a78f-4854-98f3-ffaac0959aec admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.288456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978ab85-647d-49a8-a4d9-7bacf09559a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.289108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978ab85-647d-49a8-a4d9-7bacf09559a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.289393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978ab85-647d-49a8-a4d9-7bacf09559a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.289680 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978ab85-647d-49a8-a4d9-7bacf09559a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.292486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978ab85-647d-49a8-a4d9-7bacf09559a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.293533 dv-cinder-849690-6-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-a978ab85-647d-49a8-a4d9-7bacf09559a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:34:14.293533 dv-cinder-849690-6-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 27 16:34:14.293533 dv-cinder-849690-6-smb devstack@keystone.service[80205]: Jul 27 16:34:14.294730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978ab85-647d-49a8-a4d9-7bacf09559a1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.319595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b7eeefcc-37b4-4935-9443-64041af36427 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.320870 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b7eeefcc-37b4-4935-9443-64041af36427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.349475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 766/1544] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.364832 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeefcc-37b4-4935-9443-64041af36427 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.369551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 779/1545] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:14.374056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978ab85-647d-49a8-a4d9-7bacf09559a1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.383976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeefcc-37b4-4935-9443-64041af36427 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.473629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978ab85-647d-49a8-a4d9-7bacf09559a1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.490073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb03284-6434-4e48-9b42-77d8e05693ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.490720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb03284-6434-4e48-9b42-77d8e05693ea admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.491013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb03284-6434-4e48-9b42-77d8e05693ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.491971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb757a46-367c-4097-9784-53cd843875bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.492610 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb757a46-367c-4097-9784-53cd843875bc admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.493468 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb757a46-367c-4097-9784-53cd843875bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.493761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb757a46-367c-4097-9784-53cd843875bc admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.493992 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb03284-6434-4e48-9b42-77d8e05693ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.495369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb757a46-367c-4097-9784-53cd843875bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.496112 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb03284-6434-4e48-9b42-77d8e05693ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:34:14.496423 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb03284-6434-4e48-9b42-77d8e05693ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.497441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-cfb03284-6434-4e48-9b42-77d8e05693ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:34:14.497441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 27 16:34:14.497441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: Jul 27 16:34:14.498337 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb03284-6434-4e48-9b42-77d8e05693ea admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.501550 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb757a46-367c-4097-9784-53cd843875bc admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.518046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 767/1546] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:34:14.522525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d9869-3335-4bd0-bae9-bbb83e8f8473 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.522525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d9869-3335-4bd0-bae9-bbb83e8f8473 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.522525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d9869-3335-4bd0-bae9-bbb83e8f8473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.543271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 780/1547] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:14.545530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0420f62-f25f-41c4-9afc-df3e17fdfa59 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.545896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0420f62-f25f-41c4-9afc-df3e17fdfa59 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.546248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0420f62-f25f-41c4-9afc-df3e17fdfa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.551905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-192d9869-3335-4bd0-bae9-bbb83e8f8473 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.553985 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-192d9869-3335-4bd0-bae9-bbb83e8f8473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.563705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 768/1548] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.565125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22517ec-c106-4e0c-86b2-913c313ba776 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.565414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22517ec-c106-4e0c-86b2-913c313ba776 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.565688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22517ec-c106-4e0c-86b2-913c313ba776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.572939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c0420f62-f25f-41c4-9afc-df3e17fdfa59 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.574096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c0420f62-f25f-41c4-9afc-df3e17fdfa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.587886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 781/1549] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.587886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c39885-35fc-4ecc-bc21-c5a4c6ea78d7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.587886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c39885-35fc-4ecc-bc21-c5a4c6ea78d7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.587886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c39885-35fc-4ecc-bc21-c5a4c6ea78d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.589474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e22517ec-c106-4e0c-86b2-913c313ba776 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.590798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e22517ec-c106-4e0c-86b2-913c313ba776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.598976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 769/1550] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.600909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22517ec-c106-4e0c-86b2-913c313ba776 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.606065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-61c39885-35fc-4ecc-bc21-c5a4c6ea78d7 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.607315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-61c39885-35fc-4ecc-bc21-c5a4c6ea78d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.611800 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22517ec-c106-4e0c-86b2-913c313ba776 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.615657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 782/1551] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.616550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9b0c4-d6cc-4dc3-a9c2-67f1704329ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.616890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89215d86-1fb3-4855-a2eb-a635dcc2a84c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.617179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89215d86-1fb3-4855-a2eb-a635dcc2a84c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.617341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9b0c4-d6cc-4dc3-a9c2-67f1704329ba admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.617475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89215d86-1fb3-4855-a2eb-a635dcc2a84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.617728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9b0c4-d6cc-4dc3-a9c2-67f1704329ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.618244 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9b0c4-d6cc-4dc3-a9c2-67f1704329ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.618967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9b0c4-d6cc-4dc3-a9c2-67f1704329ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.621133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9b0c4-d6cc-4dc3-a9c2-67f1704329ba admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.639849 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-89215d86-1fb3-4855-a2eb-a635dcc2a84c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.641096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-89215d86-1fb3-4855-a2eb-a635dcc2a84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.650493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 770/1552] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:14.650665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 783/1553] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.651345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89215d86-1fb3-4855-a2eb-a635dcc2a84c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.652530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb25b8-5eae-44d8-8a98-871c26ad65e4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.653092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb25b8-5eae-44d8-8a98-871c26ad65e4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.653616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb25b8-5eae-44d8-8a98-871c26ad65e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.663938 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89215d86-1fb3-4855-a2eb-a635dcc2a84c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.674237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c8eb25b8-5eae-44d8-8a98-871c26ad65e4 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.675537 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c8eb25b8-5eae-44d8-8a98-871c26ad65e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.721484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953da436-4277-4ee7-9065-73129242d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.722110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953da436-4277-4ee7-9065-73129242d003 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.722393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953da436-4277-4ee7-9065-73129242d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.722668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953da436-4277-4ee7-9065-73129242d003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.723355 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953da436-4277-4ee7-9065-73129242d003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.724971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953da436-4277-4ee7-9065-73129242d003 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.735654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 771/1554] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.736962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5212eb-3a9f-4f02-b6ee-3dbc2d5c9676 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.737256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5212eb-3a9f-4f02-b6ee-3dbc2d5c9676 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.737541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5212eb-3a9f-4f02-b6ee-3dbc2d5c9676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.739117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 784/1555] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:14.740525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca70dfd-e96d-46a6-9f86-5b17862e03f4 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.740734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca70dfd-e96d-46a6-9f86-5b17862e03f4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.740991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca70dfd-e96d-46a6-9f86-5b17862e03f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.758320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-9e5212eb-3a9f-4f02-b6ee-3dbc2d5c9676 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.759970 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9e5212eb-3a9f-4f02-b6ee-3dbc2d5c9676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.760509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-9ca70dfd-e96d-46a6-9f86-5b17862e03f4 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.761665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9ca70dfd-e96d-46a6-9f86-5b17862e03f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.767478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 772/1556] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.768713 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4cd32-8b28-4c0e-91d5-fbff077bc060 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.769003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4cd32-8b28-4c0e-91d5-fbff077bc060 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.769283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4cd32-8b28-4c0e-91d5-fbff077bc060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.772597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 785/1557] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.773862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1771d-916f-4b7a-914a-5e4e3de7448a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.774705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1771d-916f-4b7a-914a-5e4e3de7448a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.775204 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1771d-916f-4b7a-914a-5e4e3de7448a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.794072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-52b4cd32-8b28-4c0e-91d5-fbff077bc060 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.794796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-63f1771d-916f-4b7a-914a-5e4e3de7448a None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.795269 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-52b4cd32-8b28-4c0e-91d5-fbff077bc060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.796004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-63f1771d-916f-4b7a-914a-5e4e3de7448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.803099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 773/1558] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.804049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 786/1559] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.804178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4cd32-8b28-4c0e-91d5-fbff077bc060 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.807635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc89d11-f5d9-44c7-bcac-b40eb015decc None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.807635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc89d11-f5d9-44c7-bcac-b40eb015decc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.807635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc89d11-f5d9-44c7-bcac-b40eb015decc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.813599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4cd32-8b28-4c0e-91d5-fbff077bc060 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.814250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:14.818493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484feefe-7a45-4d3c-a120-5c8f6f794527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.819114 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484feefe-7a45-4d3c-a120-5c8f6f794527 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.819449 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484feefe-7a45-4d3c-a120-5c8f6f794527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.819825 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484feefe-7a45-4d3c-a120-5c8f6f794527 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.820600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484feefe-7a45-4d3c-a120-5c8f6f794527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.821652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-484feefe-7a45-4d3c-a120-5c8f6f794527 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:34:14.821652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 27 16:34:14.821652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: Jul 27 16:34:14.822826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484feefe-7a45-4d3c-a120-5c8f6f794527 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.827932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ffc89d11-f5d9-44c7-bcac-b40eb015decc None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.829075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ffc89d11-f5d9-44c7-bcac-b40eb015decc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.842592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 787/1560] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.842592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc89d11-f5d9-44c7-bcac-b40eb015decc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.845732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 774/1561] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:14.847098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9089ac-bb1a-43bc-a135-2be9e4a50ab7 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.847387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9089ac-bb1a-43bc-a135-2be9e4a50ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.847659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9089ac-bb1a-43bc-a135-2be9e4a50ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.849661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc89d11-f5d9-44c7-bcac-b40eb015decc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.854983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b7336-92a4-42cd-8b6b-833e780a36c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.855600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b7336-92a4-42cd-8b6b-833e780a36c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.855922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b7336-92a4-42cd-8b6b-833e780a36c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.856211 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b7336-92a4-42cd-8b6b-833e780a36c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.856938 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b7336-92a4-42cd-8b6b-833e780a36c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.858546 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b7336-92a4-42cd-8b6b-833e780a36c1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.867715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-9f9089ac-bb1a-43bc-a135-2be9e4a50ab7 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:14.869258 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 788/1562] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:14.869389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9f9089ac-bb1a-43bc-a135-2be9e4a50ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:14.869969 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b7336-92a4-42cd-8b6b-833e780a36c1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.877380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 775/1563] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:14.878258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9089ac-bb1a-43bc-a135-2be9e4a50ab7 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.880279 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b7336-92a4-42cd-8b6b-833e780a36c1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.885385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53cb90-2671-4897-9f7a-31e16bab3b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.885539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:14.885998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53cb90-2671-4897-9f7a-31e16bab3b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.886291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53cb90-2671-4897-9f7a-31e16bab3b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.886623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53cb90-2671-4897-9f7a-31e16bab3b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.887275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53cb90-2671-4897-9f7a-31e16bab3b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:34:14.887588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53cb90-2671-4897-9f7a-31e16bab3b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.889234 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53cb90-2671-4897-9f7a-31e16bab3b54 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.892062 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9089ac-bb1a-43bc-a135-2be9e4a50ab7 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.896993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d1ef-04ab-4be9-a083-b9388eee2409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.897608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d1ef-04ab-4be9-a083-b9388eee2409 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.897885 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d1ef-04ab-4be9-a083-b9388eee2409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.898154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d1ef-04ab-4be9-a083-b9388eee2409 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.898840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8d1ef-04ab-4be9-a083-b9388eee2409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:34:14.899800 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8d1ef-04ab-4be9-a083-b9388eee2409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.901407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8d1ef-04ab-4be9-a083-b9388eee2409 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.902896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 789/1564] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:34:14.903818 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53cb90-2671-4897-9f7a-31e16bab3b54 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.913701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53cb90-2671-4897-9f7a-31e16bab3b54 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.921909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 776/1565] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:34:14.921909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d1ef-04ab-4be9-a083-b9388eee2409 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.922146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaa725-4570-4d85-907b-516c3b28e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.922146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa725-4570-4d85-907b-516c3b28e8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.922146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa725-4570-4d85-907b-516c3b28e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.922146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa725-4570-4d85-907b-516c3b28e8d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.922517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeaa725-4570-4d85-907b-516c3b28e8d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:34:14.922517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeaa725-4570-4d85-907b-516c3b28e8d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.922931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeaa725-4570-4d85-907b-516c3b28e8d5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.927938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d1ef-04ab-4be9-a083-b9388eee2409 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.932982 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed0a8d-6ed9-4876-95df-4f6734f69680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.933620 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0a8d-6ed9-4876-95df-4f6734f69680 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.933900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0a8d-6ed9-4876-95df-4f6734f69680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.934195 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0a8d-6ed9-4876-95df-4f6734f69680 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.941699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 790/1566] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:34:14.941872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed0a8d-6ed9-4876-95df-4f6734f69680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:34:14.941872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed0a8d-6ed9-4876-95df-4f6734f69680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.942035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaa725-4570-4d85-907b-516c3b28e8d5 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.942135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed0a8d-6ed9-4876-95df-4f6734f69680 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.945151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaa725-4570-4d85-907b-516c3b28e8d5 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.950759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9e16b-ff04-418c-87d7-fd10c7ac8ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.951365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9e16b-ff04-418c-87d7-fd10c7ac8ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.951648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9e16b-ff04-418c-87d7-fd10c7ac8ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.951954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9e16b-ff04-418c-87d7-fd10c7ac8ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.952642 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9e16b-ff04-418c-87d7-fd10c7ac8ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:34:14.952950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9e16b-ff04-418c-87d7-fd10c7ac8ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.961523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 777/1567] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:34:14.962266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9e16b-ff04-418c-87d7-fd10c7ac8ce6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.962381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed0a8d-6ed9-4876-95df-4f6734f69680 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.966844 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed0a8d-6ed9-4876-95df-4f6734f69680 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.967569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 791/1568] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:34:14.968393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9e16b-ff04-418c-87d7-fd10c7ac8ce6 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.971905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cdb9b-56e1-4ba6-b55c-4b493b90a96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.972530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cdb9b-56e1-4ba6-b55c-4b493b90a96c admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.972811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cdb9b-56e1-4ba6-b55c-4b493b90a96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.973204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cdb9b-56e1-4ba6-b55c-4b493b90a96c admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.973949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cdb9b-56e1-4ba6-b55c-4b493b90a96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:14.975600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cdb9b-56e1-4ba6-b55c-4b493b90a96c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:14.978429 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9e16b-ff04-418c-87d7-fd10c7ac8ce6 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:14.984145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49d9fb-386c-454b-af40-f1c3da3a8288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:14.985083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49d9fb-386c-454b-af40-f1c3da3a8288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:14.985365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49d9fb-386c-454b-af40-f1c3da3a8288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:14.985642 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49d9fb-386c-454b-af40-f1c3da3a8288 admin admin] PATH_INFO: `/v3/projects/3e437e0b87954c92aefb75335ae5ba73/users/ec8c8a0717a5437b99cf55cead181390/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:14.989652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 778/1569] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:14.989652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cdb9b-56e1-4ba6-b55c-4b493b90a96c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:14.997470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cdb9b-56e1-4ba6-b55c-4b493b90a96c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.002173 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75737834-f028-495c-b90a-59b21069e223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.002797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75737834-f028-495c-b90a-59b21069e223 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.003080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75737834-f028-495c-b90a-59b21069e223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.003194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49d9fb-386c-454b-af40-f1c3da3a8288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e437e0b87954c92aefb75335ae5ba73, user_id=ec8c8a0717a5437b99cf55cead181390, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.003363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75737834-f028-495c-b90a-59b21069e223 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.004256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-ae49d9fb-386c-454b-af40-f1c3da3a8288 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:34:15.004256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 27 16:34:15.004256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: Jul 27 16:34:15.004551 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75737834-f028-495c-b90a-59b21069e223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:34:15.004632 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75737834-f028-495c-b90a-59b21069e223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.006142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75737834-f028-495c-b90a-59b21069e223 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.006255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49d9fb-386c-454b-af40-f1c3da3a8288 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.026714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 779/1570] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:34:15.026938 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 792/1571] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:14 2022] PUT /identity/v3/projects/3e437e0b87954c92aefb75335ae5ba73/users/ec8c8a0717a5437b99cf55cead181390/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:15.026938 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49d9fb-386c-454b-af40-f1c3da3a8288 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.027132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75737834-f028-495c-b90a-59b21069e223 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.033886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75737834-f028-495c-b90a-59b21069e223 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.084363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49d9fb-386c-454b-af40-f1c3da3a8288 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.089862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851ee67-9fd0-42bc-8734-cb6481fa19ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.090494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ee67-9fd0-42bc-8734-cb6481fa19ba admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.090779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ee67-9fd0-42bc-8734-cb6481fa19ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.091058 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ee67-9fd0-42bc-8734-cb6481fa19ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.091729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851ee67-9fd0-42bc-8734-cb6481fa19ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.091848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451a6a1-d376-4b4e-9cbb-cc69538dd1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.092468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451a6a1-d376-4b4e-9cbb-cc69538dd1db admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.092757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451a6a1-d376-4b4e-9cbb-cc69538dd1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.093032 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451a6a1-d376-4b4e-9cbb-cc69538dd1db admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.093689 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851ee67-9fd0-42bc-8734-cb6481fa19ba admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.093786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451a6a1-d376-4b4e-9cbb-cc69538dd1db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.095576 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451a6a1-d376-4b4e-9cbb-cc69538dd1db admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.121374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 793/1572] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:15.122250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851ee67-9fd0-42bc-8734-cb6481fa19ba admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.125638 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 780/1573] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:15.125638 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451a6a1-d376-4b4e-9cbb-cc69538dd1db admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.185544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851ee67-9fd0-42bc-8734-cb6481fa19ba admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.186750 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451a6a1-d376-4b4e-9cbb-cc69538dd1db admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.190200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d53d4-1d91-4294-bea2-09049fc7c26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.190878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d53d4-1d91-4294-bea2-09049fc7c26f admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.191094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d53d4-1d91-4294-bea2-09049fc7c26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.191367 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d53d4-1d91-4294-bea2-09049fc7c26f admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.191484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fab5f-a2ed-47c1-82de-99d5ebfe3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.192040 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fab5f-a2ed-47c1-82de-99d5ebfe3648 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.192156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d53d4-1d91-4294-bea2-09049fc7c26f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.192329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fab5f-a2ed-47c1-82de-99d5ebfe3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.192607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fab5f-a2ed-47c1-82de-99d5ebfe3648 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.193265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fab5f-a2ed-47c1-82de-99d5ebfe3648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.193931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d53d4-1d91-4294-bea2-09049fc7c26f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.195144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fab5f-a2ed-47c1-82de-99d5ebfe3648 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.206217 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:15.224470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 794/1574] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:15.224840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 781/1575] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:15.225683 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fab5f-a2ed-47c1-82de-99d5ebfe3648 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.226033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d53d4-1d91-4294-bea2-09049fc7c26f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.253045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:15.289637 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d53d4-1d91-4294-bea2-09049fc7c26f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.292370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fab5f-a2ed-47c1-82de-99d5ebfe3648 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.294563 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065515c1-2533-46ec-b549-51e5c6178a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.295211 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065515c1-2533-46ec-b549-51e5c6178a81 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.295543 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065515c1-2533-46ec-b549-51e5c6178a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.295763 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065515c1-2533-46ec-b549-51e5c6178a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.296458 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065515c1-2533-46ec-b549-51e5c6178a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.297156 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449e341-3cec-4149-9e6d-254453b80e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.297777 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449e341-3cec-4149-9e6d-254453b80e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.298065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449e341-3cec-4149-9e6d-254453b80e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.298346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449e341-3cec-4149-9e6d-254453b80e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.298440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065515c1-2533-46ec-b549-51e5c6178a81 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.299040 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449e341-3cec-4149-9e6d-254453b80e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.300673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449e341-3cec-4149-9e6d-254453b80e3b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.311341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 782/1576] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:15.312401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb850-8a0d-4346-a15f-deb6ea227151 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.313193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb850-8a0d-4346-a15f-deb6ea227151 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.313193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb850-8a0d-4346-a15f-deb6ea227151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.331359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 795/1577] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:15.332215 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065515c1-2533-46ec-b549-51e5c6178a81 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.341007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-240fb850-8a0d-4346-a15f-deb6ea227151 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:15.342183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-240fb850-8a0d-4346-a15f-deb6ea227151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:15.396264 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065515c1-2533-46ec-b549-51e5c6178a81 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.401039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a056c9-8b22-4039-aa60-252acc5da73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.401665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a056c9-8b22-4039-aa60-252acc5da73e admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.401952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a056c9-8b22-4039-aa60-252acc5da73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.402232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a056c9-8b22-4039-aa60-252acc5da73e admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.402925 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a056c9-8b22-4039-aa60-252acc5da73e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.407694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 783/1578] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:15.407840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a056c9-8b22-4039-aa60-252acc5da73e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.407973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fb850-8a0d-4346-a15f-deb6ea227151 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.415563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fb850-8a0d-4346-a15f-deb6ea227151 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.420270 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7065de5-fe8d-4d98-a249-1dbc3c567c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.420895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7065de5-fe8d-4d98-a249-1dbc3c567c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.421209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7065de5-fe8d-4d98-a249-1dbc3c567c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.421484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7065de5-fe8d-4d98-a249-1dbc3c567c59 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.422278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7065de5-fe8d-4d98-a249-1dbc3c567c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.424246 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7065de5-fe8d-4d98-a249-1dbc3c567c59 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.435957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 796/1579] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:15.437311 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a056c9-8b22-4039-aa60-252acc5da73e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.447486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 784/1580] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/users => generated 283 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:15.448529 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7065de5-fe8d-4d98-a249-1dbc3c567c59 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.457919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7065de5-fe8d-4d98-a249-1dbc3c567c59 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.504575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a056c9-8b22-4039-aa60-252acc5da73e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.510484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9da3b-ac3b-41d9-bb37-794332074482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.511425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9da3b-ac3b-41d9-bb37-794332074482 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.511709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9da3b-ac3b-41d9-bb37-794332074482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.512019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9da3b-ac3b-41d9-bb37-794332074482 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.512685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9da3b-ac3b-41d9-bb37-794332074482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.514617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9da3b-ac3b-41d9-bb37-794332074482 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.516547 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cc1ef-f9cd-4e7a-b3dd-bffa83db6b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.517177 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cc1ef-f9cd-4e7a-b3dd-bffa83db6b5b admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.517463 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cc1ef-f9cd-4e7a-b3dd-bffa83db6b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.517739 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cc1ef-f9cd-4e7a-b3dd-bffa83db6b5b admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.518406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cc1ef-f9cd-4e7a-b3dd-bffa83db6b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.520336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cc1ef-f9cd-4e7a-b3dd-bffa83db6b5b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.523558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:15.540586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 797/1581] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:15.540586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9da3b-ac3b-41d9-bb37-794332074482 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.544162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 785/1582] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:15.544162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cc1ef-f9cd-4e7a-b3dd-bffa83db6b5b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.548589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9da3b-ac3b-41d9-bb37-794332074482 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.551744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cc1ef-f9cd-4e7a-b3dd-bffa83db6b5b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.552847 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768edb20-d7af-418d-9abb-cc5cef55284b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.553456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768edb20-d7af-418d-9abb-cc5cef55284b admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.553743 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768edb20-d7af-418d-9abb-cc5cef55284b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.554019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768edb20-d7af-418d-9abb-cc5cef55284b admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.554707 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768edb20-d7af-418d-9abb-cc5cef55284b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.557348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768edb20-d7af-418d-9abb-cc5cef55284b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.557468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f53a70-6618-4646-8ec1-c7715e47c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.558030 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f53a70-6618-4646-8ec1-c7715e47c83f admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.558319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f53a70-6618-4646-8ec1-c7715e47c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.558600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f53a70-6618-4646-8ec1-c7715e47c83f admin admin] PATH_INFO: `/v3/projects/bd8e9861207c453baf72ac45d1eadb04/users/32a5063a78064508ad01165199bd60fc/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.575451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f53a70-6618-4646-8ec1-c7715e47c83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8e9861207c453baf72ac45d1eadb04, user_id=32a5063a78064508ad01165199bd60fc, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.578343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f53a70-6618-4646-8ec1-c7715e47c83f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.583269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 798/1583] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:15.583269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768edb20-d7af-418d-9abb-cc5cef55284b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.591798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 786/1584] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:15 2022] PUT /identity/v3/projects/bd8e9861207c453baf72ac45d1eadb04/users/32a5063a78064508ad01165199bd60fc/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:15.593432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768edb20-d7af-418d-9abb-cc5cef55284b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.596038 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f53a70-6618-4646-8ec1-c7715e47c83f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.604381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:15.654373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f53a70-6618-4646-8ec1-c7715e47c83f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.656698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b881a8-76c1-4f56-9fd5-54da76928e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.657334 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b881a8-76c1-4f56-9fd5-54da76928e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.657617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b881a8-76c1-4f56-9fd5-54da76928e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.657891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b881a8-76c1-4f56-9fd5-54da76928e56 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.658180 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fb78d-5b51-46bd-8cd8-7d249086897e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.658587 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b881a8-76c1-4f56-9fd5-54da76928e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.658800 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fb78d-5b51-46bd-8cd8-7d249086897e service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.659087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fb78d-5b51-46bd-8cd8-7d249086897e service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.659370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fb78d-5b51-46bd-8cd8-7d249086897e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.660560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b881a8-76c1-4f56-9fd5-54da76928e56 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.669525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fb78d-5b51-46bd-8cd8-7d249086897e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.670950 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fb78d-5b51-46bd-8cd8-7d249086897e service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.681447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 787/1585] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:15.683020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fb78d-5b51-46bd-8cd8-7d249086897e service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.687110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 799/1586] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:15.687110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b881a8-76c1-4f56-9fd5-54da76928e56 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.694271 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fb78d-5b51-46bd-8cd8-7d249086897e service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.698320 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b881a8-76c1-4f56-9fd5-54da76928e56 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.699777 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52d795-e80e-4f72-af04-68da075f32f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.700453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52d795-e80e-4f72-af04-68da075f32f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.700742 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52d795-e80e-4f72-af04-68da075f32f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.701022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52d795-e80e-4f72-af04-68da075f32f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.701707 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52d795-e80e-4f72-af04-68da075f32f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.703206 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf377d-9cf6-4c3a-b301-30319afed820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.703829 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf377d-9cf6-4c3a-b301-30319afed820 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.704144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf377d-9cf6-4c3a-b301-30319afed820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.704248 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52d795-e80e-4f72-af04-68da075f32f8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.704425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf377d-9cf6-4c3a-b301-30319afed820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.705128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf377d-9cf6-4c3a-b301-30319afed820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.706800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf377d-9cf6-4c3a-b301-30319afed820 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.720123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 800/1587] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:15.721143 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf377d-9cf6-4c3a-b301-30319afed820 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.731652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf377d-9cf6-4c3a-b301-30319afed820 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.734959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 788/1588] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/users => generated 287 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:15.735954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52d795-e80e-4f72-af04-68da075f32f8 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.739942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aab6eb-c609-4843-b12f-96479d4c17d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.740777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aab6eb-c609-4843-b12f-96479d4c17d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.741215 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aab6eb-c609-4843-b12f-96479d4c17d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.741642 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aab6eb-c609-4843-b12f-96479d4c17d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.742520 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aab6eb-c609-4843-b12f-96479d4c17d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.745095 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aab6eb-c609-4843-b12f-96479d4c17d7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.748819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52d795-e80e-4f72-af04-68da075f32f8 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.753937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29e44d-f9a2-4c66-97be-c13575ee2ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.754659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e44d-f9a2-4c66-97be-c13575ee2ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.755029 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e44d-f9a2-4c66-97be-c13575ee2ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.755373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e44d-f9a2-4c66-97be-c13575ee2ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.756181 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29e44d-f9a2-4c66-97be-c13575ee2ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.758036 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29e44d-f9a2-4c66-97be-c13575ee2ed0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.760272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 801/1589] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:15.761720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aab6eb-c609-4843-b12f-96479d4c17d7 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.771214 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aab6eb-c609-4843-b12f-96479d4c17d7 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.771945 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 789/1590] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:15.773430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d841f-ad27-40c8-a474-e5d390a590fe None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.774730 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d841f-ad27-40c8-a474-e5d390a590fe None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.775125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d841f-ad27-40c8-a474-e5d390a590fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.782429 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c0418-c3f3-4349-9863-867ea9633d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.783118 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c0418-c3f3-4349-9863-867ea9633d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.783463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c0418-c3f3-4349-9863-867ea9633d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.783816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c0418-c3f3-4349-9863-867ea9633d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.784683 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c0418-c3f3-4349-9863-867ea9633d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.786484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c0418-c3f3-4349-9863-867ea9633d6d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.802909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 802/1591] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:15.802909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c0418-c3f3-4349-9863-867ea9633d6d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.803234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-881d841f-ad27-40c8-a474-e5d390a590fe None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:15.803344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-881d841f-ad27-40c8-a474-e5d390a590fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:15.812731 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 790/1592] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:15.813549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d841f-ad27-40c8-a474-e5d390a590fe None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.814872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c0418-c3f3-4349-9863-867ea9633d6d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.823100 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edf568-6a95-42fb-adac-43187a1c207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.824027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edf568-6a95-42fb-adac-43187a1c207a admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.824451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edf568-6a95-42fb-adac-43187a1c207a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.824837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edf568-6a95-42fb-adac-43187a1c207a admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.826518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edf568-6a95-42fb-adac-43187a1c207a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.828697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edf568-6a95-42fb-adac-43187a1c207a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.840216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d841f-ad27-40c8-a474-e5d390a590fe None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.843332 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 803/1593] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:15.844363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edf568-6a95-42fb-adac-43187a1c207a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.849044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c527ed-3123-452b-a60f-9ebaa84c23dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.849635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c527ed-3123-452b-a60f-9ebaa84c23dd admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.849941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c527ed-3123-452b-a60f-9ebaa84c23dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.850278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c527ed-3123-452b-a60f-9ebaa84c23dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.850985 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c527ed-3123-452b-a60f-9ebaa84c23dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.854107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c527ed-3123-452b-a60f-9ebaa84c23dd admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.862438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edf568-6a95-42fb-adac-43187a1c207a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.868753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 791/1594] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:15.869457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c527ed-3123-452b-a60f-9ebaa84c23dd admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.870406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53089bc9-e777-4c74-9b91-35fd1a3ceee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.871262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53089bc9-e777-4c74-9b91-35fd1a3ceee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.871682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53089bc9-e777-4c74-9b91-35fd1a3ceee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.872076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53089bc9-e777-4c74-9b91-35fd1a3ceee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.872936 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53089bc9-e777-4c74-9b91-35fd1a3ceee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.874706 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53089bc9-e777-4c74-9b91-35fd1a3ceee9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.880604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c527ed-3123-452b-a60f-9ebaa84c23dd admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.886741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5acabf-b2b0-4240-b804-da9cc995ee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.887393 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5acabf-b2b0-4240-b804-da9cc995ee74 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.887668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5acabf-b2b0-4240-b804-da9cc995ee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.887952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5acabf-b2b0-4240-b804-da9cc995ee74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.891448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5acabf-b2b0-4240-b804-da9cc995ee74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.891708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 804/1595] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:15.891708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53089bc9-e777-4c74-9b91-35fd1a3ceee9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.891904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5acabf-b2b0-4240-b804-da9cc995ee74 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.902406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 792/1596] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:15.903096 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5acabf-b2b0-4240-b804-da9cc995ee74 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.906783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53089bc9-e777-4c74-9b91-35fd1a3ceee9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.916695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27294ac1-ca6e-4778-a53b-38cbc1de7099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.917419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27294ac1-ca6e-4778-a53b-38cbc1de7099 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.917812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27294ac1-ca6e-4778-a53b-38cbc1de7099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.917939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5acabf-b2b0-4240-b804-da9cc995ee74 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.918269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27294ac1-ca6e-4778-a53b-38cbc1de7099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.919080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27294ac1-ca6e-4778-a53b-38cbc1de7099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.921053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27294ac1-ca6e-4778-a53b-38cbc1de7099 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.924620 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d9423-e646-42b1-88ac-62d72531b8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.925275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d9423-e646-42b1-88ac-62d72531b8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.925562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d9423-e646-42b1-88ac-62d72531b8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.925845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d9423-e646-42b1-88ac-62d72531b8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.926858 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d9423-e646-42b1-88ac-62d72531b8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.928784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d9423-e646-42b1-88ac-62d72531b8d4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.937830 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 805/1597] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:15.940877 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27294ac1-ca6e-4778-a53b-38cbc1de7099 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.941526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 793/1598] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:15.942597 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d9423-e646-42b1-88ac-62d72531b8d4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.954514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d9423-e646-42b1-88ac-62d72531b8d4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.955094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27294ac1-ca6e-4778-a53b-38cbc1de7099 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:15.959595 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf69319-c4c0-4db6-8d9c-7618556b35ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.960259 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf69319-c4c0-4db6-8d9c-7618556b35ae service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.960528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fe2da-57b4-443e-b8c6-d5965b18de33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:15.960649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf69319-c4c0-4db6-8d9c-7618556b35ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.960933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf69319-c4c0-4db6-8d9c-7618556b35ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.961570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fe2da-57b4-443e-b8c6-d5965b18de33 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:15.963179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fe2da-57b4-443e-b8c6-d5965b18de33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:15.963615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fe2da-57b4-443e-b8c6-d5965b18de33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:15.964406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fe2da-57b4-443e-b8c6-d5965b18de33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.966432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fe2da-57b4-443e-b8c6-d5965b18de33 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.972982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf69319-c4c0-4db6-8d9c-7618556b35ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:15.974425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf69319-c4c0-4db6-8d9c-7618556b35ae service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:15.983145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 794/1599] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:15.984582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fe2da-57b4-443e-b8c6-d5965b18de33 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.985130 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 806/1600] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:15.985848 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf69319-c4c0-4db6-8d9c-7618556b35ae service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:15.996407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf69319-c4c0-4db6-8d9c-7618556b35ae service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:16.000299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fe2da-57b4-443e-b8c6-d5965b18de33 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:16.002410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768f5ec-ce1b-41fc-8369-d8111881a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:16.003261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768f5ec-ce1b-41fc-8369-d8111881a856 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.003826 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768f5ec-ce1b-41fc-8369-d8111881a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.004309 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768f5ec-ce1b-41fc-8369-d8111881a856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.005157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768f5ec-ce1b-41fc-8369-d8111881a856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:16.005879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a7dbc-6695-4067-b4f6-42e9128d7989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:16.006697 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a7dbc-6695-4067-b4f6-42e9128d7989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.007422 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a7dbc-6695-4067-b4f6-42e9128d7989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.007551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768f5ec-ce1b-41fc-8369-d8111881a856 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:16.007903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a7dbc-6695-4067-b4f6-42e9128d7989 admin admin] PATH_INFO: `/v3/projects/544139e55ba940ecb52f43258ef596b2/users/ae3b0b860f7848c7a4013421ec87ffb4/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.021920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 807/1601] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:16.022970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768f5ec-ce1b-41fc-8369-d8111881a856 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:16.031484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a7dbc-6695-4067-b4f6-42e9128d7989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=544139e55ba940ecb52f43258ef596b2, user_id=ae3b0b860f7848c7a4013421ec87ffb4, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:16.034630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a7dbc-6695-4067-b4f6-42e9128d7989 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:16.037602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768f5ec-ce1b-41fc-8369-d8111881a856 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:16.044873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55359229-da83-4585-a612-f85a70554c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:16.045547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55359229-da83-4585-a612-f85a70554c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.045884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55359229-da83-4585-a612-f85a70554c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.046172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55359229-da83-4585-a612-f85a70554c7d admin admin] PATH_INFO: `/v3/projects/be258adc704748749dd73c64091db71c/users/bc75a052c6b14904a314cf8f7bd4bad7/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.065479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55359229-da83-4585-a612-f85a70554c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be258adc704748749dd73c64091db71c, user_id=bc75a052c6b14904a314cf8f7bd4bad7, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:16.066526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 795/1602] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:15 2022] PUT /identity/v3/projects/544139e55ba940ecb52f43258ef596b2/users/ae3b0b860f7848c7a4013421ec87ffb4/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:16.068377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a7dbc-6695-4067-b4f6-42e9128d7989 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:16.069517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55359229-da83-4585-a612-f85a70554c7d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:16.105164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 808/1603] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:16 2022] PUT /identity/v3/projects/be258adc704748749dd73c64091db71c/users/bc75a052c6b14904a314cf8f7bd4bad7/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:16.105164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55359229-da83-4585-a612-f85a70554c7d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:16.124421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:16.161842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a7dbc-6695-4067-b4f6-42e9128d7989 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:16.172909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:16.191690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55359229-da83-4585-a612-f85a70554c7d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:16.199308 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db7386-226c-48e8-938b-881d2820d40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:16.200225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7386-226c-48e8-938b-881d2820d40e admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.200697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7386-226c-48e8-938b-881d2820d40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.201254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7386-226c-48e8-938b-881d2820d40e admin admin] PATH_INFO: `/v3/projects/ab5c8363dd3446c78e1e8b8c97fc80a9/users/17804273371846b7abdcbd663a06c227/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.222483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db7386-226c-48e8-938b-881d2820d40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5c8363dd3446c78e1e8b8c97fc80a9, user_id=17804273371846b7abdcbd663a06c227, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:16.226244 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db7386-226c-48e8-938b-881d2820d40e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:16.231589 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a870b-ce80-46d6-887e-33a41dc10477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:16.232692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a870b-ce80-46d6-887e-33a41dc10477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.233015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a870b-ce80-46d6-887e-33a41dc10477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.233319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a870b-ce80-46d6-887e-33a41dc10477 admin admin] PATH_INFO: `/v3/projects/a5b4a31bdac9447baac7ab034437b8c0/users/9f9f6f78132e4f5db9f0d4d667812a1d/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.251156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 809/1604] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:16 2022] PUT /identity/v3/projects/ab5c8363dd3446c78e1e8b8c97fc80a9/users/17804273371846b7abdcbd663a06c227/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:16.252344 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db7386-226c-48e8-938b-881d2820d40e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:16.257041 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a870b-ce80-46d6-887e-33a41dc10477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b4a31bdac9447baac7ab034437b8c0, user_id=9f9f6f78132e4f5db9f0d4d667812a1d, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:16.260704 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a870b-ce80-46d6-887e-33a41dc10477 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:16.277866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 796/1605] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:16 2022] PUT /identity/v3/projects/a5b4a31bdac9447baac7ab034437b8c0/users/9f9f6f78132e4f5db9f0d4d667812a1d/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:16.278850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a870b-ce80-46d6-887e-33a41dc10477 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:16.338197 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db7386-226c-48e8-938b-881d2820d40e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:16.357215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a870b-ce80-46d6-887e-33a41dc10477 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:16.366780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b9998-3e10-44ae-b421-26832f26ff26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:16.367453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b9998-3e10-44ae-b421-26832f26ff26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.367853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b9998-3e10-44ae-b421-26832f26ff26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.368649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b9998-3e10-44ae-b421-26832f26ff26 admin admin] PATH_INFO: `/v3/projects/ba7f2eed42834bc7bb2c17851e7dca8c/users/40bb2fee6b2f4e0a9061774ea6eb2e2e/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.388228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b9998-3e10-44ae-b421-26832f26ff26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7f2eed42834bc7bb2c17851e7dca8c, user_id=40bb2fee6b2f4e0a9061774ea6eb2e2e, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:16.391370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b9998-3e10-44ae-b421-26832f26ff26 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:16.408351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba092a5-1282-45cd-a5a9-28df82275e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:16.417662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 797/1606] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:16 2022] PUT /identity/v3/projects/ba7f2eed42834bc7bb2c17851e7dca8c/users/40bb2fee6b2f4e0a9061774ea6eb2e2e/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:16.417836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba092a5-1282-45cd-a5a9-28df82275e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.417836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba092a5-1282-45cd-a5a9-28df82275e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.417836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba092a5-1282-45cd-a5a9-28df82275e90 admin admin] PATH_INFO: `/v3/projects/005f77adea3943dfbd58d92ae65e0a12/users/376b06b82be64da3b0bd2a26738b92e9/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.418098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed917-ed9e-4813-b69c-2cbc0248bcb2 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.418098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed917-ed9e-4813-b69c-2cbc0248bcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.418098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed917-ed9e-4813-b69c-2cbc0248bcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.439588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba092a5-1282-45cd-a5a9-28df82275e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=005f77adea3943dfbd58d92ae65e0a12, user_id=376b06b82be64da3b0bd2a26738b92e9, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:16.443736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba092a5-1282-45cd-a5a9-28df82275e90 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:16.450480 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a85ed917-ed9e-4813-b69c-2cbc0248bcb2 None None] MFA Rules not processed for user `ae3b0b860f7848c7a4013421ec87ffb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:16.451899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a85ed917-ed9e-4813-b69c-2cbc0248bcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:16.471902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 810/1607] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:16 2022] PUT /identity/v3/projects/005f77adea3943dfbd58d92ae65e0a12/users/376b06b82be64da3b0bd2a26738b92e9/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:16.485976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef240e8-02a4-4558-89ed-4551d0942b3d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.486295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef240e8-02a4-4558-89ed-4551d0942b3d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.486550 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef240e8-02a4-4558-89ed-4551d0942b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.509143 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8ef240e8-02a4-4558-89ed-4551d0942b3d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:16.510525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8ef240e8-02a4-4558-89ed-4551d0942b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:16.536200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:16.573872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 798/1608] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:16.575567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6e5a6-3e62-42ab-a4be-decb1d934cc9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.576074 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6e5a6-3e62-42ab-a4be-decb1d934cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.576366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6e5a6-3e62-42ab-a4be-decb1d934cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.596207 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 811/1609] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:16.601500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db290f16-a3fe-4e63-9c74-57d7f6a10518 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.602079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db290f16-a3fe-4e63-9c74-57d7f6a10518 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.602439 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db290f16-a3fe-4e63-9c74-57d7f6a10518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.614645 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-35a6e5a6-3e62-42ab-a4be-decb1d934cc9 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:16.615962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-35a6e5a6-3e62-42ab-a4be-decb1d934cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:16.641008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 799/1610] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:16.644198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a890c5-2e92-4669-8fe7-e88687bef5ca None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.644198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a890c5-2e92-4669-8fe7-e88687bef5ca None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.644198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a890c5-2e92-4669-8fe7-e88687bef5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.650963 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-db290f16-a3fe-4e63-9c74-57d7f6a10518 None None] MFA Rules not processed for user `9f9f6f78132e4f5db9f0d4d667812a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:16.652286 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-db290f16-a3fe-4e63-9c74-57d7f6a10518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:16.666366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:16.695638 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f3a890c5-2e92-4669-8fe7-e88687bef5ca None None] MFA Rules not processed for user `40bb2fee6b2f4e0a9061774ea6eb2e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:16.698510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f3a890c5-2e92-4669-8fe7-e88687bef5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:16.755373 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 812/1611] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:16.755994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b6ec3-089f-4271-a612-df5dceea5e61 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.756346 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b6ec3-089f-4271-a612-df5dceea5e61 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.756681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b6ec3-089f-4271-a612-df5dceea5e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.809284 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 800/1612] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:16.810257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a890c5-2e92-4669-8fe7-e88687bef5ca None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:16.828700 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a97b6ec3-089f-4271-a612-df5dceea5e61 None None] MFA Rules not processed for user `376b06b82be64da3b0bd2a26738b92e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:16.829936 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a97b6ec3-089f-4271-a612-df5dceea5e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:16.830956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a890c5-2e92-4669-8fe7-e88687bef5ca None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:16.838286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b10b9-c4d6-4c3f-8c50-aed6732e4c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:16.839190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b10b9-c4d6-4c3f-8c50-aed6732e4c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:16.839454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b10b9-c4d6-4c3f-8c50-aed6732e4c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:16.840764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b10b9-c4d6-4c3f-8c50-aed6732e4c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:16.841880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b10b9-c4d6-4c3f-8c50-aed6732e4c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:16.844223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b10b9-c4d6-4c3f-8c50-aed6732e4c18 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:16.901559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 801/1613] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:16 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:16.904250 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b10b9-c4d6-4c3f-8c50-aed6732e4c18 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:16.974732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 813/1614] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:16.975354 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b6ec3-089f-4271-a612-df5dceea5e61 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:17.014763 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b10b9-c4d6-4c3f-8c50-aed6732e4c18 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:17.023588 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d60bd9-3ab3-461d-b346-73b837eed4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:17.027739 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d60bd9-3ab3-461d-b346-73b837eed4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.028120 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d60bd9-3ab3-461d-b346-73b837eed4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.028489 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d60bd9-3ab3-461d-b346-73b837eed4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.093843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:17.112057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b6ec3-089f-4271-a612-df5dceea5e61 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:17.126152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18444925-6cc1-4d5a-a57f-87795714ba6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:17.126838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18444925-6cc1-4d5a-a57f-87795714ba6d service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.127220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18444925-6cc1-4d5a-a57f-87795714ba6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.127567 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18444925-6cc1-4d5a-a57f-87795714ba6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.185295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d60bd9-3ab3-461d-b346-73b837eed4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:17.186847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d60bd9-3ab3-461d-b346-73b837eed4b0 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:17.207904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 802/1615] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:17.213758 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d60bd9-3ab3-461d-b346-73b837eed4b0 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:17.229186 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d60bd9-3ab3-461d-b346-73b837eed4b0 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:17.240589 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21546fc3-0f64-49cb-a4a6-e06371e7d054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:17.241440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21546fc3-0f64-49cb-a4a6-e06371e7d054 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.242340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21546fc3-0f64-49cb-a4a6-e06371e7d054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.243891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21546fc3-0f64-49cb-a4a6-e06371e7d054 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.244887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21546fc3-0f64-49cb-a4a6-e06371e7d054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:17.247312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21546fc3-0f64-49cb-a4a6-e06371e7d054 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:17.260297 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18444925-6cc1-4d5a-a57f-87795714ba6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:17.262353 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18444925-6cc1-4d5a-a57f-87795714ba6d service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:17.284353 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 814/1616] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:17.286501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d034b0f-e402-4e29-ba27-db06ed84d085 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.287250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d034b0f-e402-4e29-ba27-db06ed84d085 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.287250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d034b0f-e402-4e29-ba27-db06ed84d085 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.289445 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 815/1617] 10.222.0.67 () {54 vars in 962 bytes} [Wed Jul 27 16:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:34:17.290295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d034b0f-e402-4e29-ba27-db06ed84d085 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:17.292870 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:17.306591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 803/1618] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:17 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:17.308320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442e98b-d1f7-4d5a-8359-f4b3aad57c93 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.308705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442e98b-d1f7-4d5a-8359-f4b3aad57c93 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.309501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442e98b-d1f7-4d5a-8359-f4b3aad57c93 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.313179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 804/1619] 10.222.0.67 () {54 vars in 962 bytes} [Wed Jul 27 16:34:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:34:17.315176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5842f-4af0-44de-b327-8a8ab3e2e731 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.317141 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5842f-4af0-44de-b327-8a8ab3e2e731 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.317300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5842f-4af0-44de-b327-8a8ab3e2e731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.323128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d034b0f-e402-4e29-ba27-db06ed84d085 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:17.401578 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-76c5842f-4af0-44de-b327-8a8ab3e2e731 None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:17.404895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-76c5842f-4af0-44de-b327-8a8ab3e2e731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:17.460509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f7db9-c0d1-4357-bf73-babf38438121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:17.461173 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f7db9-c0d1-4357-bf73-babf38438121 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.461610 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f7db9-c0d1-4357-bf73-babf38438121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.462284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f7db9-c0d1-4357-bf73-babf38438121 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.463082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f7db9-c0d1-4357-bf73-babf38438121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:17.474137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f7db9-c0d1-4357-bf73-babf38438121 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:17.515477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 816/1620] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:17 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:17.515477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f7db9-c0d1-4357-bf73-babf38438121 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:17.526766 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 805/1621] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Jul 27 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:17.528693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006c6b-4be4-4443-9f6a-2c35152579fc None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.528832 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f7db9-c0d1-4357-bf73-babf38438121 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:17.529355 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006c6b-4be4-4443-9f6a-2c35152579fc None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.529808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006c6b-4be4-4443-9f6a-2c35152579fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.534568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eaf906-3356-4360-94c2-6dd01cbfbdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:17.535570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaf906-3356-4360-94c2-6dd01cbfbdff admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.535570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaf906-3356-4360-94c2-6dd01cbfbdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.536436 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaf906-3356-4360-94c2-6dd01cbfbdff admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.537209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eaf906-3356-4360-94c2-6dd01cbfbdff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:17.552133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eaf906-3356-4360-94c2-6dd01cbfbdff admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:17.556890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a3006c6b-4be4-4443-9f6a-2c35152579fc None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:17.559219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a3006c6b-4be4-4443-9f6a-2c35152579fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:17.571304 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 806/1622] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Jul 27 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:17.572463 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3006c6b-4be4-4443-9f6a-2c35152579fc None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:17.583968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3006c6b-4be4-4443-9f6a-2c35152579fc None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:17.588863 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 817/1623] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:17 2022] POST /identity/v3/users => generated 292 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:17.589720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eaf906-3356-4360-94c2-6dd01cbfbdff admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:17.593744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f091c-c43d-4ca6-9edd-04b6f782e173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:17.594720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f091c-c43d-4ca6-9edd-04b6f782e173 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.595225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f091c-c43d-4ca6-9edd-04b6f782e173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.595712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f091c-c43d-4ca6-9edd-04b6f782e173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.600760 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f091c-c43d-4ca6-9edd-04b6f782e173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:17.603372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f091c-c43d-4ca6-9edd-04b6f782e173 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:17.606548 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eaf906-3356-4360-94c2-6dd01cbfbdff admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:17.613848 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec35bc5-348b-4c7c-8eb9-16285dbd9019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:17.615738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35bc5-348b-4c7c-8eb9-16285dbd9019 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.616339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35bc5-348b-4c7c-8eb9-16285dbd9019 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.616707 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35bc5-348b-4c7c-8eb9-16285dbd9019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.625986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 807/1624] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:17.627475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f091c-c43d-4ca6-9edd-04b6f782e173 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:17.645673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f091c-c43d-4ca6-9edd-04b6f782e173 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:17.663356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b450a-b7d2-4075-91ea-7fb5dc1d7337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:17.664519 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b450a-b7d2-4075-91ea-7fb5dc1d7337 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.666240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b450a-b7d2-4075-91ea-7fb5dc1d7337 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.666576 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b450a-b7d2-4075-91ea-7fb5dc1d7337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.714740 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec35bc5-348b-4c7c-8eb9-16285dbd9019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:17.717012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec35bc5-348b-4c7c-8eb9-16285dbd9019 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:17.732639 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 818/1625] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:17.734205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec35bc5-348b-4c7c-8eb9-16285dbd9019 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:17.743374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:17.751728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec35bc5-348b-4c7c-8eb9-16285dbd9019 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:17.763041 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a6f5c-3001-45f1-866c-9d92b01cc14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:17.764482 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a6f5c-3001-45f1-866c-9d92b01cc14d admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.765056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a6f5c-3001-45f1-866c-9d92b01cc14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.765339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a6f5c-3001-45f1-866c-9d92b01cc14d admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.766199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a6f5c-3001-45f1-866c-9d92b01cc14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:17.768082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a6f5c-3001-45f1-866c-9d92b01cc14d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:17.783083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 819/1626] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:17.783815 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b450a-b7d2-4075-91ea-7fb5dc1d7337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:17.784035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a6f5c-3001-45f1-866c-9d92b01cc14d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:17.787051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b450a-b7d2-4075-91ea-7fb5dc1d7337 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:17.799680 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a6f5c-3001-45f1-866c-9d92b01cc14d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:17.801455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 808/1627] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:17.802493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b450a-b7d2-4075-91ea-7fb5dc1d7337 service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:17.806379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552147-2a03-4d27-bebf-839325fee511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:17.807176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552147-2a03-4d27-bebf-839325fee511 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.807514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552147-2a03-4d27-bebf-839325fee511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.807803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552147-2a03-4d27-bebf-839325fee511 admin admin] PATH_INFO: `/v3/projects/f47f9ea10fe74b05baa2887a92bb2df0/users/b465777e48c545c6a5d69906f98bf415/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.815158 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b450a-b7d2-4075-91ea-7fb5dc1d7337 service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:17.829045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3846d0-481a-4448-800a-609f4a286b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:17.829045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3846d0-481a-4448-800a-609f4a286b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:17.829545 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3846d0-481a-4448-800a-609f4a286b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:17.829545 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3846d0-481a-4448-800a-609f4a286b90 admin admin] PATH_INFO: `/v3/projects/40c50c577f224cbdba2a40e8d191d9a4/users/ef5b6ab062814fd197d12d7edb4fac06/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:17.838070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87552147-2a03-4d27-bebf-839325fee511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47f9ea10fe74b05baa2887a92bb2df0, user_id=b465777e48c545c6a5d69906f98bf415, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:17.843796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87552147-2a03-4d27-bebf-839325fee511 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:17.863206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3846d0-481a-4448-800a-609f4a286b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c50c577f224cbdba2a40e8d191d9a4, user_id=ef5b6ab062814fd197d12d7edb4fac06, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:17.868858 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3846d0-481a-4448-800a-609f4a286b90 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:17.878792 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 820/1628] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:17 2022] PUT /identity/v3/projects/f47f9ea10fe74b05baa2887a92bb2df0/users/b465777e48c545c6a5d69906f98bf415/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:17.881380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552147-2a03-4d27-bebf-839325fee511 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:17.894175 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 809/1629] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:17 2022] PUT /identity/v3/projects/40c50c577f224cbdba2a40e8d191d9a4/users/ef5b6ab062814fd197d12d7edb4fac06/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:17.898131 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3846d0-481a-4448-800a-609f4a286b90 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:17.983786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:18.067658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3846d0-481a-4448-800a-609f4a286b90 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:18.087848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fc98f-4c47-4be0-88ac-24fc00e5073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:18.090086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552147-2a03-4d27-bebf-839325fee511 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:18.091373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fc98f-4c47-4be0-88ac-24fc00e5073e admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:18.091662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fc98f-4c47-4be0-88ac-24fc00e5073e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:18.091969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fc98f-4c47-4be0-88ac-24fc00e5073e admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:18.092686 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fc98f-4c47-4be0-88ac-24fc00e5073e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:18.094298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fc98f-4c47-4be0-88ac-24fc00e5073e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:18.116531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf2219-d451-4814-8a38-31b1765b1838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:18.117567 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf2219-d451-4814-8a38-31b1765b1838 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:18.118085 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf2219-d451-4814-8a38-31b1765b1838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:18.118732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf2219-d451-4814-8a38-31b1765b1838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:18.119091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf2219-d451-4814-8a38-31b1765b1838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:18.122314 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf2219-d451-4814-8a38-31b1765b1838 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:18.131533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 810/1630] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:18.136137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fc98f-4c47-4be0-88ac-24fc00e5073e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:18.144984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 821/1631] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:18.146256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf2219-d451-4814-8a38-31b1765b1838 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:18.156857 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fc98f-4c47-4be0-88ac-24fc00e5073e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:18.167179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67c5ab-2ed8-487b-9405-d2a11a09f5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:18.169276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c5ab-2ed8-487b-9405-d2a11a09f5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:18.171056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c5ab-2ed8-487b-9405-d2a11a09f5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:18.171851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c5ab-2ed8-487b-9405-d2a11a09f5a1 admin admin] PATH_INFO: `/v3/projects/40c50c577f224cbdba2a40e8d191d9a4/users/ef5b6ab062814fd197d12d7edb4fac06/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:18.172578 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf2219-d451-4814-8a38-31b1765b1838 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:18.174573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67c5ab-2ed8-487b-9405-d2a11a09f5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c50c577f224cbdba2a40e8d191d9a4, user_id=ef5b6ab062814fd197d12d7edb4fac06, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:18.181456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67c5ab-2ed8-487b-9405-d2a11a09f5a1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:18.185684 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6ae5f-f000-417c-9df5-3b9c05f9a07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:18.186704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6ae5f-f000-417c-9df5-3b9c05f9a07a admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:18.187098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6ae5f-f000-417c-9df5-3b9c05f9a07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:18.187515 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6ae5f-f000-417c-9df5-3b9c05f9a07a admin admin] PATH_INFO: `/v3/projects/f47f9ea10fe74b05baa2887a92bb2df0/users/b465777e48c545c6a5d69906f98bf415/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:18.193769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6ae5f-f000-417c-9df5-3b9c05f9a07a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47f9ea10fe74b05baa2887a92bb2df0, user_id=b465777e48c545c6a5d69906f98bf415, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:18.200496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6ae5f-f000-417c-9df5-3b9c05f9a07a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:18.211022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 811/1632] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:18 2022] PUT /identity/v3/projects/40c50c577f224cbdba2a40e8d191d9a4/users/ef5b6ab062814fd197d12d7edb4fac06/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:34:18.225397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae670673-284c-44a2-92b1-644bfdc24707 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:18.225767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae670673-284c-44a2-92b1-644bfdc24707 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:18.226147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae670673-284c-44a2-92b1-644bfdc24707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:18.233397 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 822/1633] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:18 2022] PUT /identity/v3/projects/f47f9ea10fe74b05baa2887a92bb2df0/users/b465777e48c545c6a5d69906f98bf415/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:34:18.246027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc139-a5e6-4d99-ba38-daaf20d880ef None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:18.246454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc139-a5e6-4d99-ba38-daaf20d880ef None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:18.248025 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc139-a5e6-4d99-ba38-daaf20d880ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:18.324764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ae670673-284c-44a2-92b1-644bfdc24707 None None] MFA Rules not processed for user `ef5b6ab062814fd197d12d7edb4fac06`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:18.331628 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ae670673-284c-44a2-92b1-644bfdc24707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:18.349268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-979bc139-a5e6-4d99-ba38-daaf20d880ef None None] MFA Rules not processed for user `b465777e48c545c6a5d69906f98bf415`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:18.354553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-979bc139-a5e6-4d99-ba38-daaf20d880ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:18.520164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 823/1634] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:34:18.522654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dcda1-a2d9-407d-8d90-81f1a861046f None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:18.522962 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dcda1-a2d9-407d-8d90-81f1a861046f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:18.523249 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dcda1-a2d9-407d-8d90-81f1a861046f None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:18.540326 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 824/1635] 10.222.0.67 () {54 vars in 912 bytes} [Wed Jul 27 16:34:18 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:34:18.542074 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66968619-103f-4feb-a9fe-ba6a427c965f None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:18.542370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66968619-103f-4feb-a9fe-ba6a427c965f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:18.542872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66968619-103f-4feb-a9fe-ba6a427c965f None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:18.544404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 825/1636] 10.222.0.67 () {54 vars in 912 bytes} [Wed Jul 27 16:34:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:34:18.545274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66968619-103f-4feb-a9fe-ba6a427c965f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:18.552083 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 812/1637] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:18.553470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eb5b7-962e-4aaf-9360-4925e0d781d8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:18.557884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eb5b7-962e-4aaf-9360-4925e0d781d8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:18.558277 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eb5b7-962e-4aaf-9360-4925e0d781d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:18.607664 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-be9eb5b7-962e-4aaf-9360-4925e0d781d8 None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:18.611072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-be9eb5b7-962e-4aaf-9360-4925e0d781d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:18.618563 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:18.666413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66968619-103f-4feb-a9fe-ba6a427c965f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:18.675115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265d496-a7a7-49ad-bb19-b0693f67f5af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:18.676054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265d496-a7a7-49ad-bb19-b0693f67f5af service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:18.677191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265d496-a7a7-49ad-bb19-b0693f67f5af service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:18.677191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265d496-a7a7-49ad-bb19-b0693f67f5af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:18.701925 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265d496-a7a7-49ad-bb19-b0693f67f5af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:18.707811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265d496-a7a7-49ad-bb19-b0693f67f5af service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:18.734257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 826/1638] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:18.802814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6feb08-f7c7-4abe-9930-5671b02ce9a9 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:18.802814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6feb08-f7c7-4abe-9930-5671b02ce9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:18.802814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6feb08-f7c7-4abe-9930-5671b02ce9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:18.802814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ad6feb08-f7c7-4abe-9930-5671b02ce9a9 None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:18.802814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ad6feb08-f7c7-4abe-9930-5671b02ce9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:18.853823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 813/1639] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:34:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:18.854852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9eb5b7-962e-4aaf-9360-4925e0d781d8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:18.898356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9eb5b7-962e-4aaf-9360-4925e0d781d8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:18.912983 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d23b3-7f07-4f88-bce8-1388abb0d020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:18.913660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d23b3-7f07-4f88-bce8-1388abb0d020 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:18.913952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d23b3-7f07-4f88-bce8-1388abb0d020 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:18.914237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d23b3-7f07-4f88-bce8-1388abb0d020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:18.942713 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d23b3-7f07-4f88-bce8-1388abb0d020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:18.945424 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d23b3-7f07-4f88-bce8-1388abb0d020 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:18.973242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 814/1640] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:19.001551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 827/1641] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:34:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:19.017718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d23b3-7f07-4f88-bce8-1388abb0d020 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:19.030838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d23b3-7f07-4f88-bce8-1388abb0d020 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:19.035559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33b0a1-e6c9-4de7-a0ec-c7c30ee3a0e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:19.036459 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b0a1-e6c9-4de7-a0ec-c7c30ee3a0e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:19.036847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b0a1-e6c9-4de7-a0ec-c7c30ee3a0e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:19.037240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33b0a1-e6c9-4de7-a0ec-c7c30ee3a0e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:19.052567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33b0a1-e6c9-4de7-a0ec-c7c30ee3a0e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:19.054222 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33b0a1-e6c9-4de7-a0ec-c7c30ee3a0e3 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:19.084430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 815/1642] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:19.106576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6feb08-f7c7-4abe-9930-5671b02ce9a9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:19.118620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6feb08-f7c7-4abe-9930-5671b02ce9a9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:19.125033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20514ee7-3b88-4e55-93b4-6659ae0c70b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:19.125876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514ee7-3b88-4e55-93b4-6659ae0c70b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:19.126235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514ee7-3b88-4e55-93b4-6659ae0c70b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:19.126587 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514ee7-3b88-4e55-93b4-6659ae0c70b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:19.145313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20514ee7-3b88-4e55-93b4-6659ae0c70b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:19.147564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20514ee7-3b88-4e55-93b4-6659ae0c70b8 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:19.178255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 828/1643] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:19.288127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33b0a1-e6c9-4de7-a0ec-c7c30ee3a0e3 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:19.293275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33b0a1-e6c9-4de7-a0ec-c7c30ee3a0e3 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:19.311790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a404b0f-a58d-4c0b-91ba-114360dddb0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:19.312404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a404b0f-a58d-4c0b-91ba-114360dddb0e service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:19.312696 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a404b0f-a58d-4c0b-91ba-114360dddb0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:19.312975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a404b0f-a58d-4c0b-91ba-114360dddb0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:19.325383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:19.486049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a404b0f-a58d-4c0b-91ba-114360dddb0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:19.487625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a404b0f-a58d-4c0b-91ba-114360dddb0e service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:19.521483 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 816/1644] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:20.144594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20514ee7-3b88-4e55-93b4-6659ae0c70b8 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:20.163492 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20514ee7-3b88-4e55-93b4-6659ae0c70b8 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:20.186029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24baadc-cf30-4d6d-9c9b-dbc96dd82fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:20.186703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24baadc-cf30-4d6d-9c9b-dbc96dd82fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:20.186994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24baadc-cf30-4d6d-9c9b-dbc96dd82fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:20.187279 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24baadc-cf30-4d6d-9c9b-dbc96dd82fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:20.325071 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24baadc-cf30-4d6d-9c9b-dbc96dd82fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:20.326688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24baadc-cf30-4d6d-9c9b-dbc96dd82fe2 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:20.368137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 829/1645] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:20.469607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a404b0f-a58d-4c0b-91ba-114360dddb0e service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:20.650574 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a404b0f-a58d-4c0b-91ba-114360dddb0e service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:20.655595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:20.657241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:20.657241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:20.657576 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] PATH_INFO: `/v3/users/40bb2fee6b2f4e0a9061774ea6eb2e2e` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:20.660086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=40bb2fee6b2f4e0a9061774ea6eb2e2e)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:20.662623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:20.785393 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40bb2fee6b2f4e0a9061774ea6eb2e2e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:20.797485 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40bb2fee6b2f4e0a9061774ea6eb2e2e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:20.811066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40bb2fee6b2f4e0a9061774ea6eb2e2e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:20.811751 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40bb2fee6b2f4e0a9061774ea6eb2e2e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:20.812498 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40bb2fee6b2f4e0a9061774ea6eb2e2e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:20.863575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 817/1646] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:34:20 2022] DELETE /identity/v3/users/40bb2fee6b2f4e0a9061774ea6eb2e2e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:20.868523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858d1fe-5ca9-4f90-be6f-43a1693bc34c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:20.868816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858d1fe-5ca9-4f90-be6f-43a1693bc34c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:20.869098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858d1fe-5ca9-4f90-be6f-43a1693bc34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:20.912591 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6858d1fe-5ca9-4f90-be6f-43a1693bc34c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:20.916461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6858d1fe-5ca9-4f90-be6f-43a1693bc34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:21.024614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:21.045756 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 830/1647] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:21.070716 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:21.073121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:21.116807 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:21.205874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772638-c89c-458b-8cf1-6c50a4219e4f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:21.215706 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090ba32-2ce8-4cfb-8d3c-dc6249b8afd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:21.216830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090ba32-2ce8-4cfb-8d3c-dc6249b8afd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:21.217359 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090ba32-2ce8-4cfb-8d3c-dc6249b8afd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:21.217773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090ba32-2ce8-4cfb-8d3c-dc6249b8afd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:21.243822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090ba32-2ce8-4cfb-8d3c-dc6249b8afd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:21.245863 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090ba32-2ce8-4cfb-8d3c-dc6249b8afd2 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:21.269582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 818/1648] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:21.950932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858d1fe-5ca9-4f90-be6f-43a1693bc34c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:21.952953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6858d1fe-5ca9-4f90-be6f-43a1693bc34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:21.985789 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858d1fe-5ca9-4f90-be6f-43a1693bc34c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:21.997845 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d81591-5fde-484e-bef6-4b3778cad04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:21.999958 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d81591-5fde-484e-bef6-4b3778cad04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:22.000426 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d81591-5fde-484e-bef6-4b3778cad04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:22.002621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d81591-5fde-484e-bef6-4b3778cad04d admin admin] PATH_INFO: `/v3/projects/ba7f2eed42834bc7bb2c17851e7dca8c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:22.006709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d81591-5fde-484e-bef6-4b3778cad04d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba7f2eed42834bc7bb2c17851e7dca8c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:22.014302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d81591-5fde-484e-bef6-4b3778cad04d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:22.132192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9d81591-5fde-484e-bef6-4b3778cad04d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba7f2eed42834bc7bb2c17851e7dca8c', 'request_id': 'req-f9d81591-5fde-484e-bef6-4b3778cad04d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:22.141419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9d81591-5fde-484e-bef6-4b3778cad04d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba7f2eed42834bc7bb2c17851e7dca8c', 'request_id': 'req-f9d81591-5fde-484e-bef6-4b3778cad04d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:22.151191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9d81591-5fde-484e-bef6-4b3778cad04d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba7f2eed42834bc7bb2c17851e7dca8c', 'request_id': 'req-f9d81591-5fde-484e-bef6-4b3778cad04d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:22.179529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9d81591-5fde-484e-bef6-4b3778cad04d admin admin] The token cache is being invalidate because project ba7f2eed42834bc7bb2c17851e7dca8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:34:22.179889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9d81591-5fde-484e-bef6-4b3778cad04d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:22.182701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9d81591-5fde-484e-bef6-4b3778cad04d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:22.192948 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 831/1649] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:34:21 2022] DELETE /identity/v3/projects/ba7f2eed42834bc7bb2c17851e7dca8c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:22.194879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47873-c82c-49d0-ac2c-df4255e6ed99 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:22.195387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47873-c82c-49d0-ac2c-df4255e6ed99 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:22.196562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47873-c82c-49d0-ac2c-df4255e6ed99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:22.251577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2de47873-c82c-49d0-ac2c-df4255e6ed99 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:22.257003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2de47873-c82c-49d0-ac2c-df4255e6ed99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:22.409100 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 819/1650] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:22.417838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329150b7-1306-478a-909a-a35d53ebf9b1 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:22.417966 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329150b7-1306-478a-909a-a35d53ebf9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:22.418199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329150b7-1306-478a-909a-a35d53ebf9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:22.478329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-329150b7-1306-478a-909a-a35d53ebf9b1 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:22.481773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-329150b7-1306-478a-909a-a35d53ebf9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:22.521189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 832/1651] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:22.534346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de47873-c82c-49d0-ac2c-df4255e6ed99 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:22.564864 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de47873-c82c-49d0-ac2c-df4255e6ed99 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:22.588644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd67eb-3249-4836-9c98-bb1c5cb5bee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:22.589305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd67eb-3249-4836-9c98-bb1c5cb5bee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:22.589819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd67eb-3249-4836-9c98-bb1c5cb5bee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:22.589918 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd67eb-3249-4836-9c98-bb1c5cb5bee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:22.596508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd67eb-3249-4836-9c98-bb1c5cb5bee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:34:22.596892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd67eb-3249-4836-9c98-bb1c5cb5bee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:22.607818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd67eb-3249-4836-9c98-bb1c5cb5bee9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:22.669183 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329150b7-1306-478a-909a-a35d53ebf9b1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:22.682157 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 820/1652] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:34:22.687342 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329150b7-1306-478a-909a-a35d53ebf9b1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:22.707261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df173b8-2f5d-47a7-a3d0-3b88074f9f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:22.708133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df173b8-2f5d-47a7-a3d0-3b88074f9f39 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:22.708442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df173b8-2f5d-47a7-a3d0-3b88074f9f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:22.708694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df173b8-2f5d-47a7-a3d0-3b88074f9f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:22.709440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df173b8-2f5d-47a7-a3d0-3b88074f9f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:22.715840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df173b8-2f5d-47a7-a3d0-3b88074f9f39 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:22.805135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 833/1653] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:22 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:22.809826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd67eb-3249-4836-9c98-bb1c5cb5bee9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:22.825077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd67eb-3249-4836-9c98-bb1c5cb5bee9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:23.025633 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab94a1-eb20-4e52-852b-c9c8d32de4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:23.027012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab94a1-eb20-4e52-852b-c9c8d32de4ba admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:23.027300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab94a1-eb20-4e52-852b-c9c8d32de4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:23.027571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab94a1-eb20-4e52-852b-c9c8d32de4ba admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:23.028339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab94a1-eb20-4e52-852b-c9c8d32de4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:23.030475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab94a1-eb20-4e52-852b-c9c8d32de4ba admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:23.071606 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 821/1654] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:22 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:34:23.077660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df173b8-2f5d-47a7-a3d0-3b88074f9f39 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:23.090186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df173b8-2f5d-47a7-a3d0-3b88074f9f39 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:23.106109 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc2c4c-ab4d-404e-a532-5da669e25323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:23.106966 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc2c4c-ab4d-404e-a532-5da669e25323 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:23.107388 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc2c4c-ab4d-404e-a532-5da669e25323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:23.107791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc2c4c-ab4d-404e-a532-5da669e25323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:23.108676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc2c4c-ab4d-404e-a532-5da669e25323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:23.112335 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc2c4c-ab4d-404e-a532-5da669e25323 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:23.136136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 834/1655] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:23.137804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab94a1-eb20-4e52-852b-c9c8d32de4ba admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:23.153181 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab94a1-eb20-4e52-852b-c9c8d32de4ba admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:23.168586 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a619995-ee4d-44db-b7ef-d3b64e2a6236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:23.169223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a619995-ee4d-44db-b7ef-d3b64e2a6236 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:23.171948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a619995-ee4d-44db-b7ef-d3b64e2a6236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:23.174035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a619995-ee4d-44db-b7ef-d3b64e2a6236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:23.174816 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a619995-ee4d-44db-b7ef-d3b64e2a6236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:23.186319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a619995-ee4d-44db-b7ef-d3b64e2a6236 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:23.222814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 822/1656] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:23.224981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc2c4c-ab4d-404e-a532-5da669e25323 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:23.241809 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc2c4c-ab4d-404e-a532-5da669e25323 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:23.255086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6ac80-547e-4446-8fb0-d6516d75c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:23.258129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6ac80-547e-4446-8fb0-d6516d75c865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:23.258129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6ac80-547e-4446-8fb0-d6516d75c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:23.258364 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6ac80-547e-4446-8fb0-d6516d75c865 admin admin] PATH_INFO: `/v3/projects/acec95eaa42f4718a2d58cf79bb06046/users/a61a4a96f3b346ad8589504cb6a0edf3/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:23.299398 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6ac80-547e-4446-8fb0-d6516d75c865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acec95eaa42f4718a2d58cf79bb06046, user_id=a61a4a96f3b346ad8589504cb6a0edf3, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:23.304089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6ac80-547e-4446-8fb0-d6516d75c865 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:23.345462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 835/1657] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:23 2022] PUT /identity/v3/projects/acec95eaa42f4718a2d58cf79bb06046/users/a61a4a96f3b346ad8589504cb6a0edf3/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:23.359219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe562b-8a1e-47c2-b1ae-bf67e6ad649d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:23.359846 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe562b-8a1e-47c2-b1ae-bf67e6ad649d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:23.360158 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe562b-8a1e-47c2-b1ae-bf67e6ad649d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:23.425968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a4fe562b-8a1e-47c2-b1ae-bf67e6ad649d None None] MFA Rules not processed for user `a61a4a96f3b346ad8589504cb6a0edf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:23.427244 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a4fe562b-8a1e-47c2-b1ae-bf67e6ad649d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:23.479680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:23.618909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 823/1658] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:23.620284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6ac80-547e-4446-8fb0-d6516d75c865 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:23.799895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6ac80-547e-4446-8fb0-d6516d75c865 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:23.818632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fac04-6990-41c6-9c9b-2abc8fd735ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:23.819448 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fac04-6990-41c6-9c9b-2abc8fd735ee admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:23.819839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fac04-6990-41c6-9c9b-2abc8fd735ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:23.820262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fac04-6990-41c6-9c9b-2abc8fd735ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:23.821096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fac04-6990-41c6-9c9b-2abc8fd735ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:23.823153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fac04-6990-41c6-9c9b-2abc8fd735ee admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:23.893435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:23.906402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe562b-8a1e-47c2-b1ae-bf67e6ad649d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:23.907553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 836/1659] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:23 2022] POST /identity/v3/projects => generated 381 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:23.929814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe562b-8a1e-47c2-b1ae-bf67e6ad649d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:24.167852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ca23d-9118-408b-89d5-ab7920b61c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:24.168601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca23d-9118-408b-89d5-ab7920b61c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:24.168891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca23d-9118-408b-89d5-ab7920b61c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:24.177650 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca23d-9118-408b-89d5-ab7920b61c51 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:24.178530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ca23d-9118-408b-89d5-ab7920b61c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:24.183315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ca23d-9118-408b-89d5-ab7920b61c51 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:24.299841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 824/1660] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:23 2022] POST /identity/v3/users => generated 297 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:24.302857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fac04-6990-41c6-9c9b-2abc8fd735ee admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:24.329667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fac04-6990-41c6-9c9b-2abc8fd735ee admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:24.342885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389625f-54ad-4025-b713-7e48b81eeee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:24.354349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389625f-54ad-4025-b713-7e48b81eeee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:24.382789 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389625f-54ad-4025-b713-7e48b81eeee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:24.388348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389625f-54ad-4025-b713-7e48b81eeee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:24.391077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389625f-54ad-4025-b713-7e48b81eeee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:24.397932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389625f-54ad-4025-b713-7e48b81eeee1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:24.463256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ca23d-9118-408b-89d5-ab7920b61c51 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:24.463472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 837/1661] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:24.479600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ca23d-9118-408b-89d5-ab7920b61c51 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:24.503320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affe27a-ad61-4878-867d-a2d66d474c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:24.504154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affe27a-ad61-4878-867d-a2d66d474c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:24.504624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affe27a-ad61-4878-867d-a2d66d474c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:24.505050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affe27a-ad61-4878-867d-a2d66d474c97 admin admin] PATH_INFO: `/v3/projects/25707970c6a14864a65a9ea0ac9afded/users/81fc72afc6814315bd73b3895cbb9580/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:24.537774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affe27a-ad61-4878-867d-a2d66d474c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25707970c6a14864a65a9ea0ac9afded, user_id=81fc72afc6814315bd73b3895cbb9580, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:24.543845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affe27a-ad61-4878-867d-a2d66d474c97 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:24.580676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389625f-54ad-4025-b713-7e48b81eeee1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:24.591617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 825/1662] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:24 2022] PUT /identity/v3/projects/25707970c6a14864a65a9ea0ac9afded/users/81fc72afc6814315bd73b3895cbb9580/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:34:24.595555 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389625f-54ad-4025-b713-7e48b81eeee1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:24.842269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c5693-130c-4cc8-bf58-f52f10e5a70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:24.845879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c5693-130c-4cc8-bf58-f52f10e5a70b admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:24.846655 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c5693-130c-4cc8-bf58-f52f10e5a70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:24.847336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c5693-130c-4cc8-bf58-f52f10e5a70b admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:24.849691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c5693-130c-4cc8-bf58-f52f10e5a70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:24.858617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c5693-130c-4cc8-bf58-f52f10e5a70b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:24.905928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 838/1663] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:24.910149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affe27a-ad61-4878-867d-a2d66d474c97 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:24.932025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affe27a-ad61-4878-867d-a2d66d474c97 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:24.950507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005c03-7d87-4b92-b33d-4bcf1e2b6ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:24.951356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005c03-7d87-4b92-b33d-4bcf1e2b6ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:24.951646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005c03-7d87-4b92-b33d-4bcf1e2b6ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:24.951968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005c03-7d87-4b92-b33d-4bcf1e2b6ac0 admin admin] PATH_INFO: `/v3/projects/25707970c6a14864a65a9ea0ac9afded/users/81fc72afc6814315bd73b3895cbb9580/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:24.955541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84005c03-7d87-4b92-b33d-4bcf1e2b6ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25707970c6a14864a65a9ea0ac9afded, user_id=81fc72afc6814315bd73b3895cbb9580, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:24.964751 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84005c03-7d87-4b92-b33d-4bcf1e2b6ac0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:25.010385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 826/1664] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:24 2022] PUT /identity/v3/projects/25707970c6a14864a65a9ea0ac9afded/users/81fc72afc6814315bd73b3895cbb9580/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:25.014293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c3ac6-9440-486a-94c2-6a001733b50a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:25.014938 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c3ac6-9440-486a-94c2-6a001733b50a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:25.015931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c3ac6-9440-486a-94c2-6a001733b50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:25.142976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-735c3ac6-9440-486a-94c2-6a001733b50a None None] MFA Rules not processed for user `81fc72afc6814315bd73b3895cbb9580`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:25.146312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-735c3ac6-9440-486a-94c2-6a001733b50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:25.367508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 839/1665] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:25.609880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005c03-7d87-4b92-b33d-4bcf1e2b6ac0 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:25.612480 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-84005c03-7d87-4b92-b33d-4bcf1e2b6ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:25.856547 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005c03-7d87-4b92-b33d-4bcf1e2b6ac0 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:25.888718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd54c9-300f-4dc7-9ecf-0f21b1f2d732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:25.889627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd54c9-300f-4dc7-9ecf-0f21b1f2d732 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:25.889930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd54c9-300f-4dc7-9ecf-0f21b1f2d732 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:25.890211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd54c9-300f-4dc7-9ecf-0f21b1f2d732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:25.921432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd54c9-300f-4dc7-9ecf-0f21b1f2d732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:25.922887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd54c9-300f-4dc7-9ecf-0f21b1f2d732 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:25.960651 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 827/1666] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:26.288734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c3ac6-9440-486a-94c2-6a001733b50a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:26.291176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-735c3ac6-9440-486a-94c2-6a001733b50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:26.306098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c3ac6-9440-486a-94c2-6a001733b50a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:26.310761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ebfae-df8b-43e8-98f1-4402b7344505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:26.311666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ebfae-df8b-43e8-98f1-4402b7344505 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:26.312374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ebfae-df8b-43e8-98f1-4402b7344505 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:26.312838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ebfae-df8b-43e8-98f1-4402b7344505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:26.445490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ebfae-df8b-43e8-98f1-4402b7344505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:26.448084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ebfae-df8b-43e8-98f1-4402b7344505 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:26.470418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 840/1667] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:27.283291 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd54c9-300f-4dc7-9ecf-0f21b1f2d732 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:27.284449 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a7cd54c9-300f-4dc7-9ecf-0f21b1f2d732 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:27.359965 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:27.544126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd54c9-300f-4dc7-9ecf-0f21b1f2d732 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:27.562014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:27.564979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:27.565368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:27.565755 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] PATH_INFO: `/v3/users/376b06b82be64da3b0bd2a26738b92e9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:27.569950 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] RBAC: Authorizing `identity:delete_user(user_id=376b06b82be64da3b0bd2a26738b92e9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:27.577793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:27.741836 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376b06b82be64da3b0bd2a26738b92e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:27.760518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376b06b82be64da3b0bd2a26738b92e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:27.775151 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376b06b82be64da3b0bd2a26738b92e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:27.776000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376b06b82be64da3b0bd2a26738b92e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:27.776714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376b06b82be64da3b0bd2a26738b92e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:27.841115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d7a2-d4d6-4a76-9f20-08f9cd0eea38 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:27.841571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d7a2-d4d6-4a76-9f20-08f9cd0eea38 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:27.841958 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d7a2-d4d6-4a76-9f20-08f9cd0eea38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:27.843938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 828/1668] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:34:27 2022] DELETE /identity/v3/users/376b06b82be64da3b0bd2a26738b92e9 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:27.893005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-57e4d7a2-d4d6-4a76-9f20-08f9cd0eea38 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:27.896603 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-57e4d7a2-d4d6-4a76-9f20-08f9cd0eea38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:27.905967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:28.131340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 841/1669] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:34:28.200362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:28.202827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:28.342557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d53bef-c98c-4cbc-a525-87b1881cb1be admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:28.354216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f52bb4-968f-46c7-8b93-2804b281db46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:28.355472 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f52bb4-968f-46c7-8b93-2804b281db46 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:28.355993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f52bb4-968f-46c7-8b93-2804b281db46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:28.356472 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f52bb4-968f-46c7-8b93-2804b281db46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:28.378621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f52bb4-968f-46c7-8b93-2804b281db46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:28.381213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f52bb4-968f-46c7-8b93-2804b281db46 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:28.408151 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 829/1670] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:29.435199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b16d8f-9376-4498-861d-5a0600add7e9 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:29.435756 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b16d8f-9376-4498-861d-5a0600add7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:29.435835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b16d8f-9376-4498-861d-5a0600add7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:29.493569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d2b16d8f-9376-4498-861d-5a0600add7e9 None None] MFA Rules not processed for user `bc75a052c6b14904a314cf8f7bd4bad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:29.495121 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d2b16d8f-9376-4498-861d-5a0600add7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:29.658425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 842/1671] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:29.673684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f52bb4-968f-46c7-8b93-2804b281db46 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:29.675930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f8f52bb4-968f-46c7-8b93-2804b281db46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:29.838801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:29.940923 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f52bb4-968f-46c7-8b93-2804b281db46 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:29.949226 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408f06c-682c-448c-9cb5-3a5e41f88f5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:29.950270 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408f06c-682c-448c-9cb5-3a5e41f88f5d service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:29.950759 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408f06c-682c-448c-9cb5-3a5e41f88f5d service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:29.952798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408f06c-682c-448c-9cb5-3a5e41f88f5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:29.974397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408f06c-682c-448c-9cb5-3a5e41f88f5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:29.977388 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408f06c-682c-448c-9cb5-3a5e41f88f5d service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:30.005901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 830/1672] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:34:30.415991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1b875-5d24-43f8-aa10-5c2b0a6f3aa0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:30.416388 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1b875-5d24-43f8-aa10-5c2b0a6f3aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:30.416552 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1b875-5d24-43f8-aa10-5c2b0a6f3aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:30.459305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408f06c-682c-448c-9cb5-3a5e41f88f5d service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:30.461305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f408f06c-682c-448c-9cb5-3a5e41f88f5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:30.509705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408f06c-682c-448c-9cb5-3a5e41f88f5d service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:30.526232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f0b1b875-5d24-43f8-aa10-5c2b0a6f3aa0 None None] MFA Rules not processed for user `32a5063a78064508ad01165199bd60fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:30.537772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:30.539552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:30.541584 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:30.543523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f0b1b875-5d24-43f8-aa10-5c2b0a6f3aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:30.543952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3 admin admin] PATH_INFO: `/v3/projects/005f77adea3943dfbd58d92ae65e0a12` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:30.546719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=005f77adea3943dfbd58d92ae65e0a12)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:30.548754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: WARNING py.warnings [None req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:34:30.548754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: warnings.warn(msg) Jul 27 16:34:30.548754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: Jul 27 16:34:30.550121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:30.729862 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 843/1673] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:30.744755 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c1bf1-2877-4fc8-8d1e-2aa7f2c66c01 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:30.747129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c1bf1-2877-4fc8-8d1e-2aa7f2c66c01 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:30.747129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c1bf1-2877-4fc8-8d1e-2aa7f2c66c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:30.794921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '005f77adea3943dfbd58d92ae65e0a12', 'request_id': 'req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:30.826361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '005f77adea3943dfbd58d92ae65e0a12', 'request_id': 'req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:30.846464 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ce4c1bf1-2877-4fc8-8d1e-2aa7f2c66c01 None None] MFA Rules not processed for user `32a5063a78064508ad01165199bd60fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:30.847714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ce4c1bf1-2877-4fc8-8d1e-2aa7f2c66c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:30.864005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '005f77adea3943dfbd58d92ae65e0a12', 'request_id': 'req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:30.890507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3 admin admin] The token cache is being invalidate because project 005f77adea3943dfbd58d92ae65e0a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:34:30.891518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:30.892899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8eb62e6c-fc82-41bb-a4b8-6525c71000d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:30.899546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 831/1674] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:34:30 2022] DELETE /identity/v3/projects/005f77adea3943dfbd58d92ae65e0a12 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:30.904973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00098500-6e70-466d-b141-8774cde1d522 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:30.905535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00098500-6e70-466d-b141-8774cde1d522 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:30.906056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00098500-6e70-466d-b141-8774cde1d522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:30.907018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:30.947895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-00098500-6e70-466d-b141-8774cde1d522 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:30.949933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-00098500-6e70-466d-b141-8774cde1d522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:30.977407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 844/1675] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:30.991480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c1bf1-2877-4fc8-8d1e-2aa7f2c66c01 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:30.994453 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ce4c1bf1-2877-4fc8-8d1e-2aa7f2c66c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:31.161432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c1bf1-2877-4fc8-8d1e-2aa7f2c66c01 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:31.187749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 832/1676] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:34:31.193936 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb329f8d-f449-464c-ac5e-2a070cf39fd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:31.194759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb329f8d-f449-464c-ac5e-2a070cf39fd3 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:31.195052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb329f8d-f449-464c-ac5e-2a070cf39fd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:31.195341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb329f8d-f449-464c-ac5e-2a070cf39fd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:31.199685 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553238b1-ba71-477a-aba4-1a4e417e1078 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:31.200186 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553238b1-ba71-477a-aba4-1a4e417e1078 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:31.200630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553238b1-ba71-477a-aba4-1a4e417e1078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:31.208043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fb329f8d-f449-464c-ac5e-2a070cf39fd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:31.243806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb329f8d-f449-464c-ac5e-2a070cf39fd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:31.245491 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb329f8d-f449-464c-ac5e-2a070cf39fd3 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:31.256884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-553238b1-ba71-477a-aba4-1a4e417e1078 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:31.258927 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-553238b1-ba71-477a-aba4-1a4e417e1078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:31.287579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 833/1677] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:31.291762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553238b1-ba71-477a-aba4-1a4e417e1078 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:31.292317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 845/1678] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:31.318763 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553238b1-ba71-477a-aba4-1a4e417e1078 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:31.357435 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3bae-1bf4-42c2-a8e2-330ae5b9223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:31.358069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3bae-1bf4-42c2-a8e2-330ae5b9223e admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:31.358364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3bae-1bf4-42c2-a8e2-330ae5b9223e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:31.358643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3bae-1bf4-42c2-a8e2-330ae5b9223e admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:31.359358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3bae-1bf4-42c2-a8e2-330ae5b9223e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:34:31.368323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3bae-1bf4-42c2-a8e2-330ae5b9223e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:31.370202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3bae-1bf4-42c2-a8e2-330ae5b9223e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:31.400894 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb329f8d-f449-464c-ac5e-2a070cf39fd3 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:31.402410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fb329f8d-f449-464c-ac5e-2a070cf39fd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:31.426280 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb329f8d-f449-464c-ac5e-2a070cf39fd3 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:31.434888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 834/1679] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:34:31.435817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3bae-1bf4-42c2-a8e2-330ae5b9223e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:31.453550 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6ccdb-91ff-4f65-ab72-f77d0aec474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:31.454217 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6ccdb-91ff-4f65-ab72-f77d0aec474c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:31.454502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6ccdb-91ff-4f65-ab72-f77d0aec474c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:31.454790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6ccdb-91ff-4f65-ab72-f77d0aec474c admin admin] PATH_INFO: `/v3/users/ae3b0b860f7848c7a4013421ec87ffb4` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:31.457280 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6ccdb-91ff-4f65-ab72-f77d0aec474c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3b0b860f7848c7a4013421ec87ffb4)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:31.458329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: WARNING py.warnings [None req-f9d6ccdb-91ff-4f65-ab72-f77d0aec474c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 16:34:31.458329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: warnings.warn(msg) Jul 27 16:34:31.458329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: Jul 27 16:34:31.459698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6ccdb-91ff-4f65-ab72-f77d0aec474c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:31.472829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3bae-1bf4-42c2-a8e2-330ae5b9223e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:31.490761 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6774e3-47d7-4de9-89b6-b04ba21c471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:31.491976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6774e3-47d7-4de9-89b6-b04ba21c471e admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:31.491976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6774e3-47d7-4de9-89b6-b04ba21c471e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:31.491976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6774e3-47d7-4de9-89b6-b04ba21c471e admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:31.492693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6774e3-47d7-4de9-89b6-b04ba21c471e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:31.495109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6774e3-47d7-4de9-89b6-b04ba21c471e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:31.558660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 835/1680] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:31 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:31.559673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6774e3-47d7-4de9-89b6-b04ba21c471e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:31.586576 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:31.628234 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9d6ccdb-91ff-4f65-ab72-f77d0aec474c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3b0b860f7848c7a4013421ec87ffb4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:31.643471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9d6ccdb-91ff-4f65-ab72-f77d0aec474c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3b0b860f7848c7a4013421ec87ffb4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:31.675980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9d6ccdb-91ff-4f65-ab72-f77d0aec474c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3b0b860f7848c7a4013421ec87ffb4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:31.677531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9d6ccdb-91ff-4f65-ab72-f77d0aec474c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3b0b860f7848c7a4013421ec87ffb4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:31.679659 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f9d6ccdb-91ff-4f65-ab72-f77d0aec474c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3b0b860f7848c7a4013421ec87ffb4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:31.740243 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6774e3-47d7-4de9-89b6-b04ba21c471e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:31.745889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 846/1681] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:34:31 2022] DELETE /identity/v3/users/ae3b0b860f7848c7a4013421ec87ffb4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:34:31.749992 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dbf6c-0122-4efb-9fd1-d7e80461bff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:31.750840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dbf6c-0122-4efb-9fd1-d7e80461bff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:31.751281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dbf6c-0122-4efb-9fd1-d7e80461bff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:31.751712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dbf6c-0122-4efb-9fd1-d7e80461bff5 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:31.752764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dbf6c-0122-4efb-9fd1-d7e80461bff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:31.754811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862871d-10b8-4f5a-a4c0-97d1256c759e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:31.755448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dbf6c-0122-4efb-9fd1-d7e80461bff5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:31.757112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862871d-10b8-4f5a-a4c0-97d1256c759e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:31.757502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862871d-10b8-4f5a-a4c0-97d1256c759e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:31.789024 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 836/1682] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:31 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:31.800449 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dbf6c-0122-4efb-9fd1-d7e80461bff5 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:31.803698 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1c6dbf6c-0122-4efb-9fd1-d7e80461bff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:31.806503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2862871d-10b8-4f5a-a4c0-97d1256c759e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:31.807920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2862871d-10b8-4f5a-a4c0-97d1256c759e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:31.839691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:31.861954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dbf6c-0122-4efb-9fd1-d7e80461bff5 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:31.951253 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 847/1683] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:32.040455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862871d-10b8-4f5a-a4c0-97d1256c759e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:32.043579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2862871d-10b8-4f5a-a4c0-97d1256c759e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:32.096907 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626907b-5e99-4df7-b9c4-2f193caef7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:32.097568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626907b-5e99-4df7-b9c4-2f193caef7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:32.097858 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626907b-5e99-4df7-b9c4-2f193caef7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:32.098139 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626907b-5e99-4df7-b9c4-2f193caef7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:32.099410 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626907b-5e99-4df7-b9c4-2f193caef7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:32.101135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626907b-5e99-4df7-b9c4-2f193caef7b2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:32.131639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 837/1684] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:32.139211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626907b-5e99-4df7-b9c4-2f193caef7b2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:32.179241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626907b-5e99-4df7-b9c4-2f193caef7b2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:32.194215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec2a28-d968-48ed-bee6-978df700aed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:32.197086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec2a28-d968-48ed-bee6-978df700aed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:32.197398 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec2a28-d968-48ed-bee6-978df700aed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:32.197679 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec2a28-d968-48ed-bee6-978df700aed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:32.199637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec2a28-d968-48ed-bee6-978df700aed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:32.234372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec2a28-d968-48ed-bee6-978df700aed3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:32.275410 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 838/1685] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:32.275410 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3868d-0444-4a7b-b5a8-2783e85a15cd None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:32.275410 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3868d-0444-4a7b-b5a8-2783e85a15cd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:32.275410 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3868d-0444-4a7b-b5a8-2783e85a15cd None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:32.288065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 839/1686] 10.222.0.67 () {54 vars in 912 bytes} [Wed Jul 27 16:34:32 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:34:32.289119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3868d-0444-4a7b-b5a8-2783e85a15cd None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:32.291440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862871d-10b8-4f5a-a4c0-97d1256c759e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:32.302541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a0f8f-a9ea-4c77-828e-5b87ff5d5d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:32.303193 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a0f8f-a9ea-4c77-828e-5b87ff5d5d03 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:32.303479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a0f8f-a9ea-4c77-828e-5b87ff5d5d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:32.303759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a0f8f-a9ea-4c77-828e-5b87ff5d5d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:32.346050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3868d-0444-4a7b-b5a8-2783e85a15cd None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:32.355844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a0f8f-a9ea-4c77-828e-5b87ff5d5d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:32.360723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e969e1-c211-4365-af60-567dc963f660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:32.361623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e969e1-c211-4365-af60-567dc963f660 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:32.361963 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e969e1-c211-4365-af60-567dc963f660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:32.362246 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e969e1-c211-4365-af60-567dc963f660 admin admin] PATH_INFO: `/v3/projects/e2cc505748684ee68e04124d8ba0e4b4/users/7c0d4a9d945d402f9ffaf63bb3ea9ab9/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:32.367306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a0f8f-a9ea-4c77-828e-5b87ff5d5d03 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:32.413080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 848/1687] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:34:32.419150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5598-6d0b-4a73-846b-62ee4f4d6b9e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:32.419704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5598-6d0b-4a73-846b-62ee4f4d6b9e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:32.420218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5598-6d0b-4a73-846b-62ee4f4d6b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:32.420332 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e969e1-c211-4365-af60-567dc963f660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2cc505748684ee68e04124d8ba0e4b4, user_id=7c0d4a9d945d402f9ffaf63bb3ea9ab9, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:32.422899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e969e1-c211-4365-af60-567dc963f660 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:32.478232 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 840/1688] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:32 2022] PUT /identity/v3/projects/e2cc505748684ee68e04124d8ba0e4b4/users/7c0d4a9d945d402f9ffaf63bb3ea9ab9/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:32.485948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69513c-88ae-4dad-a798-37e4207060df None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:32.486316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69513c-88ae-4dad-a798-37e4207060df None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:32.486603 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69513c-88ae-4dad-a798-37e4207060df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:32.538970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-34db5598-6d0b-4a73-846b-62ee4f4d6b9e None None] MFA Rules not processed for user `73325bdd109749ad92a66e600fd61a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:32.540296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-34db5598-6d0b-4a73-846b-62ee4f4d6b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:32.628092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-8d69513c-88ae-4dad-a798-37e4207060df None None] MFA Rules not processed for user `7c0d4a9d945d402f9ffaf63bb3ea9ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:32.629349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8d69513c-88ae-4dad-a798-37e4207060df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:32.777542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 849/1689] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:32.778930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3afde-888f-4751-948c-33369e727cdd None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:32.779229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3afde-888f-4751-948c-33369e727cdd None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:32.779511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3afde-888f-4751-948c-33369e727cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:32.793761 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:32.866674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 841/1690] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:32.869510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69513c-88ae-4dad-a798-37e4207060df None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:32.874196 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8d69513c-88ae-4dad-a798-37e4207060df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:32.884985 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0ce3afde-888f-4751-948c-33369e727cdd None None] MFA Rules not processed for user `ec8c8a0717a5437b99cf55cead181390`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:32.896633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0ce3afde-888f-4751-948c-33369e727cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:32.908337 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69513c-88ae-4dad-a798-37e4207060df None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:32.919335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0da32-ccd7-4f3d-9a64-e11ad3dd99b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:32.925217 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0da32-ccd7-4f3d-9a64-e11ad3dd99b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:32.926855 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0da32-ccd7-4f3d-9a64-e11ad3dd99b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:32.935044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0da32-ccd7-4f3d-9a64-e11ad3dd99b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:32.951076 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0da32-ccd7-4f3d-9a64-e11ad3dd99b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:32.952945 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0da32-ccd7-4f3d-9a64-e11ad3dd99b2 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:32.970755 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 842/1691] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:32.971821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0da32-ccd7-4f3d-9a64-e11ad3dd99b2 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:33.118902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:33.129988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 850/1692] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:33.142295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba97a2-b01a-4db5-88a4-48fe8ba8acf7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:33.142601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba97a2-b01a-4db5-88a4-48fe8ba8acf7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:33.142871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba97a2-b01a-4db5-88a4-48fe8ba8acf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:33.183585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-31ba97a2-b01a-4db5-88a4-48fe8ba8acf7 None None] MFA Rules not processed for user `ec8c8a0717a5437b99cf55cead181390`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:33.185960 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-31ba97a2-b01a-4db5-88a4-48fe8ba8acf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:33.206363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 851/1693] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:33.215509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0da32-ccd7-4f3d-9a64-e11ad3dd99b2 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:33.217957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba97a2-b01a-4db5-88a4-48fe8ba8acf7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:33.219405 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-31ba97a2-b01a-4db5-88a4-48fe8ba8acf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:33.233088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d541f-08bc-479a-8511-8924c96a1bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:33.233734 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d541f-08bc-479a-8511-8924c96a1bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:33.234018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d541f-08bc-479a-8511-8924c96a1bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:33.234467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d541f-08bc-479a-8511-8924c96a1bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:33.235551 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d541f-08bc-479a-8511-8924c96a1bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:33.237655 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d541f-08bc-479a-8511-8924c96a1bb0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:33.331527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 843/1694] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:32 2022] POST /identity/v3/projects => generated 373 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:33.332860 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d541f-08bc-479a-8511-8924c96a1bb0 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:33.489462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba97a2-b01a-4db5-88a4-48fe8ba8acf7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:33.577307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d541f-08bc-479a-8511-8924c96a1bb0 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:33.593606 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41d865-5744-4b52-8201-6e9e3342e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:33.594265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41d865-5744-4b52-8201-6e9e3342e2fc admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:33.597547 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41d865-5744-4b52-8201-6e9e3342e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:33.599553 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41d865-5744-4b52-8201-6e9e3342e2fc admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:33.601181 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41d865-5744-4b52-8201-6e9e3342e2fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:33.608296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41d865-5744-4b52-8201-6e9e3342e2fc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:33.681702 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 844/1695] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:33 2022] POST /identity/v3/users => generated 293 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:33.683079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41d865-5744-4b52-8201-6e9e3342e2fc admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:33.694865 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b535d6-02b1-4c0f-8a16-b1d4dcff62ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:33.695607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b535d6-02b1-4c0f-8a16-b1d4dcff62ce service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:33.696061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b535d6-02b1-4c0f-8a16-b1d4dcff62ce service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:33.696387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b535d6-02b1-4c0f-8a16-b1d4dcff62ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:33.712544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41d865-5744-4b52-8201-6e9e3342e2fc admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:33.737248 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9207aec-30fc-4743-8768-95aec351ab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:33.738220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9207aec-30fc-4743-8768-95aec351ab6d admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:33.738663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9207aec-30fc-4743-8768-95aec351ab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:33.739096 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9207aec-30fc-4743-8768-95aec351ab6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:33.740795 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9207aec-30fc-4743-8768-95aec351ab6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:33.744544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9207aec-30fc-4743-8768-95aec351ab6d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:33.768429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 845/1696] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:33.770361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9207aec-30fc-4743-8768-95aec351ab6d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:33.772714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c9207aec-30fc-4743-8768-95aec351ab6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:33.791094 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9207aec-30fc-4743-8768-95aec351ab6d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:33.809602 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:33.816224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:33.816572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:33.816861 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] PATH_INFO: `/v3/projects/544139e55ba940ecb52f43258ef596b2` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:33.823302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=544139e55ba940ecb52f43258ef596b2)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:33.825485 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:33.860526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b535d6-02b1-4c0f-8a16-b1d4dcff62ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:33.863188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b535d6-02b1-4c0f-8a16-b1d4dcff62ce service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:33.878037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 852/1697] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:33.879208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b535d6-02b1-4c0f-8a16-b1d4dcff62ce service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:33.896004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b535d6-02b1-4c0f-8a16-b1d4dcff62ce service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:33.926237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c2766-dc9e-4e30-b916-2fd87c649559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:33.929027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c2766-dc9e-4e30-b916-2fd87c649559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:33.929319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c2766-dc9e-4e30-b916-2fd87c649559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:33.929615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c2766-dc9e-4e30-b916-2fd87c649559 admin admin] PATH_INFO: `/v3/projects/76d5d27f6641485b8f63c41b2b0cad38/users/03f051d009404c72a2cc81c85d3709d0/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:33.932323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:33.971876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c2766-dc9e-4e30-b916-2fd87c649559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d5d27f6641485b8f63c41b2b0cad38, user_id=03f051d009404c72a2cc81c85d3709d0, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:33.980682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '544139e55ba940ecb52f43258ef596b2', 'request_id': 'req-4926c513-f05e-4f7b-b6bd-04862d1666e3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:33.981175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c2766-dc9e-4e30-b916-2fd87c649559 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:34.010827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '544139e55ba940ecb52f43258ef596b2', 'request_id': 'req-4926c513-f05e-4f7b-b6bd-04862d1666e3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:34.016940 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 853/1698] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:33 2022] PUT /identity/v3/projects/76d5d27f6641485b8f63c41b2b0cad38/users/03f051d009404c72a2cc81c85d3709d0/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:34.020851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c2766-dc9e-4e30-b916-2fd87c649559 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:34.033459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:34.047600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '544139e55ba940ecb52f43258ef596b2', 'request_id': 'req-4926c513-f05e-4f7b-b6bd-04862d1666e3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:34.104307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] The token cache is being invalidate because project 544139e55ba940ecb52f43258ef596b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:34:34.105350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:34.106482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:34.114123 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 846/1699] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:34:33 2022] DELETE /identity/v3/projects/544139e55ba940ecb52f43258ef596b2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:34.118332 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:34.137965 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:34.182916 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c2766-dc9e-4e30-b916-2fd87c649559 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:34.203225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01ced5-3c7c-4934-a84b-bbca6a25fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:34.204277 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01ced5-3c7c-4934-a84b-bbca6a25fe5f admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:34.204723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01ced5-3c7c-4934-a84b-bbca6a25fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:34.205136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01ced5-3c7c-4934-a84b-bbca6a25fe5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:34.206003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01ced5-3c7c-4934-a84b-bbca6a25fe5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:34.208851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01ced5-3c7c-4934-a84b-bbca6a25fe5f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:34.241221 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 854/1700] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:34.249464 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01ced5-3c7c-4934-a84b-bbca6a25fe5f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:34.254302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0f01ced5-3c7c-4934-a84b-bbca6a25fe5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:34.285116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01ced5-3c7c-4934-a84b-bbca6a25fe5f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:34.308396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd917ce1-f48f-46d3-b50d-5857d3a90bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:34.308396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd917ce1-f48f-46d3-b50d-5857d3a90bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:34.308396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd917ce1-f48f-46d3-b50d-5857d3a90bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:34.308396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd917ce1-f48f-46d3-b50d-5857d3a90bbc admin admin] PATH_INFO: `/v3/projects/76d5d27f6641485b8f63c41b2b0cad38/users/03f051d009404c72a2cc81c85d3709d0/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:34.308889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd917ce1-f48f-46d3-b50d-5857d3a90bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d5d27f6641485b8f63c41b2b0cad38, user_id=03f051d009404c72a2cc81c85d3709d0, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:34.311019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd917ce1-f48f-46d3-b50d-5857d3a90bbc admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:34.328947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926c513-f05e-4f7b-b6bd-04862d1666e3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:34.338476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 855/1701] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:34 2022] PUT /identity/v3/projects/76d5d27f6641485b8f63c41b2b0cad38/users/03f051d009404c72a2cc81c85d3709d0/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:34.348644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b657f1-c0cb-4d15-ae28-83a3431b12ae None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:34.348937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b657f1-c0cb-4d15-ae28-83a3431b12ae None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:34.349233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b657f1-c0cb-4d15-ae28-83a3431b12ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:34.410443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f3b657f1-c0cb-4d15-ae28-83a3431b12ae None None] MFA Rules not processed for user `03f051d009404c72a2cc81c85d3709d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:34.411785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f3b657f1-c0cb-4d15-ae28-83a3431b12ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:34.490014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2030bb-a592-4bd7-85fd-7683c01e0e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:34.492384 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2030bb-a592-4bd7-85fd-7683c01e0e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:34.492893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2030bb-a592-4bd7-85fd-7683c01e0e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:34.493145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2030bb-a592-4bd7-85fd-7683c01e0e07 admin admin] PATH_INFO: `/v3/users/b465777e48c545c6a5d69906f98bf415` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:34.499112 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2030bb-a592-4bd7-85fd-7683c01e0e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b465777e48c545c6a5d69906f98bf415)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:34.502517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2030bb-a592-4bd7-85fd-7683c01e0e07 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:34.620023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bb2030bb-a592-4bd7-85fd-7683c01e0e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b465777e48c545c6a5d69906f98bf415'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:34.640150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 856/1702] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:34.653774 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b657f1-c0cb-4d15-ae28-83a3431b12ae None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:34.659259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bb2030bb-a592-4bd7-85fd-7683c01e0e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b465777e48c545c6a5d69906f98bf415'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:34.660422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f3b657f1-c0cb-4d15-ae28-83a3431b12ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:34.674413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bb2030bb-a592-4bd7-85fd-7683c01e0e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b465777e48c545c6a5d69906f98bf415'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:34.675102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bb2030bb-a592-4bd7-85fd-7683c01e0e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b465777e48c545c6a5d69906f98bf415'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:34.675701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bb2030bb-a592-4bd7-85fd-7683c01e0e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b465777e48c545c6a5d69906f98bf415'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:34.687616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:34.717198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 847/1703] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:34:34 2022] DELETE /identity/v3/users/b465777e48c545c6a5d69906f98bf415 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:34.838538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b657f1-c0cb-4d15-ae28-83a3431b12ae None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:34.905389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:34.972736 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf86a5e-098e-4629-9ef5-5b96f69dcad5 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:34.973323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf86a5e-098e-4629-9ef5-5b96f69dcad5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:34.973323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf86a5e-098e-4629-9ef5-5b96f69dcad5 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:34.975072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 848/1704] 10.222.0.67 () {54 vars in 961 bytes} [Wed Jul 27 16:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:34:34.975281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266b924-bdcc-4337-9809-034e2a3052b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:34.976620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266b924-bdcc-4337-9809-034e2a3052b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:34.977238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266b924-bdcc-4337-9809-034e2a3052b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:34.977667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266b924-bdcc-4337-9809-034e2a3052b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:34.981964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2266b924-bdcc-4337-9809-034e2a3052b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:34.985600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c6023-6493-4f5a-8bd6-7cc267b3e177 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:34.986093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c6023-6493-4f5a-8bd6-7cc267b3e177 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:34.986382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c6023-6493-4f5a-8bd6-7cc267b3e177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:35.041321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-919c6023-6493-4f5a-8bd6-7cc267b3e177 None None] MFA Rules not processed for user `f602decb26be477b867493429352bd03`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:35.042748 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-919c6023-6493-4f5a-8bd6-7cc267b3e177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:35.179541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266b924-bdcc-4337-9809-034e2a3052b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:35.181632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266b924-bdcc-4337-9809-034e2a3052b3 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:35.197416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 857/1705] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:35.199065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe7b13-0ecc-4488-831f-3f3cea85fd69 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:35.199304 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe7b13-0ecc-4488-831f-3f3cea85fd69 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:35.199588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe7b13-0ecc-4488-831f-3f3cea85fd69 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:35.202197 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 858/1706] 10.222.0.67 () {54 vars in 912 bytes} [Wed Jul 27 16:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:34:35.208090 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1004-da0e-4c01-a4b0-611149ecde93 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:35.208383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1004-da0e-4c01-a4b0-611149ecde93 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:35.208665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1004-da0e-4c01-a4b0-611149ecde93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:35.216649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 849/1707] 10.222.0.67 () {58 vars in 1058 bytes} [Wed Jul 27 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:34:35.225996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c6023-6493-4f5a-8bd6-7cc267b3e177 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:35.250444 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c6023-6493-4f5a-8bd6-7cc267b3e177 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:35.273696 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-aa2f1004-da0e-4c01-a4b0-611149ecde93 None None] MFA Rules not processed for user `73325bdd109749ad92a66e600fd61a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:35.275730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-aa2f1004-da0e-4c01-a4b0-611149ecde93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:35.276774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710cad4-b4ce-4d17-b009-301d984b3569 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f602decb26be477b867493429352bd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:35.277605 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710cad4-b4ce-4d17-b009-301d984b3569 service placement] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:35.278084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710cad4-b4ce-4d17-b009-301d984b3569 service placement] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:35.278518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710cad4-b4ce-4d17-b009-301d984b3569 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:35.284836 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f710cad4-b4ce-4d17-b009-301d984b3569 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:35.313644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710cad4-b4ce-4d17-b009-301d984b3569 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:35.317966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710cad4-b4ce-4d17-b009-301d984b3569 service placement] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:35.364566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 850/1708] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:35.368930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e97a17-bcb3-4b76-a2c4-f132f2e672b6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:35.371452 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e97a17-bcb3-4b76-a2c4-f132f2e672b6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:35.371749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e97a17-bcb3-4b76-a2c4-f132f2e672b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:35.426277 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 859/1709] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:34:35.459017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-29e97a17-bcb3-4b76-a2c4-f132f2e672b6 None None] MFA Rules not processed for user `32a5063a78064508ad01165199bd60fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:35.464816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f1004-da0e-4c01-a4b0-611149ecde93 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:35.466357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-aa2f1004-da0e-4c01-a4b0-611149ecde93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:35.467663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-29e97a17-bcb3-4b76-a2c4-f132f2e672b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:35.489272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f1004-da0e-4c01-a4b0-611149ecde93 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:35.505013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a213d-0521-43ca-a6c0-c15f839576d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:35.506646 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a213d-0521-43ca-a6c0-c15f839576d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:35.507095 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a213d-0521-43ca-a6c0-c15f839576d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:35.507611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a213d-0521-43ca-a6c0-c15f839576d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:35.534829 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a213d-0521-43ca-a6c0-c15f839576d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:35.537662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a213d-0521-43ca-a6c0-c15f839576d7 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:35.579555 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 860/1710] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:34:35.713319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 851/1711] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:36.228006 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a213d-0521-43ca-a6c0-c15f839576d7 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:36.229533 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-297a213d-0521-43ca-a6c0-c15f839576d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:36.388965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a213d-0521-43ca-a6c0-c15f839576d7 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:36.408804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:36.409504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:36.409788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:36.410100 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] PATH_INFO: `/v3/users/a61a4a96f3b346ad8589504cb6a0edf3` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:36.411361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a61a4a96f3b346ad8589504cb6a0edf3)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:36.413329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:36.463506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:36.513264 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a61a4a96f3b346ad8589504cb6a0edf3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:36.525549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a61a4a96f3b346ad8589504cb6a0edf3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:36.534884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a61a4a96f3b346ad8589504cb6a0edf3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:36.535679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a61a4a96f3b346ad8589504cb6a0edf3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:36.537860 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a61a4a96f3b346ad8589504cb6a0edf3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:36.562289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 861/1712] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:34:36 2022] DELETE /identity/v3/users/a61a4a96f3b346ad8589504cb6a0edf3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:36.567068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56534d3f-a818-46f2-b168-8102d2e09cb0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:36.567537 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56534d3f-a818-46f2-b168-8102d2e09cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:36.567637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56534d3f-a818-46f2-b168-8102d2e09cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:36.604420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-56534d3f-a818-46f2-b168-8102d2e09cb0 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:36.605966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-56534d3f-a818-46f2-b168-8102d2e09cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:36.798023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 852/1713] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:36.834118 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:36.836065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:37.052372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10739bbd-fef4-4682-a4f3-5b341171787d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:37.053142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10739bbd-fef4-4682-a4f3-5b341171787d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:37.053738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10739bbd-fef4-4682-a4f3-5b341171787d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:37.064609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb40ed-3981-431b-b1d9-8d4efa47314e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:37.084493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c0513-5bda-46cd-96ef-7bcb7039e5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:37.085148 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c0513-5bda-46cd-96ef-7bcb7039e5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:37.085435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c0513-5bda-46cd-96ef-7bcb7039e5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:37.085710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c0513-5bda-46cd-96ef-7bcb7039e5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:37.136874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-10739bbd-fef4-4682-a4f3-5b341171787d None None] MFA Rules not processed for user `17804273371846b7abdcbd663a06c227`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:37.137645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c0513-5bda-46cd-96ef-7bcb7039e5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:37.138366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-10739bbd-fef4-4682-a4f3-5b341171787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:37.139121 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c0513-5bda-46cd-96ef-7bcb7039e5f9 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:37.150150 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:37.193554 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 862/1714] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:37.296992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c0513-5bda-46cd-96ef-7bcb7039e5f9 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:37.298606 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-726c0513-5bda-46cd-96ef-7bcb7039e5f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:37.344635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c0513-5bda-46cd-96ef-7bcb7039e5f9 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:37.362554 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:37.363234 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:37.363516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:37.363812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6 admin admin] PATH_INFO: `/v3/projects/f47f9ea10fe74b05baa2887a92bb2df0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:37.373868 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f47f9ea10fe74b05baa2887a92bb2df0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:37.375911 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:37.384045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 853/1715] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:37.460052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10739bbd-fef4-4682-a4f3-5b341171787d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:37.462092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-10739bbd-fef4-4682-a4f3-5b341171787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:37.639109 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47f9ea10fe74b05baa2887a92bb2df0', 'request_id': 'req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:37.678527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47f9ea10fe74b05baa2887a92bb2df0', 'request_id': 'req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:37.692092 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47f9ea10fe74b05baa2887a92bb2df0', 'request_id': 'req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:37.770307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6 admin admin] The token cache is being invalidate because project f47f9ea10fe74b05baa2887a92bb2df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:34:37.771796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:37.776890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ebc6551d-d8e2-4bd3-afe5-c2e19fa511c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:37.787012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 863/1716] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:34:37 2022] DELETE /identity/v3/projects/f47f9ea10fe74b05baa2887a92bb2df0 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:37.792831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10739bbd-fef4-4682-a4f3-5b341171787d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:37.793326 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7af1a5-200c-4e73-a7fd-7628a9d3f4a2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:37.795784 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7af1a5-200c-4e73-a7fd-7628a9d3f4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:37.797114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7af1a5-200c-4e73-a7fd-7628a9d3f4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:37.910454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-fd7af1a5-200c-4e73-a7fd-7628a9d3f4a2 None None] MFA Rules not processed for user `bc75a052c6b14904a314cf8f7bd4bad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:37.915163 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fd7af1a5-200c-4e73-a7fd-7628a9d3f4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:38.052886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:38.110848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f06c1-38e7-4c18-ac07-d22b1623b6d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:38.112863 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f06c1-38e7-4c18-ac07-d22b1623b6d0 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:38.114719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f06c1-38e7-4c18-ac07-d22b1623b6d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:38.115197 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f06c1-38e7-4c18-ac07-d22b1623b6d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:38.120432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7e7f06c1-38e7-4c18-ac07-d22b1623b6d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:38.204445 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 864/1717] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:38.207683 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e364284-c62b-497f-a3af-02fc80f1de76 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:38.208423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e364284-c62b-497f-a3af-02fc80f1de76 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:38.208628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e364284-c62b-497f-a3af-02fc80f1de76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:38.248498 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:38.255666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5e364284-c62b-497f-a3af-02fc80f1de76 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:38.257238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5e364284-c62b-497f-a3af-02fc80f1de76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:38.279247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f06c1-38e7-4c18-ac07-d22b1623b6d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:38.281392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f06c1-38e7-4c18-ac07-d22b1623b6d0 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:38.321830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 854/1718] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 862 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:34:38.536853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 865/1719] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:38.546786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01151-c0ca-44c9-a727-8a976fb607b1 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:38.550406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01151-c0ca-44c9-a727-8a976fb607b1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:38.551425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01151-c0ca-44c9-a727-8a976fb607b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:38.621680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-54b01151-c0ca-44c9-a727-8a976fb607b1 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:38.666083 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-54b01151-c0ca-44c9-a727-8a976fb607b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:38.729592 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 855/1720] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:38.733843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e364284-c62b-497f-a3af-02fc80f1de76 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:38.752150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e364284-c62b-497f-a3af-02fc80f1de76 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:38.760392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b01151-c0ca-44c9-a727-8a976fb607b1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:38.764916 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-54b01151-c0ca-44c9-a727-8a976fb607b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:38.784557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b036922-e5f3-401f-902d-fbd8d8461f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:38.794953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b036922-e5f3-401f-902d-fbd8d8461f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:38.797507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b036922-e5f3-401f-902d-fbd8d8461f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:38.798299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b036922-e5f3-401f-902d-fbd8d8461f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:38.799594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b036922-e5f3-401f-902d-fbd8d8461f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:34:38.811775 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b036922-e5f3-401f-902d-fbd8d8461f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:38.820636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b036922-e5f3-401f-902d-fbd8d8461f09 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:38.834132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b01151-c0ca-44c9-a727-8a976fb607b1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:38.855692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:38.859213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:38.861146 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:38.861622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] PATH_INFO: `/v3/projects/acec95eaa42f4718a2d58cf79bb06046` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:38.865777 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acec95eaa42f4718a2d58cf79bb06046)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:38.872069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:38.874490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 866/1721] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:34:38.875619 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b036922-e5f3-401f-902d-fbd8d8461f09 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:38.930598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b036922-e5f3-401f-902d-fbd8d8461f09 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:38.998850 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae699e5b-ba9d-4dee-a22a-f7076141c3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:39.000571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae699e5b-ba9d-4dee-a22a-f7076141c3ab admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:39.005106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae699e5b-ba9d-4dee-a22a-f7076141c3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:39.005406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae699e5b-ba9d-4dee-a22a-f7076141c3ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:39.017395 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae699e5b-ba9d-4dee-a22a-f7076141c3ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:39.037609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae699e5b-ba9d-4dee-a22a-f7076141c3ab admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:39.145753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 867/1722] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:38 2022] POST /identity/v3/projects => generated 363 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:39.150240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae699e5b-ba9d-4dee-a22a-f7076141c3ab admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:39.154349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ae699e5b-ba9d-4dee-a22a-f7076141c3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:39.181846 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acec95eaa42f4718a2d58cf79bb06046', 'request_id': 'req-8274df96-2d0d-45a8-9087-f9f66b76f353'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:39.204604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acec95eaa42f4718a2d58cf79bb06046', 'request_id': 'req-8274df96-2d0d-45a8-9087-f9f66b76f353'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:39.214846 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acec95eaa42f4718a2d58cf79bb06046', 'request_id': 'req-8274df96-2d0d-45a8-9087-f9f66b76f353'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:39.257692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] The token cache is being invalidate because project acec95eaa42f4718a2d58cf79bb06046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:34:39.258371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:39.260014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:39.262418 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 856/1723] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:34:38 2022] DELETE /identity/v3/projects/acec95eaa42f4718a2d58cf79bb06046 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:39.264193 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:39.274401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:39.352629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae699e5b-ba9d-4dee-a22a-f7076141c3ab admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:39.365793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903eed6-8ac2-4a7a-8c4e-dcd8707df64f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:39.368680 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903eed6-8ac2-4a7a-8c4e-dcd8707df64f service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:39.369070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903eed6-8ac2-4a7a-8c4e-dcd8707df64f service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:39.370702 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903eed6-8ac2-4a7a-8c4e-dcd8707df64f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:39.375196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e903eed6-8ac2-4a7a-8c4e-dcd8707df64f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:39.503049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274df96-2d0d-45a8-9087-f9f66b76f353 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:39.663193 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:39.670514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3343240-1d5e-4c7e-ace4-df8944685657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:39.671118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3343240-1d5e-4c7e-ace4-df8944685657 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:39.672082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3343240-1d5e-4c7e-ace4-df8944685657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:39.672082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3343240-1d5e-4c7e-ace4-df8944685657 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:39.672837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3343240-1d5e-4c7e-ace4-df8944685657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:39.691085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3343240-1d5e-4c7e-ace4-df8944685657 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:39.725311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:39.790276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 857/1724] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:39 2022] POST /identity/v3/users => generated 282 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:39.791349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3343240-1d5e-4c7e-ace4-df8944685657 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:39.801265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c3343240-1d5e-4c7e-ace4-df8944685657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:39.817145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903eed6-8ac2-4a7a-8c4e-dcd8707df64f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:39.825550 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903eed6-8ac2-4a7a-8c4e-dcd8707df64f service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:39.858567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3343240-1d5e-4c7e-ace4-df8944685657 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:39.874258 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 868/1725] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:39.888995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903eed6-8ac2-4a7a-8c4e-dcd8707df64f service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:39.895752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:39.896461 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:39.896750 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:39.897033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] PATH_INFO: `/v3/users/81fc72afc6814315bd73b3895cbb9580` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:39.914263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81fc72afc6814315bd73b3895cbb9580)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:39.916525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:39.956524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903eed6-8ac2-4a7a-8c4e-dcd8707df64f service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:39.996088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56486a-b114-448a-ad03-d0506aa1e788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:39.996836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56486a-b114-448a-ad03-d0506aa1e788 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:39.997128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56486a-b114-448a-ad03-d0506aa1e788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:39.997415 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56486a-b114-448a-ad03-d0506aa1e788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:39.998132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56486a-b114-448a-ad03-d0506aa1e788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:40.004143 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56486a-b114-448a-ad03-d0506aa1e788 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:40.065110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 869/1726] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:40.069416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dd0be-789f-4b30-afe7-20326ca5bb28 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:40.083617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dd0be-789f-4b30-afe7-20326ca5bb28 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:40.084229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dd0be-789f-4b30-afe7-20326ca5bb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:40.128370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81fc72afc6814315bd73b3895cbb9580'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:40.156654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81fc72afc6814315bd73b3895cbb9580'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:40.168559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81fc72afc6814315bd73b3895cbb9580'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:40.169267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81fc72afc6814315bd73b3895cbb9580'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:40.169904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81fc72afc6814315bd73b3895cbb9580'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:40.230426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 858/1727] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:34:39 2022] DELETE /identity/v3/users/81fc72afc6814315bd73b3895cbb9580 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:40.233990 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:40.254127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:40.281725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5b4dd0be-789f-4b30-afe7-20326ca5bb28 None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:40.285850 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5b4dd0be-789f-4b30-afe7-20326ca5bb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:40.551166 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcafd07-3d10-4e0f-a73c-372df002bf72 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:40.560917 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 870/1728] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:40.575091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dc41e-ab86-41e8-b98b-d9cc2d4b0615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:40.575962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc41e-ab86-41e8-b98b-d9cc2d4b0615 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:40.576085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc41e-ab86-41e8-b98b-d9cc2d4b0615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:40.576468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc41e-ab86-41e8-b98b-d9cc2d4b0615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:40.577184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659dc41e-ab86-41e8-b98b-d9cc2d4b0615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:40.578799 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659dc41e-ab86-41e8-b98b-d9cc2d4b0615 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:40.636066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dd0be-789f-4b30-afe7-20326ca5bb28 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:40.637931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 859/1729] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:40.663727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dd0be-789f-4b30-afe7-20326ca5bb28 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:40.696180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b719a-ec15-41f1-a0e6-3a38009bd451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:40.701453 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b719a-ec15-41f1-a0e6-3a38009bd451 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:40.701759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b719a-ec15-41f1-a0e6-3a38009bd451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:40.704423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b719a-ec15-41f1-a0e6-3a38009bd451 admin admin] PATH_INFO: `/v3/projects/84a58ae55e3c4b05a35874f0439d6504/users/a65697c2eb31455f9ef3aeb313b3063b/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:40.833038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b719a-ec15-41f1-a0e6-3a38009bd451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a58ae55e3c4b05a35874f0439d6504, user_id=a65697c2eb31455f9ef3aeb313b3063b, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:40.857578 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b719a-ec15-41f1-a0e6-3a38009bd451 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:40.963359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 871/1730] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:40 2022] PUT /identity/v3/projects/84a58ae55e3c4b05a35874f0439d6504/users/a65697c2eb31455f9ef3aeb313b3063b/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:34:40.976562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04704be-c7bd-4245-900f-7fc3746b211a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:40.977420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04704be-c7bd-4245-900f-7fc3746b211a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:40.977984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04704be-c7bd-4245-900f-7fc3746b211a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:40.992341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b719a-ec15-41f1-a0e6-3a38009bd451 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:40.996667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a55b719a-ec15-41f1-a0e6-3a38009bd451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:41.083415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d04704be-c7bd-4245-900f-7fc3746b211a None None] MFA Rules not processed for user `a65697c2eb31455f9ef3aeb313b3063b`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:41.092508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d04704be-c7bd-4245-900f-7fc3746b211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:41.256609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:41.262701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b719a-ec15-41f1-a0e6-3a38009bd451 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:41.280884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd2511-eadc-4be9-8822-17314bb1ce0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:41.281879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd2511-eadc-4be9-8822-17314bb1ce0c service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:41.282249 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd2511-eadc-4be9-8822-17314bb1ce0c service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:41.282485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd2511-eadc-4be9-8822-17314bb1ce0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:41.340939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:41.407055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 860/1731] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:41.411886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04704be-c7bd-4245-900f-7fc3746b211a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:41.533494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd2511-eadc-4be9-8822-17314bb1ce0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:41.544365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd2511-eadc-4be9-8822-17314bb1ce0c service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:41.573045 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 872/1732] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:34:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 16:34:41.644142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04704be-c7bd-4245-900f-7fc3746b211a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:41.667217 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3685f-61ac-497f-8157-291d42b90248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:41.667965 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3685f-61ac-497f-8157-291d42b90248 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:41.668168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3685f-61ac-497f-8157-291d42b90248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:41.668615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3685f-61ac-497f-8157-291d42b90248 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:41.669494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3685f-61ac-497f-8157-291d42b90248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:41.673644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3685f-61ac-497f-8157-291d42b90248 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:41.739084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 861/1733] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:41 2022] POST /identity/v3/projects => generated 361 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:41.739666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd2511-eadc-4be9-8822-17314bb1ce0c service swift] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:41.760423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd2511-eadc-4be9-8822-17314bb1ce0c service swift] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:42.081006 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf79f3-3f4f-4e2a-9f0d-819f15ad14b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:42.086470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf79f3-3f4f-4e2a-9f0d-819f15ad14b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:42.087242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf79f3-3f4f-4e2a-9f0d-819f15ad14b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:42.089204 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf79f3-3f4f-4e2a-9f0d-819f15ad14b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:42.090782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf79f3-3f4f-4e2a-9f0d-819f15ad14b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:42.096849 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf79f3-3f4f-4e2a-9f0d-819f15ad14b9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:42.205525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 873/1734] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:41 2022] POST /identity/v3/users => generated 287 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:42.211152 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3685f-61ac-497f-8157-291d42b90248 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:42.266207 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3685f-61ac-497f-8157-291d42b90248 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:42.329092 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533f25-f7c8-41f9-9856-ec25a44863d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:42.334018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533f25-f7c8-41f9-9856-ec25a44863d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:42.334367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533f25-f7c8-41f9-9856-ec25a44863d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:42.338016 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533f25-f7c8-41f9-9856-ec25a44863d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:42.344274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b533f25-f7c8-41f9-9856-ec25a44863d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:42.350571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b533f25-f7c8-41f9-9856-ec25a44863d8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:42.416565 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 862/1735] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:42.420285 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf79f3-3f4f-4e2a-9f0d-819f15ad14b9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:42.459110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf79f3-3f4f-4e2a-9f0d-819f15ad14b9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:42.478187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba02eb-5f58-4332-951a-fb07b67e9eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:42.480068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba02eb-5f58-4332-951a-fb07b67e9eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:42.480727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba02eb-5f58-4332-951a-fb07b67e9eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:42.481480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba02eb-5f58-4332-951a-fb07b67e9eb9 admin admin] PATH_INFO: `/v3/projects/81397a4da534400183bc9f521f03a40e/users/e98869a212f1429bb31f4e728d4da38e/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:42.508226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba02eb-5f58-4332-951a-fb07b67e9eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81397a4da534400183bc9f521f03a40e, user_id=e98869a212f1429bb31f4e728d4da38e, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:42.511780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba02eb-5f58-4332-951a-fb07b67e9eb9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:42.553752 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 874/1736] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:42 2022] PUT /identity/v3/projects/81397a4da534400183bc9f521f03a40e/users/e98869a212f1429bb31f4e728d4da38e/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:42.558496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533f25-f7c8-41f9-9856-ec25a44863d8 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:42.624263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533f25-f7c8-41f9-9856-ec25a44863d8 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:42.859608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a2a47-ae3a-4018-822e-f61336eba4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:42.860560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a2a47-ae3a-4018-822e-f61336eba4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:42.863190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a2a47-ae3a-4018-822e-f61336eba4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:42.863543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a2a47-ae3a-4018-822e-f61336eba4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:42.864309 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a2a47-ae3a-4018-822e-f61336eba4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:42.868985 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a2a47-ae3a-4018-822e-f61336eba4ae admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:42.916989 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 863/1737] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:42.921983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba02eb-5f58-4332-951a-fb07b67e9eb9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:42.947980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba02eb-5f58-4332-951a-fb07b67e9eb9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:42.969925 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa60f75-7248-4824-8678-532cbbd49b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:42.972458 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa60f75-7248-4824-8678-532cbbd49b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:42.974635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa60f75-7248-4824-8678-532cbbd49b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:42.975204 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa60f75-7248-4824-8678-532cbbd49b34 admin admin] PATH_INFO: `/v3/projects/81397a4da534400183bc9f521f03a40e/users/e98869a212f1429bb31f4e728d4da38e/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:42.982120 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa60f75-7248-4824-8678-532cbbd49b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81397a4da534400183bc9f521f03a40e, user_id=e98869a212f1429bb31f4e728d4da38e, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:42.992980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa60f75-7248-4824-8678-532cbbd49b34 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:43.052239 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 875/1738] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:42 2022] PUT /identity/v3/projects/81397a4da534400183bc9f521f03a40e/users/e98869a212f1429bb31f4e728d4da38e/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:43.067535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b908-ba81-480d-9817-8b1ea34cf004 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:43.067825 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b908-ba81-480d-9817-8b1ea34cf004 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:43.068147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b908-ba81-480d-9817-8b1ea34cf004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:43.135340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0885b908-ba81-480d-9817-8b1ea34cf004 None None] MFA Rules not processed for user `e98869a212f1429bb31f4e728d4da38e`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:43.138030 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0885b908-ba81-480d-9817-8b1ea34cf004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:43.302184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:43.372575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 864/1739] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:43 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:43.397077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa60f75-7248-4824-8678-532cbbd49b34 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:43.400254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1aa60f75-7248-4824-8678-532cbbd49b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:43.631262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa60f75-7248-4824-8678-532cbbd49b34 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:43.647526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e6805-52c6-4893-98a3-aae72bda757c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:43.648464 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e6805-52c6-4893-98a3-aae72bda757c service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:43.649724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e6805-52c6-4893-98a3-aae72bda757c service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:43.650252 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e6805-52c6-4893-98a3-aae72bda757c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:43.689007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e6805-52c6-4893-98a3-aae72bda757c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:43.691622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e6805-52c6-4893-98a3-aae72bda757c service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:43.701945 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:43.736333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 876/1740] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:43 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:43.783299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b908-ba81-480d-9817-8b1ea34cf004 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:43.785333 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0885b908-ba81-480d-9817-8b1ea34cf004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:44.013556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e6805-52c6-4893-98a3-aae72bda757c service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:44.050327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e6805-52c6-4893-98a3-aae72bda757c service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:44.062146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e92d92-e12e-43b4-8fac-b61a97b67dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:44.062850 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e92d92-e12e-43b4-8fac-b61a97b67dca service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:44.063165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e92d92-e12e-43b4-8fac-b61a97b67dca service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:44.063470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e92d92-e12e-43b4-8fac-b61a97b67dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:44.111454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b908-ba81-480d-9817-8b1ea34cf004 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:44.139887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac3c29-d328-481e-8cc0-98fa46cd44e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:44.140761 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac3c29-d328-481e-8cc0-98fa46cd44e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:44.141068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac3c29-d328-481e-8cc0-98fa46cd44e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:44.141335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac3c29-d328-481e-8cc0-98fa46cd44e8 admin admin] PATH_INFO: `/v3/projects/25707970c6a14864a65a9ea0ac9afded` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:44.148131 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac3c29-d328-481e-8cc0-98fa46cd44e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25707970c6a14864a65a9ea0ac9afded)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:44.153131 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac3c29-d328-481e-8cc0-98fa46cd44e8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:44.328281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e92d92-e12e-43b4-8fac-b61a97b67dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:44.332364 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e92d92-e12e-43b4-8fac-b61a97b67dca service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:44.376106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-17ac3c29-d328-481e-8cc0-98fa46cd44e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25707970c6a14864a65a9ea0ac9afded', 'request_id': 'req-17ac3c29-d328-481e-8cc0-98fa46cd44e8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:44.394685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 877/1741] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:44 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:44.407782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-17ac3c29-d328-481e-8cc0-98fa46cd44e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25707970c6a14864a65a9ea0ac9afded', 'request_id': 'req-17ac3c29-d328-481e-8cc0-98fa46cd44e8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:44.439303 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-17ac3c29-d328-481e-8cc0-98fa46cd44e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25707970c6a14864a65a9ea0ac9afded', 'request_id': 'req-17ac3c29-d328-481e-8cc0-98fa46cd44e8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:44.494712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-17ac3c29-d328-481e-8cc0-98fa46cd44e8 admin admin] The token cache is being invalidate because project 25707970c6a14864a65a9ea0ac9afded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:34:44.496988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-17ac3c29-d328-481e-8cc0-98fa46cd44e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:44.499797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-17ac3c29-d328-481e-8cc0-98fa46cd44e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:44.507208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78040807-9b77-4f76-a99f-3079f264caef None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:44.507511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78040807-9b77-4f76-a99f-3079f264caef None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:44.507789 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78040807-9b77-4f76-a99f-3079f264caef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:44.512574 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 865/1742] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:34:43 2022] DELETE /identity/v3/projects/25707970c6a14864a65a9ea0ac9afded => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:44.633785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-78040807-9b77-4f76-a99f-3079f264caef None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:44.648406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-78040807-9b77-4f76-a99f-3079f264caef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:44.874016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 878/1743] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:44.882038 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed7dc0-99f3-44a0-ab6b-f3b7b6d67a7b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:44.882174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed7dc0-99f3-44a0-ab6b-f3b7b6d67a7b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:44.882616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed7dc0-99f3-44a0-ab6b-f3b7b6d67a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:44.918038 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-80ed7dc0-99f3-44a0-ab6b-f3b7b6d67a7b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:44.919604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-80ed7dc0-99f3-44a0-ab6b-f3b7b6d67a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:44.940798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 866/1744] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:44.942447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78040807-9b77-4f76-a99f-3079f264caef None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:44.959697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78040807-9b77-4f76-a99f-3079f264caef None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:44.971292 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cd493-d0e4-4cf0-bb24-390de02b2d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:44.972015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cd493-d0e4-4cf0-bb24-390de02b2d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:44.972301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cd493-d0e4-4cf0-bb24-390de02b2d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:44.972580 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cd493-d0e4-4cf0-bb24-390de02b2d61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:44.973300 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cd493-d0e4-4cf0-bb24-390de02b2d61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:34:44.973592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cd493-d0e4-4cf0-bb24-390de02b2d61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:44.975224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cd493-d0e4-4cf0-bb24-390de02b2d61 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:45.014936 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 879/1745] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:34:45.019788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed7dc0-99f3-44a0-ab6b-f3b7b6d67a7b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:45.031185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed7dc0-99f3-44a0-ab6b-f3b7b6d67a7b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:45.053872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b277307-a312-4803-bc05-92e980268e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:45.054512 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b277307-a312-4803-bc05-92e980268e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:45.054794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b277307-a312-4803-bc05-92e980268e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:45.055880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b277307-a312-4803-bc05-92e980268e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:45.057059 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b277307-a312-4803-bc05-92e980268e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:45.058955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b277307-a312-4803-bc05-92e980268e20 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:45.182258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 867/1746] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:45 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:45.183750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cd493-d0e4-4cf0-bb24-390de02b2d61 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:45.200699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cd493-d0e4-4cf0-bb24-390de02b2d61 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:45.392354 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2ab79-e563-49d3-960b-8f25421b36b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:45.393005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2ab79-e563-49d3-960b-8f25421b36b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:45.393295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2ab79-e563-49d3-960b-8f25421b36b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:45.393580 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2ab79-e563-49d3-960b-8f25421b36b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:45.394276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2ab79-e563-49d3-960b-8f25421b36b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:45.396274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2ab79-e563-49d3-960b-8f25421b36b2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:45.476293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 880/1747] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:45 2022] POST /identity/v3/users => generated 294 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:45.481134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b277307-a312-4803-bc05-92e980268e20 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:45.500146 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b277307-a312-4803-bc05-92e980268e20 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:45.520779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e6d42-edc8-4ecf-938e-c29f17a7378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:45.521373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6d42-edc8-4ecf-938e-c29f17a7378a admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:45.521660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6d42-edc8-4ecf-938e-c29f17a7378a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:45.521940 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6d42-edc8-4ecf-938e-c29f17a7378a admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:45.522661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e6d42-edc8-4ecf-938e-c29f17a7378a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:45.525672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e6d42-edc8-4ecf-938e-c29f17a7378a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:45.560994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 868/1748] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:45.565151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2ab79-e563-49d3-960b-8f25421b36b2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:45.581957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2ab79-e563-49d3-960b-8f25421b36b2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:45.607802 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8dc44-541b-415e-a015-ef957dafbc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:45.609010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8dc44-541b-415e-a015-ef957dafbc98 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:45.610231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8dc44-541b-415e-a015-ef957dafbc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:45.612228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8dc44-541b-415e-a015-ef957dafbc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:45.613161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8dc44-541b-415e-a015-ef957dafbc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:45.619681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8dc44-541b-415e-a015-ef957dafbc98 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:45.639648 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871820a-fb5d-47f7-af0d-3e2145803b32 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:45.640014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871820a-fb5d-47f7-af0d-3e2145803b32 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:45.640296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871820a-fb5d-47f7-af0d-3e2145803b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:45.690058 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 881/1749] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:45.692968 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8dc44-541b-415e-a015-ef957dafbc98 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:45.701073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1871820a-fb5d-47f7-af0d-3e2145803b32 None None] MFA Rules not processed for user `73325bdd109749ad92a66e600fd61a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:45.702307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1871820a-fb5d-47f7-af0d-3e2145803b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:45.717194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:45.737716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8dc44-541b-415e-a015-ef957dafbc98 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:45.770348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c51eb-a9d3-4852-a24e-fd99abb01af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:45.774894 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c51eb-a9d3-4852-a24e-fd99abb01af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:45.776854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c51eb-a9d3-4852-a24e-fd99abb01af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:45.777875 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c51eb-a9d3-4852-a24e-fd99abb01af0 admin admin] PATH_INFO: `/v3/projects/7d2966c49e994a13a35757718b7252c2/users/7a2575edc50d435ab41fdc6a67892b5c/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:45.849265 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c51eb-a9d3-4852-a24e-fd99abb01af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2966c49e994a13a35757718b7252c2, user_id=7a2575edc50d435ab41fdc6a67892b5c, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:45.880230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c51eb-a9d3-4852-a24e-fd99abb01af0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:45.891718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:45.928848 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 882/1750] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:45 2022] PUT /identity/v3/projects/7d2966c49e994a13a35757718b7252c2/users/7a2575edc50d435ab41fdc6a67892b5c/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:45.940190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7554d15-7806-4076-9e17-19bfcc290ac4 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:45.945224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7554d15-7806-4076-9e17-19bfcc290ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:45.946338 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7554d15-7806-4076-9e17-19bfcc290ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:45.978311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 869/1751] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Jul 27 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:46.048466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871820a-fb5d-47f7-af0d-3e2145803b32 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:46.049913 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1871820a-fb5d-47f7-af0d-3e2145803b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:46.077614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871820a-fb5d-47f7-af0d-3e2145803b32 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:46.086950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b7554d15-7806-4076-9e17-19bfcc290ac4 None None] MFA Rules not processed for user `7a2575edc50d435ab41fdc6a67892b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:46.091674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b7554d15-7806-4076-9e17-19bfcc290ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:46.290517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532afe-3a5d-4104-a625-8a30c596a469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:46.291689 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532afe-3a5d-4104-a625-8a30c596a469 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:46.292184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532afe-3a5d-4104-a625-8a30c596a469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:46.292811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532afe-3a5d-4104-a625-8a30c596a469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:46.310260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2532afe-3a5d-4104-a625-8a30c596a469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:46.315433 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2532afe-3a5d-4104-a625-8a30c596a469 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:46.330449 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 870/1752] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:46.331841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532afe-3a5d-4104-a625-8a30c596a469 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:46.344140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532afe-3a5d-4104-a625-8a30c596a469 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:46.349377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955356fa-5e64-4cf0-b384-896378a586e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:46.350428 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955356fa-5e64-4cf0-b384-896378a586e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:46.351148 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955356fa-5e64-4cf0-b384-896378a586e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:46.351723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955356fa-5e64-4cf0-b384-896378a586e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:46.376675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955356fa-5e64-4cf0-b384-896378a586e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:46.379126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955356fa-5e64-4cf0-b384-896378a586e7 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:46.397152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 883/1753] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:46.399514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 871/1754] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:46.403123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7554d15-7806-4076-9e17-19bfcc290ac4 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:46.646823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7554d15-7806-4076-9e17-19bfcc290ac4 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:46.667739 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c3e4d-a547-49e6-81b6-47dfb3de0a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:46.674151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c3e4d-a547-49e6-81b6-47dfb3de0a47 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:46.674151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c3e4d-a547-49e6-81b6-47dfb3de0a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:46.674151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c3e4d-a547-49e6-81b6-47dfb3de0a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:46.679759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c3e4d-a547-49e6-81b6-47dfb3de0a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:46.688572 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c3e4d-a547-49e6-81b6-47dfb3de0a47 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:46.772306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 884/1755] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:46 2022] POST /identity/v3/projects => generated 387 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:46.777503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955356fa-5e64-4cf0-b384-896378a586e7 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:46.808311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955356fa-5e64-4cf0-b384-896378a586e7 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:46.956824 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ab4ef-a1ac-48b3-9a8b-6ae3ab39f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:46.958051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ab4ef-a1ac-48b3-9a8b-6ae3ab39f026 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:46.959299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ab4ef-a1ac-48b3-9a8b-6ae3ab39f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:46.961736 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ab4ef-a1ac-48b3-9a8b-6ae3ab39f026 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:46.965361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ab4ef-a1ac-48b3-9a8b-6ae3ab39f026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:46.996130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ab4ef-a1ac-48b3-9a8b-6ae3ab39f026 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:47.081770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 872/1756] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:46 2022] POST /identity/v3/users => generated 294 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:47.083673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c3e4d-a547-49e6-81b6-47dfb3de0a47 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:47.098536 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c3e4d-a547-49e6-81b6-47dfb3de0a47 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:47.130846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755d169-b003-47e2-8261-38a557a8d7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:47.134754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755d169-b003-47e2-8261-38a557a8d7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:47.136291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755d169-b003-47e2-8261-38a557a8d7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:47.138337 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755d169-b003-47e2-8261-38a557a8d7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:47.146685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755d169-b003-47e2-8261-38a557a8d7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:47.151481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755d169-b003-47e2-8261-38a557a8d7d9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:47.200105 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 885/1757] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:47.202787 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ab4ef-a1ac-48b3-9a8b-6ae3ab39f026 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:47.217136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ab4ef-a1ac-48b3-9a8b-6ae3ab39f026 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:47.231443 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690aadc-ccfa-4f15-943d-7ee1e6f64eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:47.232975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690aadc-ccfa-4f15-943d-7ee1e6f64eac admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:47.234560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690aadc-ccfa-4f15-943d-7ee1e6f64eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:47.235829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690aadc-ccfa-4f15-943d-7ee1e6f64eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:47.236690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690aadc-ccfa-4f15-943d-7ee1e6f64eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:47.243272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690aadc-ccfa-4f15-943d-7ee1e6f64eac admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:47.274427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 873/1758] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:47.288185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755d169-b003-47e2-8261-38a557a8d7d9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:47.305699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755d169-b003-47e2-8261-38a557a8d7d9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:47.323345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7626bb-eb52-4b6f-a153-3340f92a7400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:47.326479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7626bb-eb52-4b6f-a153-3340f92a7400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:47.327543 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7626bb-eb52-4b6f-a153-3340f92a7400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:47.328879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7626bb-eb52-4b6f-a153-3340f92a7400 admin admin] PATH_INFO: `/v3/projects/3c8ee2185c464d81a9ab788f11c97d68/users/1d0a6e895fb844b287737eae05b9afae/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:47.384505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7626bb-eb52-4b6f-a153-3340f92a7400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8ee2185c464d81a9ab788f11c97d68, user_id=1d0a6e895fb844b287737eae05b9afae, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:47.394994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7626bb-eb52-4b6f-a153-3340f92a7400 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:47.439216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 886/1759] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:47 2022] PUT /identity/v3/projects/3c8ee2185c464d81a9ab788f11c97d68/users/1d0a6e895fb844b287737eae05b9afae/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:47.455988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942add4-7d5a-454e-9780-6ef10ebde5f7 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:47.462753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942add4-7d5a-454e-9780-6ef10ebde5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:47.465149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942add4-7d5a-454e-9780-6ef10ebde5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:47.576276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-8942add4-7d5a-454e-9780-6ef10ebde5f7 None None] MFA Rules not processed for user `1d0a6e895fb844b287737eae05b9afae`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:47.576276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8942add4-7d5a-454e-9780-6ef10ebde5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:47.771008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:47.854729 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 874/1760] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:47.858581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7626bb-eb52-4b6f-a153-3340f92a7400 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:47.923099 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:48.148757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7626bb-eb52-4b6f-a153-3340f92a7400 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:48.167316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64025d8f-93fa-472a-bfaa-ff3db0b072b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:48.168745 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64025d8f-93fa-472a-bfaa-ff3db0b072b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:48.171607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64025d8f-93fa-472a-bfaa-ff3db0b072b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:48.172109 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64025d8f-93fa-472a-bfaa-ff3db0b072b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:48.172987 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64025d8f-93fa-472a-bfaa-ff3db0b072b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:48.177901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64025d8f-93fa-472a-bfaa-ff3db0b072b4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:48.261914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 887/1761] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:47 2022] POST /identity/v3/projects => generated 385 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:48.263386 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942add4-7d5a-454e-9780-6ef10ebde5f7 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:48.283765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942add4-7d5a-454e-9780-6ef10ebde5f7 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:48.470561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7cf3f-031a-46d9-b737-4bb49cd1be6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:48.471628 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7cf3f-031a-46d9-b737-4bb49cd1be6d admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:48.472343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7cf3f-031a-46d9-b737-4bb49cd1be6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:48.472867 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7cf3f-031a-46d9-b737-4bb49cd1be6d admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:48.473816 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7cf3f-031a-46d9-b737-4bb49cd1be6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:48.481549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7cf3f-031a-46d9-b737-4bb49cd1be6d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:48.541674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 875/1762] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:48 2022] POST /identity/v3/users => generated 299 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:34:48.541971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64025d8f-93fa-472a-bfaa-ff3db0b072b4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:48.560027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64025d8f-93fa-472a-bfaa-ff3db0b072b4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:48.573485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3f4bf-11a1-470b-87e9-fab747b4bb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:48.574221 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3f4bf-11a1-470b-87e9-fab747b4bb19 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:48.574509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3f4bf-11a1-470b-87e9-fab747b4bb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:48.575232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3f4bf-11a1-470b-87e9-fab747b4bb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:48.580516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3f4bf-11a1-470b-87e9-fab747b4bb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:48.586678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3f4bf-11a1-470b-87e9-fab747b4bb19 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:48.629764 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 888/1763] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:48.636917 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7cf3f-031a-46d9-b737-4bb49cd1be6d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:48.653060 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7cf3f-031a-46d9-b737-4bb49cd1be6d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:48.660400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e30eb7-c7de-42a8-be8f-5f139f3719d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:48.661743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e30eb7-c7de-42a8-be8f-5f139f3719d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:48.662840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e30eb7-c7de-42a8-be8f-5f139f3719d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:48.663276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e30eb7-c7de-42a8-be8f-5f139f3719d9 admin admin] PATH_INFO: `/v3/projects/edab5b2a1aa3481da220d37b17289dd9/users/65f8190724db4a108c62c818b40ed5a7/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:48.686567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e30eb7-c7de-42a8-be8f-5f139f3719d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edab5b2a1aa3481da220d37b17289dd9, user_id=65f8190724db4a108c62c818b40ed5a7, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:48.690159 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e30eb7-c7de-42a8-be8f-5f139f3719d9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:48.715480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3f4bf-11a1-470b-87e9-fab747b4bb19 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:48.742203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 876/1764] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:48 2022] PUT /identity/v3/projects/edab5b2a1aa3481da220d37b17289dd9/users/65f8190724db4a108c62c818b40ed5a7/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:48.754064 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3f4bf-11a1-470b-87e9-fab747b4bb19 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:48.813498 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e30eb7-c7de-42a8-be8f-5f139f3719d9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:48.820798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-75e30eb7-c7de-42a8-be8f-5f139f3719d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:49.037404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89ce4d-9493-4ed3-9916-78a90a0e4ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:49.038570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89ce4d-9493-4ed3-9916-78a90a0e4ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:49.039092 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89ce4d-9493-4ed3-9916-78a90a0e4ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:49.040701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89ce4d-9493-4ed3-9916-78a90a0e4ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:49.042013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89ce4d-9493-4ed3-9916-78a90a0e4ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:49.046338 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89ce4d-9493-4ed3-9916-78a90a0e4ae8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:49.076284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 889/1765] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:49.079143 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9568e3-3f9a-483b-9cbe-9a8c75cb2f7e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:49.084032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9568e3-3f9a-483b-9cbe-9a8c75cb2f7e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:49.084605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9568e3-3f9a-483b-9cbe-9a8c75cb2f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:49.096702 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e30eb7-c7de-42a8-be8f-5f139f3719d9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:49.125551 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee68d48-0d3f-48d9-ac3e-f4a5d85f2bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:49.126582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee68d48-0d3f-48d9-ac3e-f4a5d85f2bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:49.127032 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee68d48-0d3f-48d9-ac3e-f4a5d85f2bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:49.127456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee68d48-0d3f-48d9-ac3e-f4a5d85f2bd8 admin admin] PATH_INFO: `/v3/users/a65697c2eb31455f9ef3aeb313b3063b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:49.129549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee68d48-0d3f-48d9-ac3e-f4a5d85f2bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65697c2eb31455f9ef3aeb313b3063b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:49.131661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee68d48-0d3f-48d9-ac3e-f4a5d85f2bd8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:49.141504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6a9568e3-3f9a-483b-9cbe-9a8c75cb2f7e None None] MFA Rules not processed for user `17804273371846b7abdcbd663a06c227`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:49.144955 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6a9568e3-3f9a-483b-9cbe-9a8c75cb2f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:49.270607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dee68d48-0d3f-48d9-ac3e-f4a5d85f2bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65697c2eb31455f9ef3aeb313b3063b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:49.290448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:49.306947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dee68d48-0d3f-48d9-ac3e-f4a5d85f2bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65697c2eb31455f9ef3aeb313b3063b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:49.333932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dee68d48-0d3f-48d9-ac3e-f4a5d85f2bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65697c2eb31455f9ef3aeb313b3063b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:49.335271 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dee68d48-0d3f-48d9-ac3e-f4a5d85f2bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65697c2eb31455f9ef3aeb313b3063b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:49.335991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dee68d48-0d3f-48d9-ac3e-f4a5d85f2bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65697c2eb31455f9ef3aeb313b3063b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:49.416213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 890/1766] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:49.426675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9568e3-3f9a-483b-9cbe-9a8c75cb2f7e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:49.439204 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6a9568e3-3f9a-483b-9cbe-9a8c75cb2f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:49.478571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 877/1767] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:34:48 2022] DELETE /identity/v3/users/a65697c2eb31455f9ef3aeb313b3063b => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:49.486095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bca5b-a59a-418d-a78d-b1bb32a8d8c0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:49.486385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bca5b-a59a-418d-a78d-b1bb32a8d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:49.486666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bca5b-a59a-418d-a78d-b1bb32a8d8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:49.517920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9568e3-3f9a-483b-9cbe-9a8c75cb2f7e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:49.552634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-382bca5b-a59a-418d-a78d-b1bb32a8d8c0 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:49.553911 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-382bca5b-a59a-418d-a78d-b1bb32a8d8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:49.679816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:49.797290 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2186813-f376-43bd-82b0-6afade499c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:49.798421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2186813-f376-43bd-82b0-6afade499c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:49.800229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2186813-f376-43bd-82b0-6afade499c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:49.800713 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2186813-f376-43bd-82b0-6afade499c5f admin admin] PATH_INFO: `/v3/projects/edab5b2a1aa3481da220d37b17289dd9/users/65f8190724db4a108c62c818b40ed5a7/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:49.819472 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 878/1768] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:49.820514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2186813-f376-43bd-82b0-6afade499c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=edab5b2a1aa3481da220d37b17289dd9, user_id=65f8190724db4a108c62c818b40ed5a7, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:49.841055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bca5b-a59a-418d-a78d-b1bb32a8d8c0 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:49.841509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2186813-f376-43bd-82b0-6afade499c5f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:49.842653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-382bca5b-a59a-418d-a78d-b1bb32a8d8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:49.890441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 891/1769] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:49 2022] PUT /identity/v3/projects/edab5b2a1aa3481da220d37b17289dd9/users/65f8190724db4a108c62c818b40ed5a7/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:49.902277 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8db2a-c812-4884-94f8-93097ce4750f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:49.902796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8db2a-c812-4884-94f8-93097ce4750f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:49.903294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8db2a-c812-4884-94f8-93097ce4750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:50.020990 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bca5b-a59a-418d-a78d-b1bb32a8d8c0 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:50.028863 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ced8db2a-c812-4884-94f8-93097ce4750f None None] MFA Rules not processed for user `65f8190724db4a108c62c818b40ed5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:50.034230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ced8db2a-c812-4884-94f8-93097ce4750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:50.173648 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bff743-1238-4fa8-8f33-93f9f4fe3a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:50.175693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bff743-1238-4fa8-8f33-93f9f4fe3a42 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:50.176021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bff743-1238-4fa8-8f33-93f9f4fe3a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:50.176455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bff743-1238-4fa8-8f33-93f9f4fe3a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:50.310205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:50.355301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 892/1770] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 27 16:34:50.387144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8db2a-c812-4884-94f8-93097ce4750f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:50.396087 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ced8db2a-c812-4884-94f8-93097ce4750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:50.413953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bff743-1238-4fa8-8f33-93f9f4fe3a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:50.429829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bff743-1238-4fa8-8f33-93f9f4fe3a42 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:50.488378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 879/1771] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:34:50.653524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8db2a-c812-4884-94f8-93097ce4750f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:50.671891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d995f7-5bb9-4ab8-9564-30b94c2ad61f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:50.673233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d995f7-5bb9-4ab8-9564-30b94c2ad61f service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:50.674978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d995f7-5bb9-4ab8-9564-30b94c2ad61f service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:50.676913 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d995f7-5bb9-4ab8-9564-30b94c2ad61f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:50.695849 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d995f7-5bb9-4ab8-9564-30b94c2ad61f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:50.718572 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d995f7-5bb9-4ab8-9564-30b94c2ad61f service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:50.754023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 893/1772] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:51.650763 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1e83b-7657-4c00-a946-682c8133cae4 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:51.651708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1e83b-7657-4c00-a946-682c8133cae4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:51.652151 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1e83b-7657-4c00-a946-682c8133cae4 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:51.654234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 880/1773] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:34:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:34:51.730091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926533d-ea85-4abd-aec1-30acb7ffef2e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:51.730695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926533d-ea85-4abd-aec1-30acb7ffef2e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:51.730695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926533d-ea85-4abd-aec1-30acb7ffef2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:51.806474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1926533d-ea85-4abd-aec1-30acb7ffef2e None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:51.809714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1926533d-ea85-4abd-aec1-30acb7ffef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:52.028236 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:52.152385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 894/1774] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:34:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:52.365021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322637d3-1922-4a5c-a847-68ef55c104ba None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:52.367012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322637d3-1922-4a5c-a847-68ef55c104ba None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:52.370054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322637d3-1922-4a5c-a847-68ef55c104ba None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:52.383929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 881/1775] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:34:52 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:34:52.470796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75570d50-e7ee-4e84-8804-984322749afa None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:52.482146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75570d50-e7ee-4e84-8804-984322749afa None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:52.482146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75570d50-e7ee-4e84-8804-984322749afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:52.535810 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322637d3-1922-4a5c-a847-68ef55c104ba None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:52.538243 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-322637d3-1922-4a5c-a847-68ef55c104ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:52.567205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322637d3-1922-4a5c-a847-68ef55c104ba None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:52.571007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-75570d50-e7ee-4e84-8804-984322749afa None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:52.588328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8070cc-09cb-4b64-99d4-f2255b90b7a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:52.593264 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8070cc-09cb-4b64-99d4-f2255b90b7a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:52.593779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8070cc-09cb-4b64-99d4-f2255b90b7a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:52.595930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8070cc-09cb-4b64-99d4-f2255b90b7a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:52.600141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-75570d50-e7ee-4e84-8804-984322749afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:52.602629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bd8070cc-09cb-4b64-99d4-f2255b90b7a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:52.644957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 895/1776] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:52.808558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8070cc-09cb-4b64-99d4-f2255b90b7a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:52.810705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8070cc-09cb-4b64-99d4-f2255b90b7a2 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:52.822821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 882/1777] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:54.470477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75570d50-e7ee-4e84-8804-984322749afa None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:54.472545 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-75570d50-e7ee-4e84-8804-984322749afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:54.513390 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75570d50-e7ee-4e84-8804-984322749afa None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:54.542478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0feec8c-7b50-4322-bfcc-f3ce03c9ed49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:54.543263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feec8c-7b50-4322-bfcc-f3ce03c9ed49 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:54.543626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feec8c-7b50-4322-bfcc-f3ce03c9ed49 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:54.543740 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feec8c-7b50-4322-bfcc-f3ce03c9ed49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:54.585066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0feec8c-7b50-4322-bfcc-f3ce03c9ed49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:54.587375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0feec8c-7b50-4322-bfcc-f3ce03c9ed49 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:54.634576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 896/1778] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:54.923018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8070cc-09cb-4b64-99d4-f2255b90b7a2 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:54.953681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8070cc-09cb-4b64-99d4-f2255b90b7a2 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:54.974772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ec512-9ba0-428e-aa03-5e8a3fa09d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:54.977484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec512-9ba0-428e-aa03-5e8a3fa09d78 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:54.979385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec512-9ba0-428e-aa03-5e8a3fa09d78 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:54.980653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec512-9ba0-428e-aa03-5e8a3fa09d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:55.036917 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ec512-9ba0-428e-aa03-5e8a3fa09d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:55.043075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ec512-9ba0-428e-aa03-5e8a3fa09d78 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:55.107767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 883/1779] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:55.594933 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0feec8c-7b50-4322-bfcc-f3ce03c9ed49 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:55.596902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a0feec8c-7b50-4322-bfcc-f3ce03c9ed49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:55.659213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0feec8c-7b50-4322-bfcc-f3ce03c9ed49 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:55.677881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:55.678669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:55.678967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:55.679249 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] PATH_INFO: `/v3/projects/84a58ae55e3c4b05a35874f0439d6504` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:55.681207 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a58ae55e3c4b05a35874f0439d6504)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:55.689977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:55.827299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a58ae55e3c4b05a35874f0439d6504', 'request_id': 'req-bdd2922b-9811-44da-8e77-10a632f0e8b4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:55.848985 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a58ae55e3c4b05a35874f0439d6504', 'request_id': 'req-bdd2922b-9811-44da-8e77-10a632f0e8b4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:55.868935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a58ae55e3c4b05a35874f0439d6504', 'request_id': 'req-bdd2922b-9811-44da-8e77-10a632f0e8b4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:55.913140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] The token cache is being invalidate because project 84a58ae55e3c4b05a35874f0439d6504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:34:55.913947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:55.917028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:55.921314 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 897/1780] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:34:55 2022] DELETE /identity/v3/projects/84a58ae55e3c4b05a35874f0439d6504 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:55.925282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ec512-9ba0-428e-aa03-5e8a3fa09d78 service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:55.949560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ec512-9ba0-428e-aa03-5e8a3fa09d78 service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:56.075666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:56.076853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:56.077367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:56.077851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] PATH_INFO: `/v3/users/e98869a212f1429bb31f4e728d4da38e` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:56.079434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e98869a212f1429bb31f4e728d4da38e)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:56.082269 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:56.244969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98869a212f1429bb31f4e728d4da38e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:56.278271 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98869a212f1429bb31f4e728d4da38e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:56.304670 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98869a212f1429bb31f4e728d4da38e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:56.306365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98869a212f1429bb31f4e728d4da38e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:56.308037 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98869a212f1429bb31f4e728d4da38e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:56.312020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:56.429335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 884/1781] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:34:55 2022] DELETE /identity/v3/users/e98869a212f1429bb31f4e728d4da38e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:57.648000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:57.649929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:57.666945 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2922b-9811-44da-8e77-10a632f0e8b4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:57.702220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:57.703675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:57.732008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccdb52-845a-4122-b45f-67e24b1ffebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:57.732675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccdb52-845a-4122-b45f-67e24b1ffebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:57.733382 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccdb52-845a-4122-b45f-67e24b1ffebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:57.733666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccdb52-845a-4122-b45f-67e24b1ffebd admin admin] PATH_INFO: `/v3/projects/81397a4da534400183bc9f521f03a40e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:57.736083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccdb52-845a-4122-b45f-67e24b1ffebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=81397a4da534400183bc9f521f03a40e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:57.738150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccdb52-845a-4122-b45f-67e24b1ffebd admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:57.779268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043964bb-fa8b-49d6-9a45-f3cfa20201e9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:57.796749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-38ccdb52-845a-4122-b45f-67e24b1ffebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81397a4da534400183bc9f521f03a40e', 'request_id': 'req-38ccdb52-845a-4122-b45f-67e24b1ffebd'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:57.799947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:57.805931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-38ccdb52-845a-4122-b45f-67e24b1ffebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81397a4da534400183bc9f521f03a40e', 'request_id': 'req-38ccdb52-845a-4122-b45f-67e24b1ffebd'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:57.814026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-38ccdb52-845a-4122-b45f-67e24b1ffebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81397a4da534400183bc9f521f03a40e', 'request_id': 'req-38ccdb52-845a-4122-b45f-67e24b1ffebd'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:57.830140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-38ccdb52-845a-4122-b45f-67e24b1ffebd admin admin] The token cache is being invalidate because project 81397a4da534400183bc9f521f03a40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:34:57.830516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-38ccdb52-845a-4122-b45f-67e24b1ffebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:57.831172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-38ccdb52-845a-4122-b45f-67e24b1ffebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:57.836661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 898/1782] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:34:57 2022] DELETE /identity/v3/projects/81397a4da534400183bc9f521f03a40e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:57.838970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc34d9-d1a9-4135-8fbc-3b20f3eb383e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:57.839355 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc34d9-d1a9-4135-8fbc-3b20f3eb383e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:57.839641 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc34d9-d1a9-4135-8fbc-3b20f3eb383e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:57.851393 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dbfd3-f2b3-46ff-8568-a9d46b364b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:57.852751 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dbfd3-f2b3-46ff-8568-a9d46b364b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:57.853188 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dbfd3-f2b3-46ff-8568-a9d46b364b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:57.853469 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dbfd3-f2b3-46ff-8568-a9d46b364b7b admin admin] PATH_INFO: `/v3/users/7c0d4a9d945d402f9ffaf63bb3ea9ab9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:57.854710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dbfd3-f2b3-46ff-8568-a9d46b364b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0d4a9d945d402f9ffaf63bb3ea9ab9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:57.857823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dbfd3-f2b3-46ff-8568-a9d46b364b7b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:57.863761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-46cc34d9-d1a9-4135-8fbc-3b20f3eb383e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:57.865003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-46cc34d9-d1a9-4135-8fbc-3b20f3eb383e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:57.877127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 899/1783] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:34:57.884895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832b743-d9eb-4037-8867-fe573255e327 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:57.885761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832b743-d9eb-4037-8867-fe573255e327 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:57.885761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832b743-d9eb-4037-8867-fe573255e327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:57.909941 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1832b743-d9eb-4037-8867-fe573255e327 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:57.911584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1832b743-d9eb-4037-8867-fe573255e327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:57.918903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-904dbfd3-f2b3-46ff-8568-a9d46b364b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0d4a9d945d402f9ffaf63bb3ea9ab9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:57.923185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 900/1784] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:57.927576 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-904dbfd3-f2b3-46ff-8568-a9d46b364b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0d4a9d945d402f9ffaf63bb3ea9ab9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:57.930913 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832b743-d9eb-4037-8867-fe573255e327 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:57.938363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-904dbfd3-f2b3-46ff-8568-a9d46b364b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0d4a9d945d402f9ffaf63bb3ea9ab9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:57.939058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-904dbfd3-f2b3-46ff-8568-a9d46b364b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0d4a9d945d402f9ffaf63bb3ea9ab9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:57.939732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-904dbfd3-f2b3-46ff-8568-a9d46b364b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0d4a9d945d402f9ffaf63bb3ea9ab9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:57.943005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832b743-d9eb-4037-8867-fe573255e327 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:57.949262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa9582-40b4-4df8-8d1f-7f4afd41bcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:57.950001 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa9582-40b4-4df8-8d1f-7f4afd41bcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:57.950361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa9582-40b4-4df8-8d1f-7f4afd41bcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:57.950799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa9582-40b4-4df8-8d1f-7f4afd41bcd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:57.951524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa9582-40b4-4df8-8d1f-7f4afd41bcd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:34:57.951667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa9582-40b4-4df8-8d1f-7f4afd41bcd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:57.953313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa9582-40b4-4df8-8d1f-7f4afd41bcd6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:57.964320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 885/1785] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:34:57 2022] DELETE /identity/v3/users/7c0d4a9d945d402f9ffaf63bb3ea9ab9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:34:57.971908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 901/1786] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:34:57.972703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10949347-bf54-4897-a342-a3fdc775b2ab None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:57.972703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10949347-bf54-4897-a342-a3fdc775b2ab None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:57.972703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10949347-bf54-4897-a342-a3fdc775b2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:57.974757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa9582-40b4-4df8-8d1f-7f4afd41bcd6 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:57.980084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-55fa9582-40b4-4df8-8d1f-7f4afd41bcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:58.002086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:58.003445 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa9582-40b4-4df8-8d1f-7f4afd41bcd6 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:58.013707 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-10949347-bf54-4897-a342-a3fdc775b2ab None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:58.016964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-10949347-bf54-4897-a342-a3fdc775b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:58.078156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8ad67-c7a0-4844-877a-8cb063689570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:58.079063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8ad67-c7a0-4844-877a-8cb063689570 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:58.079568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8ad67-c7a0-4844-877a-8cb063689570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:58.079939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8ad67-c7a0-4844-877a-8cb063689570 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:58.080744 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8ad67-c7a0-4844-877a-8cb063689570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:58.082665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8ad67-c7a0-4844-877a-8cb063689570 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:58.104365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 886/1787] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:58.123551 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10949347-bf54-4897-a342-a3fdc775b2ab None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:58.124188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 902/1788] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:57 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:58.125314 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8ad67-c7a0-4844-877a-8cb063689570 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:58.129702 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-10949347-bf54-4897-a342-a3fdc775b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:58.202138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10949347-bf54-4897-a342-a3fdc775b2ab None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:58.221717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8ad67-c7a0-4844-877a-8cb063689570 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:58.235609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc9f23-f81c-4070-869d-36e8ee73bf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:58.236408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc9f23-f81c-4070-869d-36e8ee73bf54 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:58.236752 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc9f23-f81c-4070-869d-36e8ee73bf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:58.237037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc9f23-f81c-4070-869d-36e8ee73bf54 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:58.238322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc9f23-f81c-4070-869d-36e8ee73bf54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:58.244063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc9f23-f81c-4070-869d-36e8ee73bf54 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:58.293083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 903/1789] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:58 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:58.293249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b1e8c-1860-4160-a9ee-19e294a6b9a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:58.293249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b1e8c-1860-4160-a9ee-19e294a6b9a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:58.293249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b1e8c-1860-4160-a9ee-19e294a6b9a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:58.293249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b1e8c-1860-4160-a9ee-19e294a6b9a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:58.294875 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc9f23-f81c-4070-869d-36e8ee73bf54 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:58.310537 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b1e8c-1860-4160-a9ee-19e294a6b9a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:58.311049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc9f23-f81c-4070-869d-36e8ee73bf54 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:58.313279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b1e8c-1860-4160-a9ee-19e294a6b9a6 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:58.316647 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de3b24-99e1-410b-96c4-b2d125465d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:58.317330 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de3b24-99e1-410b-96c4-b2d125465d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:58.317625 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de3b24-99e1-410b-96c4-b2d125465d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:58.317905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de3b24-99e1-410b-96c4-b2d125465d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:58.318641 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de3b24-99e1-410b-96c4-b2d125465d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:58.320322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de3b24-99e1-410b-96c4-b2d125465d61 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:58.325335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 887/1790] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:58.332114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 904/1791] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:58.338677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b1e8c-1860-4160-a9ee-19e294a6b9a6 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:58.350550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b1e8c-1860-4160-a9ee-19e294a6b9a6 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:58.362329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cd561-0230-4356-bc9d-32d61c1dee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:58.362976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cd561-0230-4356-bc9d-32d61c1dee7b admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:58.363266 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cd561-0230-4356-bc9d-32d61c1dee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:58.363549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cd561-0230-4356-bc9d-32d61c1dee7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:58.364346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cd561-0230-4356-bc9d-32d61c1dee7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:58.366476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cd561-0230-4356-bc9d-32d61c1dee7b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:58.384287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 888/1792] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:58.385874 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de3b24-99e1-410b-96c4-b2d125465d61 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:58.400117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de3b24-99e1-410b-96c4-b2d125465d61 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:58.406293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2350-c9c4-4d26-af89-bb1ab07ed7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:58.407294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2350-c9c4-4d26-af89-bb1ab07ed7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:58.407655 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2350-c9c4-4d26-af89-bb1ab07ed7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:58.408286 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2350-c9c4-4d26-af89-bb1ab07ed7e0 admin admin] PATH_INFO: `/v3/projects/4be00c2446104e1286159e5abb6d1733/users/6d36bc8116c8498ca05e59bd84bc4f9b/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:58.426845 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c2350-c9c4-4d26-af89-bb1ab07ed7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be00c2446104e1286159e5abb6d1733, user_id=6d36bc8116c8498ca05e59bd84bc4f9b, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:58.430067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c2350-c9c4-4d26-af89-bb1ab07ed7e0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:58.433242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:58.457495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 905/1793] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:58 2022] PUT /identity/v3/projects/4be00c2446104e1286159e5abb6d1733/users/6d36bc8116c8498ca05e59bd84bc4f9b/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:34:58.468640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b828-8460-40d9-b2b8-ec4223700e7b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:58.468934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b828-8460-40d9-b2b8-ec4223700e7b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:58.469222 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b828-8460-40d9-b2b8-ec4223700e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:58.502927 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-98a3b828-8460-40d9-b2b8-ec4223700e7b None None] MFA Rules not processed for user `6d36bc8116c8498ca05e59bd84bc4f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:58.504175 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-98a3b828-8460-40d9-b2b8-ec4223700e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:58.574070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:58.607402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 889/1794] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:58.612317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2350-c9c4-4d26-af89-bb1ab07ed7e0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:58.674404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b828-8460-40d9-b2b8-ec4223700e7b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:58.676147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-98a3b828-8460-40d9-b2b8-ec4223700e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:58.778992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2350-c9c4-4d26-af89-bb1ab07ed7e0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:58.783240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b828-8460-40d9-b2b8-ec4223700e7b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:58.785710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad189d-d5e8-4b90-a82e-99a507020979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:58.786435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad189d-d5e8-4b90-a82e-99a507020979 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:58.786854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad189d-d5e8-4b90-a82e-99a507020979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:58.787203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad189d-d5e8-4b90-a82e-99a507020979 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:58.787967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad189d-d5e8-4b90-a82e-99a507020979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:58.791460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad189d-d5e8-4b90-a82e-99a507020979 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:58.795883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c26f10-2d8e-4442-bc58-eda5200538c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:58.796890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c26f10-2d8e-4442-bc58-eda5200538c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:58.797382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c26f10-2d8e-4442-bc58-eda5200538c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:58.797845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c26f10-2d8e-4442-bc58-eda5200538c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:58.804182 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b9c26f10-2d8e-4442-bc58-eda5200538c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:58.848037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 906/1795] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:34:58 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:58.848037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad189d-d5e8-4b90-a82e-99a507020979 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:58.849072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-63ad189d-d5e8-4b90-a82e-99a507020979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:58.898276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c26f10-2d8e-4442-bc58-eda5200538c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:58.901100 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c26f10-2d8e-4442-bc58-eda5200538c4 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:58.915368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 890/1796] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:34:58.916346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c26f10-2d8e-4442-bc58-eda5200538c4 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:58.930107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c26f10-2d8e-4442-bc58-eda5200538c4 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:58.954470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad189d-d5e8-4b90-a82e-99a507020979 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:58.962620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:58.963368 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:58.964032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:58.964324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] PATH_INFO: `/v3/projects/e2cc505748684ee68e04124d8ba0e4b4` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:58.965541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2cc505748684ee68e04124d8ba0e4b4)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:58.967475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:59.032198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c7d8e-a8fb-4796-b928-079514a7c864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:59.033690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c7d8e-a8fb-4796-b928-079514a7c864 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:59.033690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c7d8e-a8fb-4796-b928-079514a7c864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:59.033957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c7d8e-a8fb-4796-b928-079514a7c864 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:59.035027 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c7d8e-a8fb-4796-b928-079514a7c864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:59.037318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c7d8e-a8fb-4796-b928-079514a7c864 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:59.077413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2cc505748684ee68e04124d8ba0e4b4', 'request_id': 'req-0b801762-95d1-4852-b943-7266c3b1375f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:59.080568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 891/1797] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:34:58 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:34:59.084749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c7d8e-a8fb-4796-b928-079514a7c864 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:59.088002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2cc505748684ee68e04124d8ba0e4b4', 'request_id': 'req-0b801762-95d1-4852-b943-7266c3b1375f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:59.098063 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c7d8e-a8fb-4796-b928-079514a7c864 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:59.098231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2cc505748684ee68e04124d8ba0e4b4', 'request_id': 'req-0b801762-95d1-4852-b943-7266c3b1375f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:59.120169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] The token cache is being invalidate because project e2cc505748684ee68e04124d8ba0e4b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:34:59.120466 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:59.123212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:59.131962 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 907/1798] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:34:58 2022] DELETE /identity/v3/projects/e2cc505748684ee68e04124d8ba0e4b4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:59.133904 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:59.135397 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:59.153356 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:59.159844 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:59.208562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6f961-2860-4c9e-b551-fab82137dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:59.210105 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6f961-2860-4c9e-b551-fab82137dc93 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:59.210508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6f961-2860-4c9e-b551-fab82137dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:59.211120 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6f961-2860-4c9e-b551-fab82137dc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:59.213583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6f961-2860-4c9e-b551-fab82137dc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:59.215234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6f961-2860-4c9e-b551-fab82137dc93 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:59.233962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 892/1799] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:34:59.240356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6f961-2860-4c9e-b551-fab82137dc93 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:59.245494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-aff6f961-2860-4c9e-b551-fab82137dc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:59.256881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b801762-95d1-4852-b943-7266c3b1375f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:59.259654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6f961-2860-4c9e-b551-fab82137dc93 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:59.264446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:59.265101 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:59.265981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:59.266108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4cf36-9b59-4a84-b45f-a41d91c7c622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:59.266202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] PATH_INFO: `/v3/users/03f051d009404c72a2cc81c85d3709d0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:59.266616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4cf36-9b59-4a84-b45f-a41d91c7c622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:59.266986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4cf36-9b59-4a84-b45f-a41d91c7c622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:59.267421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4cf36-9b59-4a84-b45f-a41d91c7c622 admin admin] PATH_INFO: `/v3/projects/cdf5ce91df8c43278e442fcaacdfe229/users/845985d6366a45b7bd7808ac03b8db06/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:59.267600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f051d009404c72a2cc81c85d3709d0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:59.270170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:59.287341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4cf36-9b59-4a84-b45f-a41d91c7c622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf5ce91df8c43278e442fcaacdfe229, user_id=845985d6366a45b7bd7808ac03b8db06, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:59.290651 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4cf36-9b59-4a84-b45f-a41d91c7c622 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:59.306922 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 893/1800] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:59 2022] PUT /identity/v3/projects/cdf5ce91df8c43278e442fcaacdfe229/users/845985d6366a45b7bd7808ac03b8db06/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:59.311311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4cf36-9b59-4a84-b45f-a41d91c7c622 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:59.340362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f051d009404c72a2cc81c85d3709d0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:59.348339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f051d009404c72a2cc81c85d3709d0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:59.356179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f051d009404c72a2cc81c85d3709d0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:59.356844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f051d009404c72a2cc81c85d3709d0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:59.357472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f051d009404c72a2cc81c85d3709d0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:34:59.379209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 908/1801] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:34:59 2022] DELETE /identity/v3/users/03f051d009404c72a2cc81c85d3709d0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:34:59.387613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4cf36-9b59-4a84-b45f-a41d91c7c622 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:59.460860 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5dd30-ab5f-4805-9b71-690cbad1c33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:59.462254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5dd30-ab5f-4805-9b71-690cbad1c33b admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:59.462543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5dd30-ab5f-4805-9b71-690cbad1c33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:59.462823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5dd30-ab5f-4805-9b71-690cbad1c33b admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:59.463533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5dd30-ab5f-4805-9b71-690cbad1c33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:59.465314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5dd30-ab5f-4805-9b71-690cbad1c33b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:59.495042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 894/1802] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:34:59.495465 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:59.497943 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:59.514100 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462607f9-8cf8-4806-8468-cb401a6dd08f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:59.519351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57aaf19-bd2c-44d8-9fb0-218844336657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:59.520141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57aaf19-bd2c-44d8-9fb0-218844336657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:59.520454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57aaf19-bd2c-44d8-9fb0-218844336657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:59.520750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57aaf19-bd2c-44d8-9fb0-218844336657 admin admin] PATH_INFO: `/v3/projects/cdf5ce91df8c43278e442fcaacdfe229/users/845985d6366a45b7bd7808ac03b8db06/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:59.522753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57aaf19-bd2c-44d8-9fb0-218844336657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf5ce91df8c43278e442fcaacdfe229, user_id=845985d6366a45b7bd7808ac03b8db06, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:59.532519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57aaf19-bd2c-44d8-9fb0-218844336657 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:59.549250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 909/1803] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:34:59 2022] PUT /identity/v3/projects/cdf5ce91df8c43278e442fcaacdfe229/users/845985d6366a45b7bd7808ac03b8db06/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:34:59.562684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aca50b-e58c-4b42-be18-d54d8aed0b11 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:59.562967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aca50b-e58c-4b42-be18-d54d8aed0b11 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:59.563258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aca50b-e58c-4b42-be18-d54d8aed0b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:59.601355 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-55aca50b-e58c-4b42-be18-d54d8aed0b11 None None] MFA Rules not processed for user `845985d6366a45b7bd7808ac03b8db06`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:34:59.602848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-55aca50b-e58c-4b42-be18-d54d8aed0b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:59.673962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:34:59.721164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 895/1804] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:34:59.734003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57aaf19-bd2c-44d8-9fb0-218844336657 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:59.736583 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f57aaf19-bd2c-44d8-9fb0-218844336657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:34:59.828817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57aaf19-bd2c-44d8-9fb0-218844336657 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:34:59.834014 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3e3b3-761f-4143-855e-66de4b8cc998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:34:59.835118 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3e3b3-761f-4143-855e-66de4b8cc998 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:34:59.835589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3e3b3-761f-4143-855e-66de4b8cc998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:34:59.836285 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3e3b3-761f-4143-855e-66de4b8cc998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:34:59.852525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3e3b3-761f-4143-855e-66de4b8cc998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:34:59.854191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3e3b3-761f-4143-855e-66de4b8cc998 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:34:59.865323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 910/1805] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:34:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:34:59.944080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aca50b-e58c-4b42-be18-d54d8aed0b11 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:59.987836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3e3b3-761f-4143-855e-66de4b8cc998 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:34:59.989639 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-96b3e3b3-761f-4143-855e-66de4b8cc998 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:00.022008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:00.047302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aca50b-e58c-4b42-be18-d54d8aed0b11 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:00.053268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8049ad-7f48-4728-a678-815e72d93723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:00.054241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8049ad-7f48-4728-a678-815e72d93723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.055417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8049ad-7f48-4728-a678-815e72d93723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.055936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8049ad-7f48-4728-a678-815e72d93723 admin admin] PATH_INFO: `/v3/users/6d36bc8116c8498ca05e59bd84bc4f9b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.057456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8049ad-7f48-4728-a678-815e72d93723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d36bc8116c8498ca05e59bd84bc4f9b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:00.059709 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8049ad-7f48-4728-a678-815e72d93723 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:00.091184 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3e3b3-761f-4143-855e-66de4b8cc998 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:00.109724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41581d-0d3c-4c91-94ef-c913a92df42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:00.110737 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41581d-0d3c-4c91-94ef-c913a92df42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.111022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41581d-0d3c-4c91-94ef-c913a92df42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.112009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41581d-0d3c-4c91-94ef-c913a92df42b admin admin] PATH_INFO: `/v3/projects/76d5d27f6641485b8f63c41b2b0cad38` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.113219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41581d-0d3c-4c91-94ef-c913a92df42b admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d5d27f6641485b8f63c41b2b0cad38)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:00.115160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41581d-0d3c-4c91-94ef-c913a92df42b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:00.134991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f8049ad-7f48-4728-a678-815e72d93723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d36bc8116c8498ca05e59bd84bc4f9b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.144251 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f8049ad-7f48-4728-a678-815e72d93723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d36bc8116c8498ca05e59bd84bc4f9b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.153710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f8049ad-7f48-4728-a678-815e72d93723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d36bc8116c8498ca05e59bd84bc4f9b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.154597 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f8049ad-7f48-4728-a678-815e72d93723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d36bc8116c8498ca05e59bd84bc4f9b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.155162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5f8049ad-7f48-4728-a678-815e72d93723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d36bc8116c8498ca05e59bd84bc4f9b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.173911 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ee41581d-0d3c-4c91-94ef-c913a92df42b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d5d27f6641485b8f63c41b2b0cad38', 'request_id': 'req-ee41581d-0d3c-4c91-94ef-c913a92df42b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.183639 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ee41581d-0d3c-4c91-94ef-c913a92df42b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d5d27f6641485b8f63c41b2b0cad38', 'request_id': 'req-ee41581d-0d3c-4c91-94ef-c913a92df42b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.185149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 896/1806] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:34:59 2022] DELETE /identity/v3/users/6d36bc8116c8498ca05e59bd84bc4f9b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:00.189442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6da5b6-51ee-4424-bcf6-f46f909ebe37 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.189920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6da5b6-51ee-4424-bcf6-f46f909ebe37 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.190123 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6da5b6-51ee-4424-bcf6-f46f909ebe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.191711 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ee41581d-0d3c-4c91-94ef-c913a92df42b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d5d27f6641485b8f63c41b2b0cad38', 'request_id': 'req-ee41581d-0d3c-4c91-94ef-c913a92df42b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.210306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ee41581d-0d3c-4c91-94ef-c913a92df42b admin admin] The token cache is being invalidate because project 76d5d27f6641485b8f63c41b2b0cad38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:00.210755 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ee41581d-0d3c-4c91-94ef-c913a92df42b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.211459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ee41581d-0d3c-4c91-94ef-c913a92df42b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.213549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 911/1807] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:34:59 2022] DELETE /identity/v3/projects/76d5d27f6641485b8f63c41b2b0cad38 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:00.218698 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4b6da5b6-51ee-4424-bcf6-f46f909ebe37 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:00.220309 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4b6da5b6-51ee-4424-bcf6-f46f909ebe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:00.223418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e265e4-cc89-4be7-823d-5473fd31a8b6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.224718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e265e4-cc89-4be7-823d-5473fd31a8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.225112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e265e4-cc89-4be7-823d-5473fd31a8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.259787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-52e265e4-cc89-4be7-823d-5473fd31a8b6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:00.261030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-52e265e4-cc89-4be7-823d-5473fd31a8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:00.292779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:00.326608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 897/1808] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:00.334941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6da5b6-51ee-4424-bcf6-f46f909ebe37 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:00.337372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4b6da5b6-51ee-4424-bcf6-f46f909ebe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:00.356134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 912/1809] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:00.366927 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ae862-3fff-463c-924f-d3118cb95105 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.367774 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ae862-3fff-463c-924f-d3118cb95105 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.368261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ae862-3fff-463c-924f-d3118cb95105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.393196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8f1ae862-3fff-463c-924f-d3118cb95105 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:00.394485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8f1ae862-3fff-463c-924f-d3118cb95105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:00.412405 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 913/1810] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:00.415909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ae862-3fff-463c-924f-d3118cb95105 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:00.421252 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6da5b6-51ee-4424-bcf6-f46f909ebe37 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:00.425689 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3d41c-1ae4-455e-a876-2626f3c93e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:00.426531 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d41c-1ae4-455e-a876-2626f3c93e6e service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.426914 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d41c-1ae4-455e-a876-2626f3c93e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.427290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d41c-1ae4-455e-a876-2626f3c93e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.434725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ae862-3fff-463c-924f-d3118cb95105 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:00.445793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3d41c-1ae4-455e-a876-2626f3c93e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:00.447457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3d41c-1ae4-455e-a876-2626f3c93e6e service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:00.453207 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4ba4f-233d-414a-b250-6f846b4278e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:00.453844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4ba4f-233d-414a-b250-6f846b4278e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.454125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4ba4f-233d-414a-b250-6f846b4278e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.454402 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4ba4f-233d-414a-b250-6f846b4278e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.455137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4ba4f-233d-414a-b250-6f846b4278e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:00.455446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4ba4f-233d-414a-b250-6f846b4278e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:00.457349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4ba4f-233d-414a-b250-6f846b4278e8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:00.464657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 898/1811] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:35:00.479895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 914/1812] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:00.484351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3d41c-1ae4-455e-a876-2626f3c93e6e service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:00.495389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3d41c-1ae4-455e-a876-2626f3c93e6e service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:00.500440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50897c8f-ee85-46cb-93e6-b22d18d05392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:00.501063 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897c8f-ee85-46cb-93e6-b22d18d05392 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.501343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897c8f-ee85-46cb-93e6-b22d18d05392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.501616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897c8f-ee85-46cb-93e6-b22d18d05392 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.502283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50897c8f-ee85-46cb-93e6-b22d18d05392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:00.504279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50897c8f-ee85-46cb-93e6-b22d18d05392 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:00.535904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 899/1813] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:00 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:00.538812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4ba4f-233d-414a-b250-6f846b4278e8 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:00.553459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4ba4f-233d-414a-b250-6f846b4278e8 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:00.584823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:00.612467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50897c8f-ee85-46cb-93e6-b22d18d05392 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:00.616166 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-50897c8f-ee85-46cb-93e6-b22d18d05392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:00.627457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c08167-c727-451e-a313-ced79e08baef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:00.628227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c08167-c727-451e-a313-ced79e08baef admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.628751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c08167-c727-451e-a313-ced79e08baef admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.629042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c08167-c727-451e-a313-ced79e08baef admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.629717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c08167-c727-451e-a313-ced79e08baef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:00.631649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c08167-c727-451e-a313-ced79e08baef admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:00.664072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 915/1814] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:00 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:00.668321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c08167-c727-451e-a313-ced79e08baef admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:00.680145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c08167-c727-451e-a313-ced79e08baef admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:00.684813 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59007338-501e-4906-88f9-d43e8164a209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:00.685572 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59007338-501e-4906-88f9-d43e8164a209 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.686317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59007338-501e-4906-88f9-d43e8164a209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.686317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59007338-501e-4906-88f9-d43e8164a209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.686865 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59007338-501e-4906-88f9-d43e8164a209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:00.688542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59007338-501e-4906-88f9-d43e8164a209 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:00.696791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50897c8f-ee85-46cb-93e6-b22d18d05392 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:00.700979 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 916/1815] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:00.701984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc725c2-1368-45c9-8ffb-ed253bf63f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:00.702704 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc725c2-1368-45c9-8ffb-ed253bf63f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.703056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc725c2-1368-45c9-8ffb-ed253bf63f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.703399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc725c2-1368-45c9-8ffb-ed253bf63f0f admin admin] PATH_INFO: `/v3/users/9f9f6f78132e4f5db9f0d4d667812a1d` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.704916 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc725c2-1368-45c9-8ffb-ed253bf63f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f9f6f78132e4f5db9f0d4d667812a1d)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:00.705342 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59007338-501e-4906-88f9-d43e8164a209 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:00.707330 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc725c2-1368-45c9-8ffb-ed253bf63f0f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:00.716306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59007338-501e-4906-88f9-d43e8164a209 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:00.721545 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8fa05-cece-44b8-ac0b-44a37c852c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:00.722170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8fa05-cece-44b8-ac0b-44a37c852c7a admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.722461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8fa05-cece-44b8-ac0b-44a37c852c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.722741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8fa05-cece-44b8-ac0b-44a37c852c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.723439 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8fa05-cece-44b8-ac0b-44a37c852c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:00.725071 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8fa05-cece-44b8-ac0b-44a37c852c7a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:00.737102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 917/1816] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:00.741371 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8fa05-cece-44b8-ac0b-44a37c852c7a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:00.754086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8fa05-cece-44b8-ac0b-44a37c852c7a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:00.759453 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dded6e6-ee1c-42b1-90ae-fe1e702b743d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:00.760831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bfc725c2-1368-45c9-8ffb-ed253bf63f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f9f6f78132e4f5db9f0d4d667812a1d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.761304 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dded6e6-ee1c-42b1-90ae-fe1e702b743d admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.761816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dded6e6-ee1c-42b1-90ae-fe1e702b743d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.762839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dded6e6-ee1c-42b1-90ae-fe1e702b743d admin admin] PATH_INFO: `/v3/projects/8424c5abd70e424fbbc834f34ddb90d2/users/d1cca937517141c8870ce66761ca20a2/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.769068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bfc725c2-1368-45c9-8ffb-ed253bf63f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f9f6f78132e4f5db9f0d4d667812a1d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.780275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bfc725c2-1368-45c9-8ffb-ed253bf63f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f9f6f78132e4f5db9f0d4d667812a1d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.780946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bfc725c2-1368-45c9-8ffb-ed253bf63f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f9f6f78132e4f5db9f0d4d667812a1d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.781077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dded6e6-ee1c-42b1-90ae-fe1e702b743d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8424c5abd70e424fbbc834f34ddb90d2, user_id=d1cca937517141c8870ce66761ca20a2, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:00.781621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-bfc725c2-1368-45c9-8ffb-ed253bf63f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f9f6f78132e4f5db9f0d4d667812a1d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:00.783951 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dded6e6-ee1c-42b1-90ae-fe1e702b743d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:00.790708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:00.800571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 918/1817] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:00 2022] PUT /identity/v3/projects/8424c5abd70e424fbbc834f34ddb90d2/users/d1cca937517141c8870ce66761ca20a2/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:00.801685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dded6e6-ee1c-42b1-90ae-fe1e702b743d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:00.803309 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6dded6e6-ee1c-42b1-90ae-fe1e702b743d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:00.808065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 900/1818] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:00 2022] DELETE /identity/v3/users/9f9f6f78132e4f5db9f0d4d667812a1d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:00.812461 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119265-b135-44a6-b67b-22be3c3333d3 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.812748 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119265-b135-44a6-b67b-22be3c3333d3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.813052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119265-b135-44a6-b67b-22be3c3333d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.850848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-05119265-b135-44a6-b67b-22be3c3333d3 None None] MFA Rules not processed for user `d1cca937517141c8870ce66761ca20a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:00.852629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-05119265-b135-44a6-b67b-22be3c3333d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:00.876675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dded6e6-ee1c-42b1-90ae-fe1e702b743d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:00.923068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 901/1819] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:00.923068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a855e53-04c4-4c91-9967-71dd933ec490 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.923068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a855e53-04c4-4c91-9967-71dd933ec490 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.923068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a855e53-04c4-4c91-9967-71dd933ec490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.937457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:00.938187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.938546 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.939290 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] PATH_INFO: `/v3/projects/4be00c2446104e1286159e5abb6d1733` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.940784 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be00c2446104e1286159e5abb6d1733)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:00.943105 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:00.943445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6a855e53-04c4-4c91-9967-71dd933ec490 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:00.944879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6a855e53-04c4-4c91-9967-71dd933ec490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:00.956741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 902/1820] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:00.956741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a855e53-04c4-4c91-9967-71dd933ec490 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:00.959307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6a855e53-04c4-4c91-9967-71dd933ec490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:00.974609 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a855e53-04c4-4c91-9967-71dd933ec490 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:00.980596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686be13-db0c-4147-b48c-6b0c9f491623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:00.981387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686be13-db0c-4147-b48c-6b0c9f491623 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:00.981819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686be13-db0c-4147-b48c-6b0c9f491623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:00.982100 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686be13-db0c-4147-b48c-6b0c9f491623 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:00.982768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686be13-db0c-4147-b48c-6b0c9f491623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:00.983896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:00.984826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686be13-db0c-4147-b48c-6b0c9f491623 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:01.016882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 903/1821] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:00 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:01.017907 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686be13-db0c-4147-b48c-6b0c9f491623 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:01.018887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be00c2446104e1286159e5abb6d1733', 'request_id': 'req-8a84fcce-b78e-4238-9de5-677875beab98'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.022185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e686be13-db0c-4147-b48c-6b0c9f491623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:01.029875 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be00c2446104e1286159e5abb6d1733', 'request_id': 'req-8a84fcce-b78e-4238-9de5-677875beab98'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.044325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be00c2446104e1286159e5abb6d1733', 'request_id': 'req-8a84fcce-b78e-4238-9de5-677875beab98'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.067646 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] The token cache is being invalidate because project 4be00c2446104e1286159e5abb6d1733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:01.068089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.068648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.072591 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 919/1822] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:00 2022] DELETE /identity/v3/projects/4be00c2446104e1286159e5abb6d1733 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:01.072965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:01.077755 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:01.111365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686be13-db0c-4147-b48c-6b0c9f491623 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:01.115608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3efcc-f75e-4e17-a81a-b845e0d7b61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:01.116419 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3efcc-f75e-4e17-a81a-b845e0d7b61e service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:01.116690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3efcc-f75e-4e17-a81a-b845e0d7b61e service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:01.116995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3efcc-f75e-4e17-a81a-b845e0d7b61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:01.119487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fdf3efcc-f75e-4e17-a81a-b845e0d7b61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:01.174336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84fcce-b78e-4238-9de5-677875beab98 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:01.206965 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3efcc-f75e-4e17-a81a-b845e0d7b61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:01.208527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3efcc-f75e-4e17-a81a-b845e0d7b61e service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:01.216624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:01.231606 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 904/1823] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:01.231839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3efcc-f75e-4e17-a81a-b845e0d7b61e service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:01.233723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fdf3efcc-f75e-4e17-a81a-b845e0d7b61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:01.256771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3efcc-f75e-4e17-a81a-b845e0d7b61e service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:01.265898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:01.266483 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:01.266764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:01.267039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] PATH_INFO: `/v3/users/845985d6366a45b7bd7808ac03b8db06` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:01.268270 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=845985d6366a45b7bd7808ac03b8db06)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:01.270470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:01.275448 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caee40-f70a-4701-9511-e3a5eca943b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:01.276914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caee40-f70a-4701-9511-e3a5eca943b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:01.279224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caee40-f70a-4701-9511-e3a5eca943b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:01.279622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caee40-f70a-4701-9511-e3a5eca943b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:01.280553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2caee40-f70a-4701-9511-e3a5eca943b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:01.283122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2caee40-f70a-4701-9511-e3a5eca943b0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:01.328272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 920/1824] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:01 2022] POST /identity/v3/users => generated 299 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:01.329916 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caee40-f70a-4701-9511-e3a5eca943b0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:01.345896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caee40-f70a-4701-9511-e3a5eca943b0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:01.352633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d334f1-0eb2-43c5-a0bf-9d9f632ae3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:01.353438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d334f1-0eb2-43c5-a0bf-9d9f632ae3ae admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:01.353806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d334f1-0eb2-43c5-a0bf-9d9f632ae3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:01.354183 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d334f1-0eb2-43c5-a0bf-9d9f632ae3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:01.355270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d334f1-0eb2-43c5-a0bf-9d9f632ae3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:01.357848 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d334f1-0eb2-43c5-a0bf-9d9f632ae3ae admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:01.379309 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 921/1825] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:01.380922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d334f1-0eb2-43c5-a0bf-9d9f632ae3ae admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:01.396322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d334f1-0eb2-43c5-a0bf-9d9f632ae3ae admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:01.405271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7836cf1-097f-4004-b9c1-c3feea80cfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:01.407002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845985d6366a45b7bd7808ac03b8db06'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.407177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7836cf1-097f-4004-b9c1-c3feea80cfd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:01.407712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7836cf1-097f-4004-b9c1-c3feea80cfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:01.408233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7836cf1-097f-4004-b9c1-c3feea80cfd4 admin admin] PATH_INFO: `/v3/projects/b395e03a11844eac906665fabfbe27a1/users/ba44bc20ce13455a9905bc75dc5c7106/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:01.425315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845985d6366a45b7bd7808ac03b8db06'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.438261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7836cf1-097f-4004-b9c1-c3feea80cfd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b395e03a11844eac906665fabfbe27a1, user_id=ba44bc20ce13455a9905bc75dc5c7106, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:01.439948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845985d6366a45b7bd7808ac03b8db06'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.440670 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845985d6366a45b7bd7808ac03b8db06'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.441375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845985d6366a45b7bd7808ac03b8db06'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.443523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7836cf1-097f-4004-b9c1-c3feea80cfd4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:01.467392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 922/1826] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:01 2022] PUT /identity/v3/projects/b395e03a11844eac906665fabfbe27a1/users/ba44bc20ce13455a9905bc75dc5c7106/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:01.472260 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7836cf1-097f-4004-b9c1-c3feea80cfd4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:01.474662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c7836cf1-097f-4004-b9c1-c3feea80cfd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:01.482541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 905/1827] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:01 2022] DELETE /identity/v3/users/845985d6366a45b7bd7808ac03b8db06 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:01.503851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:01.553228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:01.556837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:01.586902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7836cf1-097f-4004-b9c1-c3feea80cfd4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:01.669072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e1a32-043e-4bd1-8f07-fb2dd96a39bb admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:01.675499 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0da60c-927a-44cf-9968-5fe04dee19fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:01.676541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da60c-927a-44cf-9968-5fe04dee19fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:01.676939 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da60c-927a-44cf-9968-5fe04dee19fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:01.677885 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da60c-927a-44cf-9968-5fe04dee19fe admin admin] PATH_INFO: `/v3/users/7a2575edc50d435ab41fdc6a67892b5c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:01.679776 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0da60c-927a-44cf-9968-5fe04dee19fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2575edc50d435ab41fdc6a67892b5c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:01.684276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0da60c-927a-44cf-9968-5fe04dee19fe admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:01.688985 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df3c2-3d8f-42e8-b117-3ca426588294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:01.690551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df3c2-3d8f-42e8-b117-3ca426588294 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:01.691198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df3c2-3d8f-42e8-b117-3ca426588294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:01.692840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25df3c2-3d8f-42e8-b117-3ca426588294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:01.694462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25df3c2-3d8f-42e8-b117-3ca426588294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:01.696192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25df3c2-3d8f-42e8-b117-3ca426588294 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:01.736211 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 923/1828] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:01.740315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df3c2-3d8f-42e8-b117-3ca426588294 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:01.759581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25df3c2-3d8f-42e8-b117-3ca426588294 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:01.783701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d392b-327c-4ca5-b0d4-380989d6dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:01.784394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d392b-327c-4ca5-b0d4-380989d6dc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:01.784685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d392b-327c-4ca5-b0d4-380989d6dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:01.784970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d392b-327c-4ca5-b0d4-380989d6dc23 admin admin] PATH_INFO: `/v3/projects/b395e03a11844eac906665fabfbe27a1/users/ba44bc20ce13455a9905bc75dc5c7106/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:01.788818 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d392b-327c-4ca5-b0d4-380989d6dc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b395e03a11844eac906665fabfbe27a1, user_id=ba44bc20ce13455a9905bc75dc5c7106, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:01.792386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d392b-327c-4ca5-b0d4-380989d6dc23 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:01.796427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2e0da60c-927a-44cf-9968-5fe04dee19fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2575edc50d435ab41fdc6a67892b5c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.809651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 924/1829] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:01 2022] PUT /identity/v3/projects/b395e03a11844eac906665fabfbe27a1/users/ba44bc20ce13455a9905bc75dc5c7106/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:01.819588 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2e0da60c-927a-44cf-9968-5fe04dee19fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2575edc50d435ab41fdc6a67892b5c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.825033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a2d3-35f0-4fb1-a6c9-e77b05789521 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:01.825358 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a2d3-35f0-4fb1-a6c9-e77b05789521 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:01.825600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a2d3-35f0-4fb1-a6c9-e77b05789521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:01.839980 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2e0da60c-927a-44cf-9968-5fe04dee19fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2575edc50d435ab41fdc6a67892b5c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.840805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2e0da60c-927a-44cf-9968-5fe04dee19fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2575edc50d435ab41fdc6a67892b5c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.841501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2e0da60c-927a-44cf-9968-5fe04dee19fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2575edc50d435ab41fdc6a67892b5c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:01.858539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:01.872752 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-4173a2d3-35f0-4fb1-a6c9-e77b05789521 None None] MFA Rules not processed for user `ba44bc20ce13455a9905bc75dc5c7106`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:01.875185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4173a2d3-35f0-4fb1-a6c9-e77b05789521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:01.885822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 906/1830] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:01 2022] DELETE /identity/v3/users/7a2575edc50d435ab41fdc6a67892b5c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:01.888033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8802c-405e-47f3-bd61-56eeff093fee None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:01.889342 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8802c-405e-47f3-bd61-56eeff093fee None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:01.889847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8802c-405e-47f3-bd61-56eeff093fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:01.914002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-cce8802c-405e-47f3-bd61-56eeff093fee None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:01.916934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cce8802c-405e-47f3-bd61-56eeff093fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:02.005268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 907/1831] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:02.016538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 925/1832] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:02.030788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8802c-405e-47f3-bd61-56eeff093fee None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:02.030966 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173a2d3-35f0-4fb1-a6c9-e77b05789521 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:02.032931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cce8802c-405e-47f3-bd61-56eeff093fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:02.034202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4173a2d3-35f0-4fb1-a6c9-e77b05789521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:02.085519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:02.141695 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8802c-405e-47f3-bd61-56eeff093fee None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:02.169011 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173a2d3-35f0-4fb1-a6c9-e77b05789521 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:02.177381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec1028-e019-4c18-8834-521bb918da92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:02.182001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec1028-e019-4c18-8834-521bb918da92 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:02.182472 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec1028-e019-4c18-8834-521bb918da92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:02.184360 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec1028-e019-4c18-8834-521bb918da92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:02.261853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8213f-d1ad-42fd-99b1-8b424015765a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:02.262990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8213f-d1ad-42fd-99b1-8b424015765a service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:02.263787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8213f-d1ad-42fd-99b1-8b424015765a service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:02.263787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8213f-d1ad-42fd-99b1-8b424015765a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:02.282250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8213f-d1ad-42fd-99b1-8b424015765a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:02.283957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8213f-d1ad-42fd-99b1-8b424015765a service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:02.301650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 926/1833] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:02.317509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec1028-e019-4c18-8834-521bb918da92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:02.320147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec1028-e019-4c18-8834-521bb918da92 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:02.341480 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 908/1834] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:02.401428 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8213f-d1ad-42fd-99b1-8b424015765a service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:02.404898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-17d8213f-d1ad-42fd-99b1-8b424015765a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:02.432562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8213f-d1ad-42fd-99b1-8b424015765a service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:02.439941 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd5ae2-7046-4b86-9d3a-1e983c6ed675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:02.441147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd5ae2-7046-4b86-9d3a-1e983c6ed675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:02.441621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd5ae2-7046-4b86-9d3a-1e983c6ed675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:02.442121 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd5ae2-7046-4b86-9d3a-1e983c6ed675 admin admin] PATH_INFO: `/v3/users/d1cca937517141c8870ce66761ca20a2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:02.444370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd5ae2-7046-4b86-9d3a-1e983c6ed675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1cca937517141c8870ce66761ca20a2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:02.448892 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd5ae2-7046-4b86-9d3a-1e983c6ed675 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:02.493774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec1028-e019-4c18-8834-521bb918da92 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:02.495421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-70ec1028-e019-4c18-8834-521bb918da92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:02.524622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec1028-e019-4c18-8834-521bb918da92 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:02.528259 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6cbd5ae2-7046-4b86-9d3a-1e983c6ed675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1cca937517141c8870ce66761ca20a2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:02.530877 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:02.531600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:02.532294 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:02.532580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] PATH_INFO: `/v3/projects/a5b4a31bdac9447baac7ab034437b8c0` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:02.533872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b4a31bdac9447baac7ab034437b8c0)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:02.535848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:02.538939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6cbd5ae2-7046-4b86-9d3a-1e983c6ed675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1cca937517141c8870ce66761ca20a2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:02.549629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6cbd5ae2-7046-4b86-9d3a-1e983c6ed675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1cca937517141c8870ce66761ca20a2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:02.551038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6cbd5ae2-7046-4b86-9d3a-1e983c6ed675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1cca937517141c8870ce66761ca20a2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:02.552081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6cbd5ae2-7046-4b86-9d3a-1e983c6ed675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1cca937517141c8870ce66761ca20a2'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:02.583670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 927/1835] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:02 2022] DELETE /identity/v3/users/d1cca937517141c8870ce66761ca20a2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:02.590807 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:02.591852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1a816-24d1-4837-9014-b764673e5670 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:02.593012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1a816-24d1-4837-9014-b764673e5670 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:02.593490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1a816-24d1-4837-9014-b764673e5670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:02.607594 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b4a31bdac9447baac7ab034437b8c0', 'request_id': 'req-5bed9942-08dd-484a-b649-a3c73d7e4b43'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:02.623390 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b5a1a816-24d1-4837-9014-b764673e5670 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:02.624814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b5a1a816-24d1-4837-9014-b764673e5670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:02.644058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b4a31bdac9447baac7ab034437b8c0', 'request_id': 'req-5bed9942-08dd-484a-b649-a3c73d7e4b43'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:02.663398 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b4a31bdac9447baac7ab034437b8c0', 'request_id': 'req-5bed9942-08dd-484a-b649-a3c73d7e4b43'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:02.695945 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] The token cache is being invalidate because project a5b4a31bdac9447baac7ab034437b8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:02.698116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:02.701035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:02.705141 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 909/1836] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:02 2022] DELETE /identity/v3/projects/a5b4a31bdac9447baac7ab034437b8c0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:02.710899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:02.710899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:02.831454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:02.868275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 928/1837] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:02.869560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1a816-24d1-4837-9014-b764673e5670 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:02.873630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b5a1a816-24d1-4837-9014-b764673e5670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:02.877301 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed9942-08dd-484a-b649-a3c73d7e4b43 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:02.888527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:02.889140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:02.889430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:02.889710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] PATH_INFO: `/v3/users/ef5b6ab062814fd197d12d7edb4fac06` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:02.890986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5b6ab062814fd197d12d7edb4fac06)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:02.893012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:02.897535 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1a816-24d1-4837-9014-b764673e5670 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:02.904892 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:02.905855 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:02.906354 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:02.906837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee admin admin] PATH_INFO: `/v3/projects/cdf5ce91df8c43278e442fcaacdfe229` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:02.908460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf5ce91df8c43278e442fcaacdfe229)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:02.914825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:02.975616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5b6ab062814fd197d12d7edb4fac06'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:02.982164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf5ce91df8c43278e442fcaacdfe229', 'request_id': 'req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:02.984184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5b6ab062814fd197d12d7edb4fac06'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:02.991111 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf5ce91df8c43278e442fcaacdfe229', 'request_id': 'req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:03.001280 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf5ce91df8c43278e442fcaacdfe229', 'request_id': 'req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:03.005361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5b6ab062814fd197d12d7edb4fac06'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:03.006307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5b6ab062814fd197d12d7edb4fac06'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:03.007695 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5b6ab062814fd197d12d7edb4fac06'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:03.037097 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 910/1838] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:02 2022] DELETE /identity/v3/users/ef5b6ab062814fd197d12d7edb4fac06 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:03.038784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:03.049195 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee admin admin] The token cache is being invalidate because project cdf5ce91df8c43278e442fcaacdfe229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:03.049762 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:03.052736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0251ca4-19c3-4834-9a9d-f0f36f0682ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:03.056705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:03.056918 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 929/1839] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:02 2022] DELETE /identity/v3/projects/cdf5ce91df8c43278e442fcaacdfe229 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:03.065013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c097ff-b9cf-4192-86e6-03c22a24e271 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:03.065324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c097ff-b9cf-4192-86e6-03c22a24e271 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:03.065703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c097ff-b9cf-4192-86e6-03c22a24e271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:03.091238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-83c097ff-b9cf-4192-86e6-03c22a24e271 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:03.092494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-83c097ff-b9cf-4192-86e6-03c22a24e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:03.125494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:03.147539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db41bd5-4e7c-4239-86d6-d9d8a1856bce admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:03.156586 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea84342-8af0-41df-9dd6-40c93c1b6bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:03.157370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea84342-8af0-41df-9dd6-40c93c1b6bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:03.157828 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea84342-8af0-41df-9dd6-40c93c1b6bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:03.158200 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea84342-8af0-41df-9dd6-40c93c1b6bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:03.160530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8ea84342-8af0-41df-9dd6-40c93c1b6bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:03.178404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 930/1840] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:03.186541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814d32f-f0db-4f30-8b2b-89393936d3b9 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:03.187650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814d32f-f0db-4f30-8b2b-89393936d3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:03.188206 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814d32f-f0db-4f30-8b2b-89393936d3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:03.216011 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8814d32f-f0db-4f30-8b2b-89393936d3b9 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:03.217393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8814d32f-f0db-4f30-8b2b-89393936d3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:03.227771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 931/1841] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:03.232038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814d32f-f0db-4f30-8b2b-89393936d3b9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:03.246672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814d32f-f0db-4f30-8b2b-89393936d3b9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:03.255035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139bc19-9480-4e97-8bd8-ee257bf12414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:03.255999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139bc19-9480-4e97-8bd8-ee257bf12414 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:03.256361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139bc19-9480-4e97-8bd8-ee257bf12414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:03.256713 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139bc19-9480-4e97-8bd8-ee257bf12414 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:03.257188 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea84342-8af0-41df-9dd6-40c93c1b6bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:03.257700 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139bc19-9480-4e97-8bd8-ee257bf12414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:03.258621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139bc19-9480-4e97-8bd8-ee257bf12414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:03.260689 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea84342-8af0-41df-9dd6-40c93c1b6bb4 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:03.261706 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139bc19-9480-4e97-8bd8-ee257bf12414 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:03.275709 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 911/1842] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:03.283550 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 932/1843] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:03.285102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea84342-8af0-41df-9dd6-40c93c1b6bb4 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:03.295689 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea84342-8af0-41df-9dd6-40c93c1b6bb4 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:03.300859 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb9edf-cdeb-46ca-a8c8-58bf73891705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:03.301236 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb9edf-cdeb-46ca-a8c8-58bf73891705 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:03.301522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb9edf-cdeb-46ca-a8c8-58bf73891705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:03.301795 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb9edf-cdeb-46ca-a8c8-58bf73891705 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:03.302660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb9edf-cdeb-46ca-a8c8-58bf73891705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:03.304610 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb9edf-cdeb-46ca-a8c8-58bf73891705 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:03.339618 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 912/1844] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:03 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:03.343448 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139bc19-9480-4e97-8bd8-ee257bf12414 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:03.363885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139bc19-9480-4e97-8bd8-ee257bf12414 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:03.446656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e4678-16d6-406b-bc4a-d70e5b96538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:03.447320 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e4678-16d6-406b-bc4a-d70e5b96538c admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:03.448031 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e4678-16d6-406b-bc4a-d70e5b96538c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:03.448374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e4678-16d6-406b-bc4a-d70e5b96538c admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:03.449290 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e4678-16d6-406b-bc4a-d70e5b96538c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:03.451486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e4678-16d6-406b-bc4a-d70e5b96538c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:03.461713 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:03.484801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb9edf-cdeb-46ca-a8c8-58bf73891705 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:03.486110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 933/1845] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:03 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:03.499721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb9edf-cdeb-46ca-a8c8-58bf73891705 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:03.506448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7328-3176-4441-8e73-02140892a303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:03.507185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7328-3176-4441-8e73-02140892a303 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:03.507476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7328-3176-4441-8e73-02140892a303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:03.507827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7328-3176-4441-8e73-02140892a303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:03.509572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e7328-3176-4441-8e73-02140892a303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:03.511223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e7328-3176-4441-8e73-02140892a303 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:03.528096 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 913/1846] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:03.530575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e4678-16d6-406b-bc4a-d70e5b96538c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:03.541231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e4678-16d6-406b-bc4a-d70e5b96538c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:03.553182 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fe1a5-9959-4c7f-a09d-5b8b380c3404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:03.553831 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fe1a5-9959-4c7f-a09d-5b8b380c3404 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:03.554116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fe1a5-9959-4c7f-a09d-5b8b380c3404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:03.554387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fe1a5-9959-4c7f-a09d-5b8b380c3404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:03.555623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fe1a5-9959-4c7f-a09d-5b8b380c3404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:03.557258 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fe1a5-9959-4c7f-a09d-5b8b380c3404 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:03.575735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7328-3176-4441-8e73-02140892a303 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:03.576267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 934/1847] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:03.589145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7328-3176-4441-8e73-02140892a303 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:03.595699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb7345-8160-4837-93fd-76f11fd18fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:03.596453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb7345-8160-4837-93fd-76f11fd18fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:03.596733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb7345-8160-4837-93fd-76f11fd18fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:03.597010 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb7345-8160-4837-93fd-76f11fd18fa6 admin admin] PATH_INFO: `/v3/projects/5414a5d7d1514c5485fae9162d188632/users/b6c150b3d26547a4a387fc9abc1bd3f8/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:03.621761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fe1a5-9959-4c7f-a09d-5b8b380c3404 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:03.623491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb7345-8160-4837-93fd-76f11fd18fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5414a5d7d1514c5485fae9162d188632, user_id=b6c150b3d26547a4a387fc9abc1bd3f8, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:03.625302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c52fe1a5-9959-4c7f-a09d-5b8b380c3404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:03.626623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb7345-8160-4837-93fd-76f11fd18fa6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:03.651447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fe1a5-9959-4c7f-a09d-5b8b380c3404 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:03.671601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 914/1848] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:03 2022] PUT /identity/v3/projects/5414a5d7d1514c5485fae9162d188632/users/b6c150b3d26547a4a387fc9abc1bd3f8/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:03.698299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adae172-c6a9-46c5-8cae-45d96b469e18 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:03.698599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adae172-c6a9-46c5-8cae-45d96b469e18 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:03.698886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adae172-c6a9-46c5-8cae-45d96b469e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:03.753994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7adae172-c6a9-46c5-8cae-45d96b469e18 None None] MFA Rules not processed for user `b6c150b3d26547a4a387fc9abc1bd3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:03.755235 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7adae172-c6a9-46c5-8cae-45d96b469e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:03.804400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:03.805300 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:03.805833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:03.806120 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] PATH_INFO: `/v3/projects/7d2966c49e994a13a35757718b7252c2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:03.808229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2966c49e994a13a35757718b7252c2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:03.810421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:03.886120 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2966c49e994a13a35757718b7252c2', 'request_id': 'req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:03.895659 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2966c49e994a13a35757718b7252c2', 'request_id': 'req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:03.903376 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2966c49e994a13a35757718b7252c2', 'request_id': 'req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:03.917980 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 915/1849] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:03.922106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adae172-c6a9-46c5-8cae-45d96b469e18 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:03.929578 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] The token cache is being invalidate because project 7d2966c49e994a13a35757718b7252c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:03.930468 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:03.932049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:03.935109 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 935/1850] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:03 2022] DELETE /identity/v3/projects/7d2966c49e994a13a35757718b7252c2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:03.939907 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:03.941648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:03.943762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adae172-c6a9-46c5-8cae-45d96b469e18 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:03.970946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:04.017135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f6440-3091-4df1-b0f3-7251747a1a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:04.017135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f6440-3091-4df1-b0f3-7251747a1a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:04.017961 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f6440-3091-4df1-b0f3-7251747a1a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:04.017961 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f6440-3091-4df1-b0f3-7251747a1a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:04.018442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f6440-3091-4df1-b0f3-7251747a1a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:04.021408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f6440-3091-4df1-b0f3-7251747a1a61 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:04.063697 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 916/1851] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:03 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:04.064478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f6440-3091-4df1-b0f3-7251747a1a61 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:04.066574 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c87f6440-3091-4df1-b0f3-7251747a1a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:04.069519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3305d-e689-44c5-8aa4-0dbd3d01d28a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:04.093641 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:04.162586 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f6440-3091-4df1-b0f3-7251747a1a61 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:04.165769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:04.166457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:04.166741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:04.167019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] PATH_INFO: `/v3/users/1d0a6e895fb844b287737eae05b9afae` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:04.168204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1d0fa-74c0-4e3e-b855-bb5ffd8eccdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:04.168447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0a6e895fb844b287737eae05b9afae)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:04.169178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1d0fa-74c0-4e3e-b855-bb5ffd8eccdb admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:04.169614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1d0fa-74c0-4e3e-b855-bb5ffd8eccdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:04.170036 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1d0fa-74c0-4e3e-b855-bb5ffd8eccdb admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:04.170396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:04.171012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1d0fa-74c0-4e3e-b855-bb5ffd8eccdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:04.173143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1d0fa-74c0-4e3e-b855-bb5ffd8eccdb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:04.198142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 917/1852] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:04 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:04.202441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1d0fa-74c0-4e3e-b855-bb5ffd8eccdb admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:04.213902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1d0fa-74c0-4e3e-b855-bb5ffd8eccdb admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:04.219134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fd80a-6a77-441e-b586-fb76ac0c3d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:04.220072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fd80a-6a77-441e-b586-fb76ac0c3d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:04.220574 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fd80a-6a77-441e-b586-fb76ac0c3d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:04.221084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fd80a-6a77-441e-b586-fb76ac0c3d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:04.221990 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fd80a-6a77-441e-b586-fb76ac0c3d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:04.224089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fd80a-6a77-441e-b586-fb76ac0c3d64 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:04.239453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 918/1853] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:04.243654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fd80a-6a77-441e-b586-fb76ac0c3d64 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:04.256949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fd80a-6a77-441e-b586-fb76ac0c3d64 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:04.264474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302897f-803b-4e76-8b4b-b6b4ea4ab544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:04.265723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302897f-803b-4e76-8b4b-b6b4ea4ab544 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:04.266466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302897f-803b-4e76-8b4b-b6b4ea4ab544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:04.266881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302897f-803b-4e76-8b4b-b6b4ea4ab544 admin admin] PATH_INFO: `/v3/projects/2dd4a3c7e1ac408a873ff8341171da23/users/545f555cc86f49879706ba7301a21c74/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:04.274664 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0a6e895fb844b287737eae05b9afae'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.288454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0a6e895fb844b287737eae05b9afae'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.289968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302897f-803b-4e76-8b4b-b6b4ea4ab544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd4a3c7e1ac408a873ff8341171da23, user_id=545f555cc86f49879706ba7301a21c74, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:04.294589 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302897f-803b-4e76-8b4b-b6b4ea4ab544 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:04.299720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0a6e895fb844b287737eae05b9afae'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.300978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0a6e895fb844b287737eae05b9afae'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.301669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0a6e895fb844b287737eae05b9afae'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.317345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 919/1854] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:04 2022] PUT /identity/v3/projects/2dd4a3c7e1ac408a873ff8341171da23/users/545f555cc86f49879706ba7301a21c74/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:04.321255 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302897f-803b-4e76-8b4b-b6b4ea4ab544 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:04.324659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7302897f-803b-4e76-8b4b-b6b4ea4ab544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:04.333947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 936/1855] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:03 2022] DELETE /identity/v3/users/1d0a6e895fb844b287737eae05b9afae => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:04.420872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:04.422811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:04.442383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302897f-803b-4e76-8b4b-b6b4ea4ab544 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:04.458308 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:04.575737 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48797de-74fa-499b-880d-1c57fecfb81d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:04.577056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778133b-c790-49b9-be50-1de69ea91635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:04.577702 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778133b-c790-49b9-be50-1de69ea91635 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:04.577989 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778133b-c790-49b9-be50-1de69ea91635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:04.578268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778133b-c790-49b9-be50-1de69ea91635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:04.579117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778133b-c790-49b9-be50-1de69ea91635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:04.580910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778133b-c790-49b9-be50-1de69ea91635 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:04.590230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:04.590920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:04.591213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:04.591499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] PATH_INFO: `/v3/projects/8424c5abd70e424fbbc834f34ddb90d2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:04.599038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8424c5abd70e424fbbc834f34ddb90d2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:04.601144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:04.607968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 920/1856] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:04.607968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778133b-c790-49b9-be50-1de69ea91635 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:04.615132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7778133b-c790-49b9-be50-1de69ea91635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:04.647657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778133b-c790-49b9-be50-1de69ea91635 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:04.662484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:04.663321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:04.664455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:04.669163 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] PATH_INFO: `/v3/projects/40c50c577f224cbdba2a40e8d191d9a4` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:04.672624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c50c577f224cbdba2a40e8d191d9a4)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:04.674563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:04.678433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:04.688799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8424c5abd70e424fbbc834f34ddb90d2', 'request_id': 'req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.704204 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8424c5abd70e424fbbc834f34ddb90d2', 'request_id': 'req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.719408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8424c5abd70e424fbbc834f34ddb90d2', 'request_id': 'req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.740607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] The token cache is being invalidate because project 8424c5abd70e424fbbc834f34ddb90d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:04.741960 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.743388 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.745171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 937/1857] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:04 2022] DELETE /identity/v3/projects/8424c5abd70e424fbbc834f34ddb90d2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:04.746187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:04.747752 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:04.819486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c50c577f224cbdba2a40e8d191d9a4', 'request_id': 'req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.838305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15bffb-7f2c-4a1d-9d93-76a7871f99fe admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:04.838626 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c50c577f224cbdba2a40e8d191d9a4', 'request_id': 'req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.849195 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c50c577f224cbdba2a40e8d191d9a4', 'request_id': 'req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.881825 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] The token cache is being invalidate because project 40c50c577f224cbdba2a40e8d191d9a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:04.881825 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.888629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:04.892278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 921/1858] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:04 2022] DELETE /identity/v3/projects/40c50c577f224cbdba2a40e8d191d9a4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:04.895735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:04.901354 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:04.927720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f119a60-05ed-4e43-8713-7bbefa8f61ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:04.928411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f119a60-05ed-4e43-8713-7bbefa8f61ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:04.928694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f119a60-05ed-4e43-8713-7bbefa8f61ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:04.929503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f119a60-05ed-4e43-8713-7bbefa8f61ac admin admin] PATH_INFO: `/v3/projects/2dd4a3c7e1ac408a873ff8341171da23/users/545f555cc86f49879706ba7301a21c74/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:04.931518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f119a60-05ed-4e43-8713-7bbefa8f61ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd4a3c7e1ac408a873ff8341171da23, user_id=545f555cc86f49879706ba7301a21c74, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:04.936542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f119a60-05ed-4e43-8713-7bbefa8f61ac admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:04.953164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 938/1859] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:04 2022] PUT /identity/v3/projects/2dd4a3c7e1ac408a873ff8341171da23/users/545f555cc86f49879706ba7301a21c74/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:04.964037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ba0a-5320-499c-a45f-e7f0df83bc10 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:04.964037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ba0a-5320-499c-a45f-e7f0df83bc10 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:04.964037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ba0a-5320-499c-a45f-e7f0df83bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:05.008388 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e2b3ba0a-5320-499c-a45f-e7f0df83bc10 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:05.009855 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e2b3ba0a-5320-499c-a45f-e7f0df83bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:05.076496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a977cb8-1652-4eb9-96b0-f05dad1eb8b4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:05.154483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 939/1860] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:05.154483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47c3c-6964-478e-9a17-42c7e1e637e7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:05.154483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47c3c-6964-478e-9a17-42c7e1e637e7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:05.154483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47c3c-6964-478e-9a17-42c7e1e637e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:05.163005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:05.210928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:05.223729 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198be71-5951-4fe6-a2f6-fe8b2b2f7806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:05.232516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198be71-5951-4fe6-a2f6-fe8b2b2f7806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:05.232802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198be71-5951-4fe6-a2f6-fe8b2b2f7806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:05.233090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198be71-5951-4fe6-a2f6-fe8b2b2f7806 admin admin] PATH_INFO: `/v3/users/ba44bc20ce13455a9905bc75dc5c7106` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:05.236208 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198be71-5951-4fe6-a2f6-fe8b2b2f7806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba44bc20ce13455a9905bc75dc5c7106)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:05.238517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198be71-5951-4fe6-a2f6-fe8b2b2f7806 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:05.241575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d6c47c3c-6964-478e-9a17-42c7e1e637e7 None None] MFA Rules not processed for user `545f555cc86f49879706ba7301a21c74`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:05.243112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d6c47c3c-6964-478e-9a17-42c7e1e637e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:05.353572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4198be71-5951-4fe6-a2f6-fe8b2b2f7806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba44bc20ce13455a9905bc75dc5c7106'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:05.368341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4198be71-5951-4fe6-a2f6-fe8b2b2f7806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba44bc20ce13455a9905bc75dc5c7106'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:05.374418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 940/1861] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:05.378892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4198be71-5951-4fe6-a2f6-fe8b2b2f7806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba44bc20ce13455a9905bc75dc5c7106'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:05.380793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4198be71-5951-4fe6-a2f6-fe8b2b2f7806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba44bc20ce13455a9905bc75dc5c7106'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:05.381029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1246b-9bbf-4736-9833-5b383a59afe4 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:05.381881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1246b-9bbf-4736-9833-5b383a59afe4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:05.381881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1246b-9bbf-4736-9833-5b383a59afe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:05.382058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-4198be71-5951-4fe6-a2f6-fe8b2b2f7806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba44bc20ce13455a9905bc75dc5c7106'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:05.405185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-eed1246b-9bbf-4736-9833-5b383a59afe4 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:05.406811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-eed1246b-9bbf-4736-9833-5b383a59afe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:05.423804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 941/1862] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:05.425073 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1246b-9bbf-4736-9833-5b383a59afe4 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:05.427016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-eed1246b-9bbf-4736-9833-5b383a59afe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:05.442298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 922/1863] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:04 2022] DELETE /identity/v3/users/ba44bc20ce13455a9905bc75dc5c7106 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:05.444187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198be71-5951-4fe6-a2f6-fe8b2b2f7806 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:05.547077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1246b-9bbf-4736-9833-5b383a59afe4 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:05.577310 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198be71-5951-4fe6-a2f6-fe8b2b2f7806 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:05.583882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f8799-3b5b-4cf6-a8c6-a9982b542964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:05.584883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f8799-3b5b-4cf6-a8c6-a9982b542964 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:05.585167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f8799-3b5b-4cf6-a8c6-a9982b542964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:05.585438 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f8799-3b5b-4cf6-a8c6-a9982b542964 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:05.586184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f8799-3b5b-4cf6-a8c6-a9982b542964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:05.586659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f8799-3b5b-4cf6-a8c6-a9982b542964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:05.589133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f8799-3b5b-4cf6-a8c6-a9982b542964 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:05.612048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 923/1864] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:05.616586 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f8799-3b5b-4cf6-a8c6-a9982b542964 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:05.634524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d50a6a-3859-4fe7-b72b-42ee5d2ee5b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:05.635173 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d50a6a-3859-4fe7-b72b-42ee5d2ee5b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:05.635457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d50a6a-3859-4fe7-b72b-42ee5d2ee5b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:05.635734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d50a6a-3859-4fe7-b72b-42ee5d2ee5b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:05.636087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f8799-3b5b-4cf6-a8c6-a9982b542964 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:05.637660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f1d50a6a-3859-4fe7-b72b-42ee5d2ee5b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:05.643311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7cd6c-3b32-4f39-ba86-36bedc0e9bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:05.644643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7cd6c-3b32-4f39-ba86-36bedc0e9bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:05.645152 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7cd6c-3b32-4f39-ba86-36bedc0e9bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:05.645941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7cd6c-3b32-4f39-ba86-36bedc0e9bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:05.648494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7cd6c-3b32-4f39-ba86-36bedc0e9bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:05.651678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7cd6c-3b32-4f39-ba86-36bedc0e9bb4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:05.705694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 924/1865] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:05 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:05.709710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7cd6c-3b32-4f39-ba86-36bedc0e9bb4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:05.766424 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:05.780836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d50a6a-3859-4fe7-b72b-42ee5d2ee5b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:05.782816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d50a6a-3859-4fe7-b72b-42ee5d2ee5b1 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:05.790394 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:05.814771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 942/1866] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:05.840891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7cd6c-3b32-4f39-ba86-36bedc0e9bb4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:05.848971 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a703be5-99bd-46b1-a71c-d7b5dd81c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:05.849793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a703be5-99bd-46b1-a71c-d7b5dd81c86b admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:05.850164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a703be5-99bd-46b1-a71c-d7b5dd81c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:05.850553 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a703be5-99bd-46b1-a71c-d7b5dd81c86b admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:05.852214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a703be5-99bd-46b1-a71c-d7b5dd81c86b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:05.855137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a703be5-99bd-46b1-a71c-d7b5dd81c86b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:05.866325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf39bb-5be1-4b00-b2ee-affa5bde970c None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:05.866793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf39bb-5be1-4b00-b2ee-affa5bde970c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:05.868707 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf39bb-5be1-4b00-b2ee-affa5bde970c None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:05.870313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 943/1867] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:35:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 16:35:05.901473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794e082-9aee-4cea-866b-6d7a2abf1450 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:05.901623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794e082-9aee-4cea-866b-6d7a2abf1450 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:05.901913 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794e082-9aee-4cea-866b-6d7a2abf1450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:05.920649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 925/1868] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:05 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:05.938352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a703be5-99bd-46b1-a71c-d7b5dd81c86b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:05.949026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e794e082-9aee-4cea-866b-6d7a2abf1450 None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:05.950296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e794e082-9aee-4cea-866b-6d7a2abf1450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:05.969741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a703be5-99bd-46b1-a71c-d7b5dd81c86b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:05.986390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69147565-9360-4706-9c28-08f1676efd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:05.987055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69147565-9360-4706-9c28-08f1676efd64 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:05.988997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69147565-9360-4706-9c28-08f1676efd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:05.989297 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69147565-9360-4706-9c28-08f1676efd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:05.991702 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69147565-9360-4706-9c28-08f1676efd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:05.995625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69147565-9360-4706-9c28-08f1676efd64 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:06.025997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 926/1869] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:06.025997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69147565-9360-4706-9c28-08f1676efd64 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:06.034476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-69147565-9360-4706-9c28-08f1676efd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:06.068460 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69147565-9360-4706-9c28-08f1676efd64 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:06.080716 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:06.081392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:06.081677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:06.081955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] PATH_INFO: `/v3/projects/3c8ee2185c464d81a9ab788f11c97d68` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:06.085710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8ee2185c464d81a9ab788f11c97d68)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:06.087814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:06.161831 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 944/1870] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:35:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:06.162888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794e082-9aee-4cea-866b-6d7a2abf1450 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:06.178671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794e082-9aee-4cea-866b-6d7a2abf1450 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:06.199690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb9bc7-62cd-43d2-9cce-707b112ecede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:06.201537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb9bc7-62cd-43d2-9cce-707b112ecede admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:06.205246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb9bc7-62cd-43d2-9cce-707b112ecede admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:06.205634 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb9bc7-62cd-43d2-9cce-707b112ecede admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:06.206451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb9bc7-62cd-43d2-9cce-707b112ecede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:06.208523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8ee2185c464d81a9ab788f11c97d68', 'request_id': 'req-99a02f24-3a6f-4239-86e3-ccf142b490da'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.210103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb9bc7-62cd-43d2-9cce-707b112ecede admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:06.220282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8ee2185c464d81a9ab788f11c97d68', 'request_id': 'req-99a02f24-3a6f-4239-86e3-ccf142b490da'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.229930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8ee2185c464d81a9ab788f11c97d68', 'request_id': 'req-99a02f24-3a6f-4239-86e3-ccf142b490da'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.247414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] The token cache is being invalidate because project 3c8ee2185c464d81a9ab788f11c97d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:06.247414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.248384 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.250310 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 927/1871] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:06 2022] DELETE /identity/v3/projects/3c8ee2185c464d81a9ab788f11c97d68 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:06.251090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:06.253013 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:06.257063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 945/1872] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:06.277317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb9bc7-62cd-43d2-9cce-707b112ecede admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:06.291204 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b9cb9bc7-62cd-43d2-9cce-707b112ecede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:06.335905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb9bc7-62cd-43d2-9cce-707b112ecede admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:06.390531 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a02f24-3a6f-4239-86e3-ccf142b490da admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:06.396126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:06.397280 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:06.397828 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:06.398427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] PATH_INFO: `/v3/projects/b395e03a11844eac906665fabfbe27a1` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:06.400999 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b395e03a11844eac906665fabfbe27a1)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:06.404073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:06.441778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf5ae7-fdd2-45c3-bea4-524fc77b4ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:06.442566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf5ae7-fdd2-45c3-bea4-524fc77b4ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:06.442943 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf5ae7-fdd2-45c3-bea4-524fc77b4ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:06.443434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf5ae7-fdd2-45c3-bea4-524fc77b4ad1 admin admin] PATH_INFO: `/v3/projects/120fbd63b71b49e8b0711584d7d72af0/users/350080219c5344e2909995ae86559edb/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:06.470550 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf5ae7-fdd2-45c3-bea4-524fc77b4ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120fbd63b71b49e8b0711584d7d72af0, user_id=350080219c5344e2909995ae86559edb, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:06.474164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf5ae7-fdd2-45c3-bea4-524fc77b4ad1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:06.494913 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:06.497553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 946/1873] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:06 2022] PUT /identity/v3/projects/120fbd63b71b49e8b0711584d7d72af0/users/350080219c5344e2909995ae86559edb/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:06.506737 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf5ae7-fdd2-45c3-bea4-524fc77b4ad1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:06.513233 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b395e03a11844eac906665fabfbe27a1', 'request_id': 'req-f2c560dd-4250-4865-a405-cff19f8392f1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.515708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-66bf5ae7-fdd2-45c3-bea4-524fc77b4ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:06.534455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b395e03a11844eac906665fabfbe27a1', 'request_id': 'req-f2c560dd-4250-4865-a405-cff19f8392f1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.544784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b395e03a11844eac906665fabfbe27a1', 'request_id': 'req-f2c560dd-4250-4865-a405-cff19f8392f1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.559622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] The token cache is being invalidate because project b395e03a11844eac906665fabfbe27a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:06.560673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.561727 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.567729 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 928/1874] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:06 2022] DELETE /identity/v3/projects/b395e03a11844eac906665fabfbe27a1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:06.569083 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:06.571691 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:06.609670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:06.620617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf5ae7-fdd2-45c3-bea4-524fc77b4ad1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:06.699690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c560dd-4250-4865-a405-cff19f8392f1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:06.703596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e539f-bd19-4ce2-ac82-e9aa5edcb71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:06.704029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e539f-bd19-4ce2-ac82-e9aa5edcb71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:06.704731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e539f-bd19-4ce2-ac82-e9aa5edcb71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:06.704731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e539f-bd19-4ce2-ac82-e9aa5edcb71c admin admin] PATH_INFO: `/v3/users/65f8190724db4a108c62c818b40ed5a7` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:06.705363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6693c01-0ab3-4341-b97c-6acc6e165715 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '545f555cc86f49879706ba7301a21c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dd4a3c7e1ac408a873ff8341171da23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:06.705731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e539f-bd19-4ce2-ac82-e9aa5edcb71c admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f8190724db4a108c62c818b40ed5a7)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:06.706174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6693c01-0ab3-4341-b97c-6acc6e165715 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:06.706565 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6693c01-0ab3-4341-b97c-6acc6e165715 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:06.707000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6693c01-0ab3-4341-b97c-6acc6e165715 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:06.707676 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6693c01-0ab3-4341-b97c-6acc6e165715 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:06.707810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e539f-bd19-4ce2-ac82-e9aa5edcb71c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:06.708418 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6693c01-0ab3-4341-b97c-6acc6e165715 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:06.710078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6693c01-0ab3-4341-b97c-6acc6e165715 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:06.729617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 929/1875] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:06.729617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530cf3-e629-4d26-8abf-64397ef2235f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:06.729617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530cf3-e629-4d26-8abf-64397ef2235f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:06.729617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530cf3-e629-4d26-8abf-64397ef2235f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:06.764098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-03530cf3-e629-4d26-8abf-64397ef2235f None None] MFA Rules not processed for user `350080219c5344e2909995ae86559edb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:06.764764 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1c5e539f-bd19-4ce2-ac82-e9aa5edcb71c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f8190724db4a108c62c818b40ed5a7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.765577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-03530cf3-e629-4d26-8abf-64397ef2235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:06.774629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1c5e539f-bd19-4ce2-ac82-e9aa5edcb71c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f8190724db4a108c62c818b40ed5a7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.782696 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1c5e539f-bd19-4ce2-ac82-e9aa5edcb71c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f8190724db4a108c62c818b40ed5a7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.783454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1c5e539f-bd19-4ce2-ac82-e9aa5edcb71c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f8190724db4a108c62c818b40ed5a7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.784174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1c5e539f-bd19-4ce2-ac82-e9aa5edcb71c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f8190724db4a108c62c818b40ed5a7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:06.807594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 947/1876] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:06 2022] DELETE /identity/v3/users/65f8190724db4a108c62c818b40ed5a7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:06.810660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fa08-3fc6-4604-b416-3fbeefa7a5a1 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:06.810660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fa08-3fc6-4604-b416-3fbeefa7a5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:06.810660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fa08-3fc6-4604-b416-3fbeefa7a5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:06.833566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c672fa08-3fc6-4604-b416-3fbeefa7a5a1 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:06.835295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c672fa08-3fc6-4604-b416-3fbeefa7a5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:06.848675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 930/1877] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:06.849742 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530cf3-e629-4d26-8abf-64397ef2235f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:06.851257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-03530cf3-e629-4d26-8abf-64397ef2235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:06.915323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:06.946536 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 948/1878] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:06.947511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672fa08-3fc6-4604-b416-3fbeefa7a5a1 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:06.948839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c672fa08-3fc6-4604-b416-3fbeefa7a5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:06.963815 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530cf3-e629-4d26-8abf-64397ef2235f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:06.987082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:07.051661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672fa08-3fc6-4604-b416-3fbeefa7a5a1 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:07.061232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217fe45-16ff-4f7f-bc5d-aab0fbe37ba2 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '545f555cc86f49879706ba7301a21c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dd4a3c7e1ac408a873ff8341171da23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:07.062602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217fe45-16ff-4f7f-bc5d-aab0fbe37ba2 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:07.063042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217fe45-16ff-4f7f-bc5d-aab0fbe37ba2 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:07.063494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217fe45-16ff-4f7f-bc5d-aab0fbe37ba2 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:07.064473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217fe45-16ff-4f7f-bc5d-aab0fbe37ba2 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:07.067175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217fe45-16ff-4f7f-bc5d-aab0fbe37ba2 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:07.067455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34eaae0-eb09-40ed-a0e0-976f5fb15595 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:07.068228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eaae0-eb09-40ed-a0e0-976f5fb15595 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:07.068627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eaae0-eb09-40ed-a0e0-976f5fb15595 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:07.069010 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eaae0-eb09-40ed-a0e0-976f5fb15595 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:07.071118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c34eaae0-eb09-40ed-a0e0-976f5fb15595 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:07.086921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34eaae0-eb09-40ed-a0e0-976f5fb15595 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:07.089881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34eaae0-eb09-40ed-a0e0-976f5fb15595 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:07.111684 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 949/1879] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:06 2022] POST /identity/v3/projects => generated 353 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:07.111938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 931/1880] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:07.111938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f5ecf-e69a-420b-af48-48310f4254a4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:07.111938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f5ecf-e69a-420b-af48-48310f4254a4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:07.111938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f5ecf-e69a-420b-af48-48310f4254a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:07.123391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217fe45-16ff-4f7f-bc5d-aab0fbe37ba2 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:07.125981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1217fe45-16ff-4f7f-bc5d-aab0fbe37ba2 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:07.147853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-807f5ecf-e69a-420b-af48-48310f4254a4 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:07.150127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-807f5ecf-e69a-420b-af48-48310f4254a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:07.239707 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217fe45-16ff-4f7f-bc5d-aab0fbe37ba2 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:07.247231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86c79d-749e-45ee-829e-152c3f518b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:07.248122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86c79d-749e-45ee-829e-152c3f518b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:07.248454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86c79d-749e-45ee-829e-152c3f518b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:07.248757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 932/1881] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:07.251843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86c79d-749e-45ee-829e-152c3f518b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:07.251843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86c79d-749e-45ee-829e-152c3f518b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:07.252789 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86c79d-749e-45ee-829e-152c3f518b2f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:07.253176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f5ecf-e69a-420b-af48-48310f4254a4 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:07.322459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 950/1882] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:07 2022] POST /identity/v3/projects => generated 371 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:07.331584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86c79d-749e-45ee-829e-152c3f518b2f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:07.334341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1e86c79d-749e-45ee-829e-152c3f518b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:07.374095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f5ecf-e69a-420b-af48-48310f4254a4 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:07.400268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:07.474187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762d81f-2d36-4d21-b4fa-e0a150bcf76d tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '545f555cc86f49879706ba7301a21c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dd4a3c7e1ac408a873ff8341171da23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:07.474832 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762d81f-2d36-4d21-b4fa-e0a150bcf76d tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:07.475292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762d81f-2d36-4d21-b4fa-e0a150bcf76d tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:07.475583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762d81f-2d36-4d21-b4fa-e0a150bcf76d tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:07.476324 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762d81f-2d36-4d21-b4fa-e0a150bcf76d tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:07.477195 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762d81f-2d36-4d21-b4fa-e0a150bcf76d tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:07.478896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762d81f-2d36-4d21-b4fa-e0a150bcf76d tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:07.490521 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86c79d-749e-45ee-829e-152c3f518b2f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:07.495072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 933/1883] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:07.495987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762d81f-2d36-4d21-b4fa-e0a150bcf76d tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:07.501103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:07.502035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:07.502535 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:07.503002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] PATH_INFO: `/v3/projects/edab5b2a1aa3481da220d37b17289dd9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:07.505250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edab5b2a1aa3481da220d37b17289dd9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:07.507935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:07.528599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762d81f-2d36-4d21-b4fa-e0a150bcf76d tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:07.542942 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba752b6-5273-46c5-bbf7-3b21e2a1cff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:07.543594 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba752b6-5273-46c5-bbf7-3b21e2a1cff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:07.544788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba752b6-5273-46c5-bbf7-3b21e2a1cff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:07.545113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba752b6-5273-46c5-bbf7-3b21e2a1cff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:07.546491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba752b6-5273-46c5-bbf7-3b21e2a1cff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:07.546808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba752b6-5273-46c5-bbf7-3b21e2a1cff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:07.550563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba752b6-5273-46c5-bbf7-3b21e2a1cff7 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:07.573140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:07.583137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 934/1884] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:07.583137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba752b6-5273-46c5-bbf7-3b21e2a1cff7 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:07.589533 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edab5b2a1aa3481da220d37b17289dd9', 'request_id': 'req-07337498-09fd-4462-b38a-4c8213c99a11'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:07.591822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba752b6-5273-46c5-bbf7-3b21e2a1cff7 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:07.596021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edab5b2a1aa3481da220d37b17289dd9', 'request_id': 'req-07337498-09fd-4462-b38a-4c8213c99a11'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:07.603267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edab5b2a1aa3481da220d37b17289dd9', 'request_id': 'req-07337498-09fd-4462-b38a-4c8213c99a11'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:07.621485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] The token cache is being invalidate because project edab5b2a1aa3481da220d37b17289dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:07.621786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:07.622988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:07.624907 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 951/1885] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:07 2022] DELETE /identity/v3/projects/edab5b2a1aa3481da220d37b17289dd9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:07.625684 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:07.626950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:07.678352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0028a-1189-485e-8b12-9db21e18a4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:07.684368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0028a-1189-485e-8b12-9db21e18a4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:07.684738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0028a-1189-485e-8b12-9db21e18a4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:07.685033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0028a-1189-485e-8b12-9db21e18a4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:07.685848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0028a-1189-485e-8b12-9db21e18a4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:07.691473 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0028a-1189-485e-8b12-9db21e18a4c6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:07.733322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 935/1886] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:07 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:07.733502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0028a-1189-485e-8b12-9db21e18a4c6 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:07.736881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cef0028a-1189-485e-8b12-9db21e18a4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:07.752813 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07337498-09fd-4462-b38a-4c8213c99a11 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:07.756163 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0028a-1189-485e-8b12-9db21e18a4c6 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:07.760563 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '545f555cc86f49879706ba7301a21c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dd4a3c7e1ac408a873ff8341171da23', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:07.761661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:07.762111 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:07.762570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] PATH_INFO: `/v3/projects/5abc6e5bf9124d279005fff733627824` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:07.762989 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc71ed-843e-4309-a3b9-0c6c45872a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:07.763633 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc71ed-843e-4309-a3b9-0c6c45872a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:07.764017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc71ed-843e-4309-a3b9-0c6c45872a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:07.764579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5abc6e5bf9124d279005fff733627824)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:07.764796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc71ed-843e-4309-a3b9-0c6c45872a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:07.765573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc71ed-843e-4309-a3b9-0c6c45872a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:07.767552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc71ed-843e-4309-a3b9-0c6c45872a86 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:07.768027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:07.819598 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 936/1887] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:07 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:07.821808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef408807-fe85-4f84-9efe-1d037c636771 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:07.822255 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef408807-fe85-4f84-9efe-1d037c636771 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:07.822669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef408807-fe85-4f84-9efe-1d037c636771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:07.849365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ef408807-fe85-4f84-9efe-1d037c636771 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:07.849556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5abc6e5bf9124d279005fff733627824', 'request_id': 'req-5277a6bf-6f44-4ed1-9315-728a299b3e04'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:07.850710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ef408807-fe85-4f84-9efe-1d037c636771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:07.858022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5abc6e5bf9124d279005fff733627824', 'request_id': 'req-5277a6bf-6f44-4ed1-9315-728a299b3e04'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:07.870128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5abc6e5bf9124d279005fff733627824', 'request_id': 'req-5277a6bf-6f44-4ed1-9315-728a299b3e04'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:07.889319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] The token cache is being invalidate because project 5abc6e5bf9124d279005fff733627824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:07.889636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:07.890711 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:07.892259 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 952/1888] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:07 2022] DELETE /identity/v3/projects/5abc6e5bf9124d279005fff733627824 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:07.893107 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:07.902787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:07.996876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 937/1889] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:07.996876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef408807-fe85-4f84-9efe-1d037c636771 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:07.996876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ef408807-fe85-4f84-9efe-1d037c636771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:08.036723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:08.037582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef408807-fe85-4f84-9efe-1d037c636771 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.044332 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e64d60-8196-417a-89aa-a378b10118a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.044974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e64d60-8196-417a-89aa-a378b10118a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.045261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e64d60-8196-417a-89aa-a378b10118a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.045539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e64d60-8196-417a-89aa-a378b10118a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.045801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277a6bf-6f44-4ed1-9315-728a299b3e04 tempest-VolumeQuotaClassesTest-282781712 tempest-VolumeQuotaClassesTest-282781712-project-admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.046213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e64d60-8196-417a-89aa-a378b10118a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.049060 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e64d60-8196-417a-89aa-a378b10118a1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.053503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8355b3-2d41-43c2-a613-9f8d0cf2dc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.054276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8355b3-2d41-43c2-a613-9f8d0cf2dc76 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.055160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8355b3-2d41-43c2-a613-9f8d0cf2dc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.055819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8355b3-2d41-43c2-a613-9f8d0cf2dc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.056876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8355b3-2d41-43c2-a613-9f8d0cf2dc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.057917 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:08.059244 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8355b3-2d41-43c2-a613-9f8d0cf2dc76 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.075973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 953/1890] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:08.077365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1a9b0-b6ec-4eff-a991-02acab60dd70 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.077666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1a9b0-b6ec-4eff-a991-02acab60dd70 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.077962 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1a9b0-b6ec-4eff-a991-02acab60dd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.081513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 938/1891] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:07 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:08.082465 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e64d60-8196-417a-89aa-a378b10118a1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.099179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e64d60-8196-417a-89aa-a378b10118a1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.104748 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5c9a9-ed2e-405a-869e-ce420bfa3733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.105440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5c9a9-ed2e-405a-869e-ce420bfa3733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.105730 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5c9a9-ed2e-405a-869e-ce420bfa3733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.106010 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5c9a9-ed2e-405a-869e-ce420bfa3733 admin admin] PATH_INFO: `/v3/projects/fee5cef563e644c7835a6536210fd16a/users/66f6e0c7c0684788b9cc3b0c939e9139/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.110292 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-75c1a9b0-b6ec-4eff-a991-02acab60dd70 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:08.112295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-75c1a9b0-b6ec-4eff-a991-02acab60dd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:08.123484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 954/1892] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:08.124864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1a9b0-b6ec-4eff-a991-02acab60dd70 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.129214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5c9a9-ed2e-405a-869e-ce420bfa3733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee5cef563e644c7835a6536210fd16a, user_id=66f6e0c7c0684788b9cc3b0c939e9139, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.132056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5c9a9-ed2e-405a-869e-ce420bfa3733 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.143666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1a9b0-b6ec-4eff-a991-02acab60dd70 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.156210 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 939/1893] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:08 2022] PUT /identity/v3/projects/fee5cef563e644c7835a6536210fd16a/users/66f6e0c7c0684788b9cc3b0c939e9139/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:08.156210 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5c9a9-ed2e-405a-869e-ce420bfa3733 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.238434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239105-6d74-4219-8d3a-b8127e64ac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.239128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239105-6d74-4219-8d3a-b8127e64ac1e admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.239417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239105-6d74-4219-8d3a-b8127e64ac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.239543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5c9a9-ed2e-405a-869e-ce420bfa3733 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.239982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239105-6d74-4219-8d3a-b8127e64ac1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.240695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f239105-6d74-4219-8d3a-b8127e64ac1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.242521 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f239105-6d74-4219-8d3a-b8127e64ac1e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.245515 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12dc3f-9cb3-419d-963a-a9b9ea7217a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.246821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12dc3f-9cb3-419d-963a-a9b9ea7217a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.246821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12dc3f-9cb3-419d-963a-a9b9ea7217a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.247335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12dc3f-9cb3-419d-963a-a9b9ea7217a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.248341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12dc3f-9cb3-419d-963a-a9b9ea7217a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:08.248949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12dc3f-9cb3-419d-963a-a9b9ea7217a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.250600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12dc3f-9cb3-419d-963a-a9b9ea7217a9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.256113 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 955/1894] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:08.256976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239105-6d74-4219-8d3a-b8127e64ac1e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.268932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 940/1895] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:08.269904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12dc3f-9cb3-419d-963a-a9b9ea7217a9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.271746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5f12dc3f-9cb3-419d-963a-a9b9ea7217a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:08.272630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239105-6d74-4219-8d3a-b8127e64ac1e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.278233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0be9dc-8b98-4ed1-9a58-3573269c25d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.278860 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0be9dc-8b98-4ed1-9a58-3573269c25d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.279147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0be9dc-8b98-4ed1-9a58-3573269c25d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.279420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0be9dc-8b98-4ed1-9a58-3573269c25d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.280148 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0be9dc-8b98-4ed1-9a58-3573269c25d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.282365 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0be9dc-8b98-4ed1-9a58-3573269c25d3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.288199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12dc3f-9cb3-419d-963a-a9b9ea7217a9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.296558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 956/1896] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:08.296765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.296885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0be9dc-8b98-4ed1-9a58-3573269c25d3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.296975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.296975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.296975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] PATH_INFO: `/v3/users/b6c150b3d26547a4a387fc9abc1bd3f8` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.297992 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c150b3d26547a4a387fc9abc1bd3f8)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.300070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.308277 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0be9dc-8b98-4ed1-9a58-3573269c25d3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.312970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3bbd8-ad94-4c78-8be0-c33682346cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.313593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3bbd8-ad94-4c78-8be0-c33682346cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.313876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3bbd8-ad94-4c78-8be0-c33682346cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.314154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3bbd8-ad94-4c78-8be0-c33682346cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.314840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3bbd8-ad94-4c78-8be0-c33682346cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.316528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3bbd8-ad94-4c78-8be0-c33682346cd0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.328619 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 957/1897] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:08.329659 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3bbd8-ad94-4c78-8be0-c33682346cd0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.344606 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3bbd8-ad94-4c78-8be0-c33682346cd0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.349250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a20ec4-54a6-41f6-b900-98e4bd30f5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.349901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a20ec4-54a6-41f6-b900-98e4bd30f5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.350182 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a20ec4-54a6-41f6-b900-98e4bd30f5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.350455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a20ec4-54a6-41f6-b900-98e4bd30f5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.351119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a20ec4-54a6-41f6-b900-98e4bd30f5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.353197 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a20ec4-54a6-41f6-b900-98e4bd30f5a1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.357304 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c150b3d26547a4a387fc9abc1bd3f8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:08.365682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c150b3d26547a4a387fc9abc1bd3f8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:08.374684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c150b3d26547a4a387fc9abc1bd3f8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:08.375497 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c150b3d26547a4a387fc9abc1bd3f8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:08.376329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c150b3d26547a4a387fc9abc1bd3f8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:08.388084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 958/1898] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:08 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:08.388717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a20ec4-54a6-41f6-b900-98e4bd30f5a1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.390325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d7a20ec4-54a6-41f6-b900-98e4bd30f5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:08.403175 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 941/1899] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:08 2022] DELETE /identity/v3/users/b6c150b3d26547a4a387fc9abc1bd3f8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:08.403175 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.405137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:08.455189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:08.469689 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a20ec4-54a6-41f6-b900-98e4bd30f5a1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.484536 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7e917-3e38-46e4-a316-cfb6700a289b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.489929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5708d-1115-4f77-805d-43d0262b001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.490656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5708d-1115-4f77-805d-43d0262b001b admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.491015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5708d-1115-4f77-805d-43d0262b001b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.491322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5708d-1115-4f77-805d-43d0262b001b admin admin] PATH_INFO: `/v3/projects/2b7e15b5bf5e4778bebaa4d27d94ae25/users/c26a01ca8fd1478dbe453582c7dafc03/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.506926 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5708d-1115-4f77-805d-43d0262b001b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7e15b5bf5e4778bebaa4d27d94ae25, user_id=c26a01ca8fd1478dbe453582c7dafc03, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.509728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5708d-1115-4f77-805d-43d0262b001b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.519089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:08.531904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 942/1900] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:08 2022] PUT /identity/v3/projects/2b7e15b5bf5e4778bebaa4d27d94ae25/users/c26a01ca8fd1478dbe453582c7dafc03/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:08.531904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5708d-1115-4f77-805d-43d0262b001b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.531904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3dd5708d-1115-4f77-805d-43d0262b001b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:08.545787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e9128-6e2b-4a09-a958-c37925a126d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.546466 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e9128-6e2b-4a09-a958-c37925a126d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.546803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e9128-6e2b-4a09-a958-c37925a126d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.547224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e9128-6e2b-4a09-a958-c37925a126d9 admin admin] PATH_INFO: `/v3/projects/fee5cef563e644c7835a6536210fd16a/users/66f6e0c7c0684788b9cc3b0c939e9139/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.550512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e9128-6e2b-4a09-a958-c37925a126d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee5cef563e644c7835a6536210fd16a, user_id=66f6e0c7c0684788b9cc3b0c939e9139, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.553450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e9128-6e2b-4a09-a958-c37925a126d9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.566660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 959/1901] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:08 2022] PUT /identity/v3/projects/fee5cef563e644c7835a6536210fd16a/users/66f6e0c7c0684788b9cc3b0c939e9139/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:08.568419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b58db-542e-4b2a-abb5-4ea1d5578d8f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.568594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b58db-542e-4b2a-abb5-4ea1d5578d8f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.568884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b58db-542e-4b2a-abb5-4ea1d5578d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.597471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-692b58db-542e-4b2a-abb5-4ea1d5578d8f None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:08.599667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-692b58db-542e-4b2a-abb5-4ea1d5578d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:08.667455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5708d-1115-4f77-805d-43d0262b001b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.686224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 960/1902] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:08.687844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122b295-49d5-4834-9d10-1fd7df310731 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.688311 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122b295-49d5-4834-9d10-1fd7df310731 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.688652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122b295-49d5-4834-9d10-1fd7df310731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.720074 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3122b295-49d5-4834-9d10-1fd7df310731 None None] MFA Rules not processed for user `c26a01ca8fd1478dbe453582c7dafc03`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:08.721392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3122b295-49d5-4834-9d10-1fd7df310731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:08.751975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fbf73-5f92-427f-b9b3-fe6415e4bae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.752613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fbf73-5f92-427f-b9b3-fe6415e4bae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.753056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fbf73-5f92-427f-b9b3-fe6415e4bae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.753336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fbf73-5f92-427f-b9b3-fe6415e4bae6 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.754004 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fbf73-5f92-427f-b9b3-fe6415e4bae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.756232 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fbf73-5f92-427f-b9b3-fe6415e4bae6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.785273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 943/1903] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:08 2022] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:08.790221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a465547-156f-499d-87fe-aac9b7da5086 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.791258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a465547-156f-499d-87fe-aac9b7da5086 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.791726 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a465547-156f-499d-87fe-aac9b7da5086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.821246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 961/1904] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:08.822269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122b295-49d5-4834-9d10-1fd7df310731 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.824141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3122b295-49d5-4834-9d10-1fd7df310731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:08.826134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1a465547-156f-499d-87fe-aac9b7da5086 None None] MFA Rules not processed for user `66f6e0c7c0684788b9cc3b0c939e9139`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:08.827680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1a465547-156f-499d-87fe-aac9b7da5086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:08.874742 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:08.894133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122b295-49d5-4834-9d10-1fd7df310731 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.897803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025590dc-bab8-49f3-bfa4-87d61e39d6e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.898431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025590dc-bab8-49f3-bfa4-87d61e39d6e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.899248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025590dc-bab8-49f3-bfa4-87d61e39d6e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.899533 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025590dc-bab8-49f3-bfa4-87d61e39d6e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.907951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 944/1905] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:08.908866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025590dc-bab8-49f3-bfa4-87d61e39d6e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.908994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a465547-156f-499d-87fe-aac9b7da5086 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.910314 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025590dc-bab8-49f3-bfa4-87d61e39d6e5 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.921623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 962/1906] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:08.922310 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025590dc-bab8-49f3-bfa4-87d61e39d6e5 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.924806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a465547-156f-499d-87fe-aac9b7da5086 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.929479 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1afa9-f526-405b-b656-74face0592be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.930137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1afa9-f526-405b-b656-74face0592be admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.930419 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1afa9-f526-405b-b656-74face0592be admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.930691 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1afa9-f526-405b-b656-74face0592be admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.931379 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1afa9-f526-405b-b656-74face0592be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.932203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025590dc-bab8-49f3-bfa4-87d61e39d6e5 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:08.933003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1afa9-f526-405b-b656-74face0592be admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.937526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf07361-0b3f-4b7a-b790-a3eb3ec23625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:08.938488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf07361-0b3f-4b7a-b790-a3eb3ec23625 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:08.938777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf07361-0b3f-4b7a-b790-a3eb3ec23625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:08.939057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf07361-0b3f-4b7a-b790-a3eb3ec23625 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:08.939727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf07361-0b3f-4b7a-b790-a3eb3ec23625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:08.941771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf07361-0b3f-4b7a-b790-a3eb3ec23625 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:08.946817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 945/1907] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:08.946817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1afa9-f526-405b-b656-74face0592be admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:08.946817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-82a1afa9-f526-405b-b656-74face0592be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:08.955401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:08.979619 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 963/1908] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:08 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:08.980567 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf07361-0b3f-4b7a-b790-a3eb3ec23625 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:09.025840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1afa9-f526-405b-b656-74face0592be admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:09.075267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf07361-0b3f-4b7a-b790-a3eb3ec23625 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:09.087553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f93a6-61ed-43f3-86dd-62d217ae80f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:09.089607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f93a6-61ed-43f3-86dd-62d217ae80f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:09.089895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f93a6-61ed-43f3-86dd-62d217ae80f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:09.090177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f93a6-61ed-43f3-86dd-62d217ae80f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:09.090899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f93a6-61ed-43f3-86dd-62d217ae80f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:09.093442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f93a6-61ed-43f3-86dd-62d217ae80f3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:09.118956 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 964/1909] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:09.118956 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f93a6-61ed-43f3-86dd-62d217ae80f3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:09.136438 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c3d7a-02a6-400f-b9bb-97447602c30a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:09.137273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c3d7a-02a6-400f-b9bb-97447602c30a service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:09.137570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c3d7a-02a6-400f-b9bb-97447602c30a service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:09.138292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c3d7a-02a6-400f-b9bb-97447602c30a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:09.143101 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f93a6-61ed-43f3-86dd-62d217ae80f3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:09.150566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215ea03-3ae1-4ee3-a4b4-7b87ac452cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:09.151232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215ea03-3ae1-4ee3-a4b4-7b87ac452cde admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:09.152166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215ea03-3ae1-4ee3-a4b4-7b87ac452cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:09.152452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215ea03-3ae1-4ee3-a4b4-7b87ac452cde admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:09.161260 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215ea03-3ae1-4ee3-a4b4-7b87ac452cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:09.170575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215ea03-3ae1-4ee3-a4b4-7b87ac452cde admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:09.213708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 965/1910] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:09 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:09.214346 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215ea03-3ae1-4ee3-a4b4-7b87ac452cde admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:09.242630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215ea03-3ae1-4ee3-a4b4-7b87ac452cde admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:09.248710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9f058-600c-4bf0-8928-0f99dcfd6447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:09.249412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9f058-600c-4bf0-8928-0f99dcfd6447 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:09.249983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9f058-600c-4bf0-8928-0f99dcfd6447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:09.250644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9f058-600c-4bf0-8928-0f99dcfd6447 admin admin] PATH_INFO: `/v3/projects/2c1e6b43b1ba4f71b7228e867c0dfabf/users/a6402dd612f9458ab3d56056a8611584/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:09.254307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c3d7a-02a6-400f-b9bb-97447602c30a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:09.256156 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c3d7a-02a6-400f-b9bb-97447602c30a service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:09.270994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 946/1911] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:09.272077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c3d7a-02a6-400f-b9bb-97447602c30a service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:09.285210 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9f058-600c-4bf0-8928-0f99dcfd6447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1e6b43b1ba4f71b7228e867c0dfabf, user_id=a6402dd612f9458ab3d56056a8611584, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:09.287830 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9f058-600c-4bf0-8928-0f99dcfd6447 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:09.288553 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c3d7a-02a6-400f-b9bb-97447602c30a service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:09.297055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a56bbe-9cff-477a-8a06-05fc19a81cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:09.298834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a56bbe-9cff-477a-8a06-05fc19a81cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:09.299244 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a56bbe-9cff-477a-8a06-05fc19a81cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:09.299581 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a56bbe-9cff-477a-8a06-05fc19a81cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:09.301103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a56bbe-9cff-477a-8a06-05fc19a81cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:09.303773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a56bbe-9cff-477a-8a06-05fc19a81cb1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:09.315576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 966/1912] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:09 2022] PUT /identity/v3/projects/2c1e6b43b1ba4f71b7228e867c0dfabf/users/a6402dd612f9458ab3d56056a8611584/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:09.316537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9f058-600c-4bf0-8928-0f99dcfd6447 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:09.319510 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bee9f058-600c-4bf0-8928-0f99dcfd6447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:09.335087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 947/1913] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:09.337593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f8346-b7f6-4332-949f-7a903696ba76 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:09.337593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f8346-b7f6-4332-949f-7a903696ba76 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:09.338017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f8346-b7f6-4332-949f-7a903696ba76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:09.397533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d11f8346-b7f6-4332-949f-7a903696ba76 None None] MFA Rules not processed for user `a6402dd612f9458ab3d56056a8611584`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:09.400275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d11f8346-b7f6-4332-949f-7a903696ba76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:09.412389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:09.475498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9f058-600c-4bf0-8928-0f99dcfd6447 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:09.481321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:09.481982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:09.482271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:09.482584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] PATH_INFO: `/v3/projects/5414a5d7d1514c5485fae9162d188632` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:09.483772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5414a5d7d1514c5485fae9162d188632)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:09.485990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:09.495975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 948/1914] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:09.496879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f8346-b7f6-4332-949f-7a903696ba76 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:09.508732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f8346-b7f6-4332-949f-7a903696ba76 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:09.515395 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f3a09-fa41-456c-8fd7-40c772aa3dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:09.516185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f3a09-fa41-456c-8fd7-40c772aa3dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:09.516481 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f3a09-fa41-456c-8fd7-40c772aa3dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:09.516802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f3a09-fa41-456c-8fd7-40c772aa3dcc admin admin] PATH_INFO: `/v3/projects/c786b8ddc6f54d53a7737898ca54f044/users/a69d53aae13640968dbb949c7e4a8c57/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:09.537239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f3a09-fa41-456c-8fd7-40c772aa3dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c786b8ddc6f54d53a7737898ca54f044, user_id=a69d53aae13640968dbb949c7e4a8c57, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:09.540953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f3a09-fa41-456c-8fd7-40c772aa3dcc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:09.543902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:09.548230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5414a5d7d1514c5485fae9162d188632', 'request_id': 'req-bc17034a-6c8c-4071-a98d-79517c782f2d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:09.559725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5414a5d7d1514c5485fae9162d188632', 'request_id': 'req-bc17034a-6c8c-4071-a98d-79517c782f2d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:09.561524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 949/1915] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:09 2022] PUT /identity/v3/projects/c786b8ddc6f54d53a7737898ca54f044/users/a69d53aae13640968dbb949c7e4a8c57/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:09.565075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f3a09-fa41-456c-8fd7-40c772aa3dcc admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:09.570122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5414a5d7d1514c5485fae9162d188632', 'request_id': 'req-bc17034a-6c8c-4071-a98d-79517c782f2d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:09.584272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] The token cache is being invalidate because project 5414a5d7d1514c5485fae9162d188632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:09.584650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:09.585238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:09.590460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 967/1916] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:09 2022] DELETE /identity/v3/projects/5414a5d7d1514c5485fae9162d188632 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:09.591381 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:09.592930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:09.692526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f3a09-fa41-456c-8fd7-40c772aa3dcc admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:09.703722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6727a-2eda-4fe9-b9af-ef686895c489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:09.705906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6727a-2eda-4fe9-b9af-ef686895c489 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:09.706354 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6727a-2eda-4fe9-b9af-ef686895c489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:09.707611 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6727a-2eda-4fe9-b9af-ef686895c489 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:09.710093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6727a-2eda-4fe9-b9af-ef686895c489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:09.718682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6727a-2eda-4fe9-b9af-ef686895c489 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:09.733379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17034a-6c8c-4071-a98d-79517c782f2d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:09.745520 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c53f05-6c8a-4d74-9719-ebc9249c6087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:09.746400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c53f05-6c8a-4d74-9719-ebc9249c6087 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:09.746800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c53f05-6c8a-4d74-9719-ebc9249c6087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:09.747144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c53f05-6c8a-4d74-9719-ebc9249c6087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:09.747957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c53f05-6c8a-4d74-9719-ebc9249c6087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:09.754678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c53f05-6c8a-4d74-9719-ebc9249c6087 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:09.797827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 950/1917] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:09 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:09.798778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6727a-2eda-4fe9-b9af-ef686895c489 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:09.800642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-27e6727a-2eda-4fe9-b9af-ef686895c489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:09.806943 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 968/1918] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:09.807788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c53f05-6c8a-4d74-9719-ebc9249c6087 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:09.809549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d4c53f05-6c8a-4d74-9719-ebc9249c6087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:09.828981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c53f05-6c8a-4d74-9719-ebc9249c6087 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:09.913883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d151a-bd70-4fdd-b479-1c53ad3a6308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:09.915078 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d151a-bd70-4fdd-b479-1c53ad3a6308 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:09.915369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d151a-bd70-4fdd-b479-1c53ad3a6308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:09.915646 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d151a-bd70-4fdd-b479-1c53ad3a6308 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:09.916363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d151a-bd70-4fdd-b479-1c53ad3a6308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:09.917981 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6727a-2eda-4fe9-b9af-ef686895c489 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:09.918324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d151a-bd70-4fdd-b479-1c53ad3a6308 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:09.924290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:09.925901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:09.926264 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:09.926632 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] PATH_INFO: `/v3/users/545f555cc86f49879706ba7301a21c74` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:09.928533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=545f555cc86f49879706ba7301a21c74)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:09.932069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:09.946304 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 969/1919] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:09 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:09.947392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d151a-bd70-4fdd-b479-1c53ad3a6308 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:09.954063 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:09.960614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d151a-bd70-4fdd-b479-1c53ad3a6308 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:09.967571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123ef44-3112-4959-b912-1712c52affe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:09.968428 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ef44-3112-4959-b912-1712c52affe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:09.969130 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ef44-3112-4959-b912-1712c52affe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:09.969501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ef44-3112-4959-b912-1712c52affe5 admin admin] PATH_INFO: `/v3/projects/c786b8ddc6f54d53a7737898ca54f044/users/a69d53aae13640968dbb949c7e4a8c57/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:09.972345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123ef44-3112-4959-b912-1712c52affe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c786b8ddc6f54d53a7737898ca54f044, user_id=a69d53aae13640968dbb949c7e4a8c57, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:09.975013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123ef44-3112-4959-b912-1712c52affe5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:09.990033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 970/1920] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:09 2022] PUT /identity/v3/projects/c786b8ddc6f54d53a7737898ca54f044/users/a69d53aae13640968dbb949c7e4a8c57/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:09.990885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123ef44-3112-4959-b912-1712c52affe5 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:09.993599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0123ef44-3112-4959-b912-1712c52affe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:10.023485 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545f555cc86f49879706ba7301a21c74'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:10.032609 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545f555cc86f49879706ba7301a21c74'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:10.042371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545f555cc86f49879706ba7301a21c74'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:10.043125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545f555cc86f49879706ba7301a21c74'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:10.043774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545f555cc86f49879706ba7301a21c74'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:10.054083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:10.067342 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 951/1921] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:09 2022] DELETE /identity/v3/users/545f555cc86f49879706ba7301a21c74 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:10.068538 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:10.070986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:10.081169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123ef44-3112-4959-b912-1712c52affe5 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:10.146680 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:10.147344 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:10.147633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:10.147949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] PATH_INFO: `/v3/users/350080219c5344e2909995ae86559edb` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:10.149340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d592f4-5507-464a-a535-2333b91bd8ae admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:10.150243 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=350080219c5344e2909995ae86559edb)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:10.151664 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:10.153976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d2e93-5f05-4257-9ad8-119202fe6022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:10.154611 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d2e93-5f05-4257-9ad8-119202fe6022 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:10.154891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d2e93-5f05-4257-9ad8-119202fe6022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:10.155177 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d2e93-5f05-4257-9ad8-119202fe6022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:10.155911 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d2e93-5f05-4257-9ad8-119202fe6022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:10.157688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d2e93-5f05-4257-9ad8-119202fe6022 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:10.168913 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 952/1922] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:10.172919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab9d95-99b6-4b15-bda2-cb580a9a9466 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:10.173217 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab9d95-99b6-4b15-bda2-cb580a9a9466 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:10.173506 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab9d95-99b6-4b15-bda2-cb580a9a9466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:10.202975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b2ab9d95-99b6-4b15-bda2-cb580a9a9466 None None] MFA Rules not processed for user `a69d53aae13640968dbb949c7e4a8c57`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:10.204387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b2ab9d95-99b6-4b15-bda2-cb580a9a9466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:10.213527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350080219c5344e2909995ae86559edb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:10.227980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350080219c5344e2909995ae86559edb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:10.245291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350080219c5344e2909995ae86559edb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:10.246164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350080219c5344e2909995ae86559edb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:10.247618 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350080219c5344e2909995ae86559edb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:10.300873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 971/1923] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:09 2022] DELETE /identity/v3/users/350080219c5344e2909995ae86559edb => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:10.300873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:10.302467 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:10.374556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 953/1924] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:10.376307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6a9ed-d67f-4429-971d-40ad75af9822 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:10.376604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6a9ed-d67f-4429-971d-40ad75af9822 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:10.376888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6a9ed-d67f-4429-971d-40ad75af9822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:10.401688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c5c6a9ed-d67f-4429-971d-40ad75af9822 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:10.405200 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c5c6a9ed-d67f-4429-971d-40ad75af9822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:10.419309 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:10.423176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c04bd7-fe06-4a9c-b9b6-4c3e820aecc1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:10.429014 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e6a19-0616-4cfd-b7e6-09f4f44d7239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:10.430151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e6a19-0616-4cfd-b7e6-09f4f44d7239 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:10.430512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e6a19-0616-4cfd-b7e6-09f4f44d7239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:10.431690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e6a19-0616-4cfd-b7e6-09f4f44d7239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:10.431822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e6a19-0616-4cfd-b7e6-09f4f44d7239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:10.433622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e6a19-0616-4cfd-b7e6-09f4f44d7239 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:10.457785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 972/1925] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:10.464703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e6a19-0616-4cfd-b7e6-09f4f44d7239 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:10.466588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a12e6a19-0616-4cfd-b7e6-09f4f44d7239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:10.480559 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:10.507430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 954/1926] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:10.509291 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6a9ed-d67f-4429-971d-40ad75af9822 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:10.524999 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6a9ed-d67f-4429-971d-40ad75af9822 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:10.532617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432666d-41a0-46ff-a795-a71ed72f5ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:10.533753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432666d-41a0-46ff-a795-a71ed72f5ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:10.534057 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432666d-41a0-46ff-a795-a71ed72f5ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:10.534466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432666d-41a0-46ff-a795-a71ed72f5ab4 admin admin] PATH_INFO: `/v3/projects/35f48574dc9a432bbdab6865e6940663/users/04d70059d7a5460d93357c8db94e151f/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:10.543612 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e6a19-0616-4cfd-b7e6-09f4f44d7239 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:10.547831 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558a51a-0b5e-404c-9bee-078be374ad28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:10.548601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558a51a-0b5e-404c-9bee-078be374ad28 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:10.548987 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558a51a-0b5e-404c-9bee-078be374ad28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:10.549364 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558a51a-0b5e-404c-9bee-078be374ad28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:10.558125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432666d-41a0-46ff-a795-a71ed72f5ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f48574dc9a432bbdab6865e6940663, user_id=04d70059d7a5460d93357c8db94e151f, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:10.561360 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432666d-41a0-46ff-a795-a71ed72f5ab4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:10.595441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 955/1927] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:10 2022] PUT /identity/v3/projects/35f48574dc9a432bbdab6865e6940663/users/04d70059d7a5460d93357c8db94e151f/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:10.596923 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432666d-41a0-46ff-a795-a71ed72f5ab4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:10.599039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d432666d-41a0-46ff-a795-a71ed72f5ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:10.643298 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558a51a-0b5e-404c-9bee-078be374ad28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:10.645059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558a51a-0b5e-404c-9bee-078be374ad28 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:10.668607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 973/1928] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:10.672583 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7040868-9339-4d68-9123-ad2f92a8b2ca None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:10.673077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7040868-9339-4d68-9123-ad2f92a8b2ca None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:10.674659 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7040868-9339-4d68-9123-ad2f92a8b2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:10.687152 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432666d-41a0-46ff-a795-a71ed72f5ab4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:10.713300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de716ef-f83e-4ac9-a262-47d12b59ebcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:10.713963 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de716ef-f83e-4ac9-a262-47d12b59ebcf service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:10.714251 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de716ef-f83e-4ac9-a262-47d12b59ebcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:10.714526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de716ef-f83e-4ac9-a262-47d12b59ebcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:10.736704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c7040868-9339-4d68-9123-ad2f92a8b2ca None None] MFA Rules not processed for user `04d70059d7a5460d93357c8db94e151f`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:10.737961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c7040868-9339-4d68-9123-ad2f92a8b2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:10.828601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de716ef-f83e-4ac9-a262-47d12b59ebcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:10.832134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de716ef-f83e-4ac9-a262-47d12b59ebcf service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:10.853982 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 956/1929] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:10.856185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de716ef-f83e-4ac9-a262-47d12b59ebcf service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:10.868826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3de716ef-f83e-4ac9-a262-47d12b59ebcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:10.884562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 974/1930] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:10.889246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7040868-9339-4d68-9123-ad2f92a8b2ca None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:10.890222 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de716ef-f83e-4ac9-a262-47d12b59ebcf service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:10.902268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577724fa-962c-4086-b626-d295a514f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:10.904840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577724fa-962c-4086-b626-d295a514f953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:10.905319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577724fa-962c-4086-b626-d295a514f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:10.905917 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577724fa-962c-4086-b626-d295a514f953 admin admin] PATH_INFO: `/v3/projects/2dd4a3c7e1ac408a873ff8341171da23` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:10.909131 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577724fa-962c-4086-b626-d295a514f953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd4a3c7e1ac408a873ff8341171da23)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:10.912923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7040868-9339-4d68-9123-ad2f92a8b2ca None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:10.920616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577724fa-962c-4086-b626-d295a514f953 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:10.931309 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4533b55-20a3-49b5-8962-3d456c2ea6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:10.932038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4533b55-20a3-49b5-8962-3d456c2ea6fe admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:10.932334 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4533b55-20a3-49b5-8962-3d456c2ea6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:10.936013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4533b55-20a3-49b5-8962-3d456c2ea6fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:10.936750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4533b55-20a3-49b5-8962-3d456c2ea6fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:10.938681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4533b55-20a3-49b5-8962-3d456c2ea6fe admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:11.021518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 975/1931] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:10 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:11.022232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4533b55-20a3-49b5-8962-3d456c2ea6fe admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:11.040419 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:11.062104 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:11.081418 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-577724fa-962c-4086-b626-d295a514f953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd4a3c7e1ac408a873ff8341171da23', 'request_id': 'req-577724fa-962c-4086-b626-d295a514f953'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.107742 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-577724fa-962c-4086-b626-d295a514f953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd4a3c7e1ac408a873ff8341171da23', 'request_id': 'req-577724fa-962c-4086-b626-d295a514f953'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.125171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4533b55-20a3-49b5-8962-3d456c2ea6fe admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:11.135278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-577724fa-962c-4086-b626-d295a514f953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd4a3c7e1ac408a873ff8341171da23', 'request_id': 'req-577724fa-962c-4086-b626-d295a514f953'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.178422 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-577724fa-962c-4086-b626-d295a514f953 admin admin] The token cache is being invalidate because project 2dd4a3c7e1ac408a873ff8341171da23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:11.179527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-577724fa-962c-4086-b626-d295a514f953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.182319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-577724fa-962c-4086-b626-d295a514f953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.184696 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 957/1932] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:10 2022] DELETE /identity/v3/projects/2dd4a3c7e1ac408a873ff8341171da23 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:11.190648 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4cad6-9316-4841-b8a3-2f85f1e250d4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:11.191259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4cad6-9316-4841-b8a3-2f85f1e250d4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:11.191753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4cad6-9316-4841-b8a3-2f85f1e250d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:11.237252 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-bab4cad6-9316-4841-b8a3-2f85f1e250d4 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:11.241305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bab4cad6-9316-4841-b8a3-2f85f1e250d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:11.262631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d677f-fc06-4b21-bc17-2a14f4e51dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:11.264128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d677f-fc06-4b21-bc17-2a14f4e51dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:11.264936 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d677f-fc06-4b21-bc17-2a14f4e51dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:11.265691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d677f-fc06-4b21-bc17-2a14f4e51dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:11.268537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d677f-fc06-4b21-bc17-2a14f4e51dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:11.275692 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d677f-fc06-4b21-bc17-2a14f4e51dd4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:11.338342 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 976/1933] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:11 2022] POST /identity/v3/users => generated 296 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:11.345144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d677f-fc06-4b21-bc17-2a14f4e51dd4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:11.348715 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-790d677f-fc06-4b21-bc17-2a14f4e51dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:11.389336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d677f-fc06-4b21-bc17-2a14f4e51dd4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:11.412868 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb955b-4163-4af8-a968-9b1debe385b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:11.428509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb955b-4163-4af8-a968-9b1debe385b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:11.429374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb955b-4163-4af8-a968-9b1debe385b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:11.430863 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb955b-4163-4af8-a968-9b1debe385b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:11.437822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 958/1934] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:11.439697 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12d047-e972-4be0-b65d-a7af7578ec45 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:11.440164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12d047-e972-4be0-b65d-a7af7578ec45 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:11.440529 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12d047-e972-4be0-b65d-a7af7578ec45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:11.460704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb955b-4163-4af8-a968-9b1debe385b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:11.463989 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb955b-4163-4af8-a968-9b1debe385b4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:11.471736 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6b12d047-e972-4be0-b65d-a7af7578ec45 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:11.473263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6b12d047-e972-4be0-b65d-a7af7578ec45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:11.479444 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 977/1935] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:11.480451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb955b-4163-4af8-a968-9b1debe385b4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:11.483822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6efb955b-4163-4af8-a968-9b1debe385b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:11.490206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 959/1936] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:11.490971 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12d047-e972-4be0-b65d-a7af7578ec45 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:11.492429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6b12d047-e972-4be0-b65d-a7af7578ec45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:11.504029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb955b-4163-4af8-a968-9b1debe385b4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:11.505657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12d047-e972-4be0-b65d-a7af7578ec45 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:11.512382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:11.513118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:11.513669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:11.513852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] PATH_INFO: `/v3/projects/120fbd63b71b49e8b0711584d7d72af0` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:11.515137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=120fbd63b71b49e8b0711584d7d72af0)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:11.517785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:11.519036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:11.519406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:11.519696 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:11.520031 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] PATH_INFO: `/v3/users/c26a01ca8fd1478dbe453582c7dafc03` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:11.522018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26a01ca8fd1478dbe453582c7dafc03)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:11.524484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:11.612943 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26a01ca8fd1478dbe453582c7dafc03'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.616555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120fbd63b71b49e8b0711584d7d72af0', 'request_id': 'req-adebcd3c-b60f-4150-8eec-9a13242e20ed'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.623092 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26a01ca8fd1478dbe453582c7dafc03'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.625362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120fbd63b71b49e8b0711584d7d72af0', 'request_id': 'req-adebcd3c-b60f-4150-8eec-9a13242e20ed'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.632877 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120fbd63b71b49e8b0711584d7d72af0', 'request_id': 'req-adebcd3c-b60f-4150-8eec-9a13242e20ed'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.636811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26a01ca8fd1478dbe453582c7dafc03'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.637639 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26a01ca8fd1478dbe453582c7dafc03'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.638576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26a01ca8fd1478dbe453582c7dafc03'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.646081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] The token cache is being invalidate because project 120fbd63b71b49e8b0711584d7d72af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:11.646378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.647053 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.650211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 960/1937] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:11 2022] DELETE /identity/v3/projects/120fbd63b71b49e8b0711584d7d72af0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:11.650900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:11.655985 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:11.660270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 978/1938] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:11 2022] DELETE /identity/v3/users/c26a01ca8fd1478dbe453582c7dafc03 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:11.663110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:11.663110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:11.690791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:11.703344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:11.733164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aff932-d795-415d-b900-15dfcab8d567 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:11.733408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebcd3c-b60f-4150-8eec-9a13242e20ed admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:11.738628 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ab625-9de5-4035-a63e-0a4f16a8dc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:11.738910 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb043d7-1468-4fde-bda8-5f7fb416acbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:11.739306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ab625-9de5-4035-a63e-0a4f16a8dc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:11.739598 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ab625-9de5-4035-a63e-0a4f16a8dc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:11.739700 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb043d7-1468-4fde-bda8-5f7fb416acbc admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:11.739891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ab625-9de5-4035-a63e-0a4f16a8dc2c admin admin] PATH_INFO: `/v3/projects/bf0cc8b4987e4f6f882a2ca53cc964c7/users/a99beb1fbba0488e80b10653099676d4/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:11.740312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb043d7-1468-4fde-bda8-5f7fb416acbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:11.740602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb043d7-1468-4fde-bda8-5f7fb416acbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:11.741318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb043d7-1468-4fde-bda8-5f7fb416acbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:11.741632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb043d7-1468-4fde-bda8-5f7fb416acbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:11.743806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb043d7-1468-4fde-bda8-5f7fb416acbc admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:11.755744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ab625-9de5-4035-a63e-0a4f16a8dc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0cc8b4987e4f6f882a2ca53cc964c7, user_id=a99beb1fbba0488e80b10653099676d4, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:11.760771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 979/1939] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:11.760771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb043d7-1468-4fde-bda8-5f7fb416acbc admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:11.761035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ab625-9de5-4035-a63e-0a4f16a8dc2c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:11.763429 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-aeb043d7-1468-4fde-bda8-5f7fb416acbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:11.772913 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 961/1940] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:11 2022] PUT /identity/v3/projects/bf0cc8b4987e4f6f882a2ca53cc964c7/users/a99beb1fbba0488e80b10653099676d4/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:11.774612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca239e-85ac-4310-a855-7e4f887b9eeb None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:11.775313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca239e-85ac-4310-a855-7e4f887b9eeb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:11.775808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca239e-85ac-4310-a855-7e4f887b9eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:11.779619 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb043d7-1468-4fde-bda8-5f7fb416acbc admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:11.797991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6eca239e-85ac-4310-a855-7e4f887b9eeb None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:11.799108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6eca239e-85ac-4310-a855-7e4f887b9eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:11.846771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:11.847605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:11.848027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:11.848384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] PATH_INFO: `/v3/users/66f6e0c7c0684788b9cc3b0c939e9139` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:11.849716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f6e0c7c0684788b9cc3b0c939e9139)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:11.852304 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:11.872904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 962/1941] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:11.873553 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca239e-85ac-4310-a855-7e4f887b9eeb None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:11.875376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6eca239e-85ac-4310-a855-7e4f887b9eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:11.889880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca239e-85ac-4310-a855-7e4f887b9eeb None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:11.895467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aa5c1-c3da-4f65-9cb8-39c1a840173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:11.896169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aa5c1-c3da-4f65-9cb8-39c1a840173d admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:11.896455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aa5c1-c3da-4f65-9cb8-39c1a840173d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:11.896733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aa5c1-c3da-4f65-9cb8-39c1a840173d admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:11.897406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163aa5c1-c3da-4f65-9cb8-39c1a840173d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:11.899772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163aa5c1-c3da-4f65-9cb8-39c1a840173d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:11.907663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f6e0c7c0684788b9cc3b0c939e9139'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.916216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f6e0c7c0684788b9cc3b0c939e9139'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.924401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f6e0c7c0684788b9cc3b0c939e9139'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.925061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f6e0c7c0684788b9cc3b0c939e9139'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.925676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f6e0c7c0684788b9cc3b0c939e9139'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:11.928961 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 963/1942] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:11 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:11.933835 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aa5c1-c3da-4f65-9cb8-39c1a840173d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:11.935508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-163aa5c1-c3da-4f65-9cb8-39c1a840173d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:11.944258 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 980/1943] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:11 2022] DELETE /identity/v3/users/66f6e0c7c0684788b9cc3b0c939e9139 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:11.948315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:11.949919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:12.004805 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:12.040195 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284179b8-ef64-458d-aca3-835b062dfde2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:12.041534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aa5c1-c3da-4f65-9cb8-39c1a840173d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:12.048770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72da0a-0f0a-48ef-8672-ebb6cccf5915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:12.049558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72da0a-0f0a-48ef-8672-ebb6cccf5915 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:12.050080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72da0a-0f0a-48ef-8672-ebb6cccf5915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:12.050430 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72da0a-0f0a-48ef-8672-ebb6cccf5915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:12.052583 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6d72da0a-0f0a-48ef-8672-ebb6cccf5915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:12.103075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:12.128919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e8d89-ce37-4865-9d76-7c934c2322fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:12.129708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e8d89-ce37-4865-9d76-7c934c2322fc admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:12.130003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e8d89-ce37-4865-9d76-7c934c2322fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:12.130288 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e8d89-ce37-4865-9d76-7c934c2322fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:12.131025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e8d89-ce37-4865-9d76-7c934c2322fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:12.133759 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e8d89-ce37-4865-9d76-7c934c2322fc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:12.136913 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72da0a-0f0a-48ef-8672-ebb6cccf5915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:12.138598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72da0a-0f0a-48ef-8672-ebb6cccf5915 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:12.148017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 964/1944] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:12.148017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e8d89-ce37-4865-9d76-7c934c2322fc admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:12.148017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d79e8d89-ce37-4865-9d76-7c934c2322fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:12.152761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 981/1945] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:12.153739 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72da0a-0f0a-48ef-8672-ebb6cccf5915 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:12.161429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e8d89-ce37-4865-9d76-7c934c2322fc admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:12.165973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72da0a-0f0a-48ef-8672-ebb6cccf5915 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:12.169718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064aea1-946e-436f-8b31-511d892c4b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:12.170999 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064aea1-946e-436f-8b31-511d892c4b0c admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:12.171731 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064aea1-946e-436f-8b31-511d892c4b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:12.172235 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064aea1-946e-436f-8b31-511d892c4b0c admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:12.172620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61040ae6-043a-44a2-b3fe-06a06582be1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:12.173356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064aea1-946e-436f-8b31-511d892c4b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:12.174117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61040ae6-043a-44a2-b3fe-06a06582be1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:12.174567 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61040ae6-043a-44a2-b3fe-06a06582be1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:12.174949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61040ae6-043a-44a2-b3fe-06a06582be1c admin admin] PATH_INFO: `/v3/projects/bf0cc8b4987e4f6f882a2ca53cc964c7/users/a99beb1fbba0488e80b10653099676d4/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:12.176667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064aea1-946e-436f-8b31-511d892c4b0c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:12.178836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61040ae6-043a-44a2-b3fe-06a06582be1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0cc8b4987e4f6f882a2ca53cc964c7, user_id=a99beb1fbba0488e80b10653099676d4, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:12.183501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61040ae6-043a-44a2-b3fe-06a06582be1c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:12.201107 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 982/1946] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:12 2022] PUT /identity/v3/projects/bf0cc8b4987e4f6f882a2ca53cc964c7/users/a99beb1fbba0488e80b10653099676d4/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:12.212633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79b314-2c8b-4048-9ec4-e733747a5210 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:12.213083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79b314-2c8b-4048-9ec4-e733747a5210 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:12.214051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79b314-2c8b-4048-9ec4-e733747a5210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:12.215063 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 965/1947] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:12 2022] POST /identity/v3/users => generated 291 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:12.219108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064aea1-946e-436f-8b31-511d892c4b0c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:12.231493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064aea1-946e-436f-8b31-511d892c4b0c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:12.261262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ae79b314-2c8b-4048-9ec4-e733747a5210 None None] MFA Rules not processed for user `a99beb1fbba0488e80b10653099676d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:12.262818 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ae79b314-2c8b-4048-9ec4-e733747a5210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:12.329978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af02f-b6dc-4aa6-8d58-f75d8868c959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:12.330613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af02f-b6dc-4aa6-8d58-f75d8868c959 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:12.330899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af02f-b6dc-4aa6-8d58-f75d8868c959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:12.331174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af02f-b6dc-4aa6-8d58-f75d8868c959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:12.332033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af02f-b6dc-4aa6-8d58-f75d8868c959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:12.333658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af02f-b6dc-4aa6-8d58-f75d8868c959 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:12.345293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 966/1948] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:12.346486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af02f-b6dc-4aa6-8d58-f75d8868c959 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:12.349805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-dc3af02f-b6dc-4aa6-8d58-f75d8868c959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:12.370957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 983/1949] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:12.372486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79b314-2c8b-4048-9ec4-e733747a5210 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:12.377138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af02f-b6dc-4aa6-8d58-f75d8868c959 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:12.383375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:12.384736 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:12.385023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:12.385294 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] PATH_INFO: `/v3/projects/fee5cef563e644c7835a6536210fd16a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:12.387166 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee5cef563e644c7835a6536210fd16a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:12.389305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:12.406387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79b314-2c8b-4048-9ec4-e733747a5210 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:12.412584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce44bc-9d80-41a7-868c-f5573edfad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:12.413306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce44bc-9d80-41a7-868c-f5573edfad18 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:12.413596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce44bc-9d80-41a7-868c-f5573edfad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:12.413959 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce44bc-9d80-41a7-868c-f5573edfad18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:12.415622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce44bc-9d80-41a7-868c-f5573edfad18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:12.417596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce44bc-9d80-41a7-868c-f5573edfad18 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:12.429383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 984/1950] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:12.430418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce44bc-9d80-41a7-868c-f5573edfad18 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:12.432836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-96ce44bc-9d80-41a7-868c-f5573edfad18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:12.477318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee5cef563e644c7835a6536210fd16a', 'request_id': 'req-e4b2fb90-3c3a-402d-9017-8bdbc7125542'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:12.487389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee5cef563e644c7835a6536210fd16a', 'request_id': 'req-e4b2fb90-3c3a-402d-9017-8bdbc7125542'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:12.496076 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee5cef563e644c7835a6536210fd16a', 'request_id': 'req-e4b2fb90-3c3a-402d-9017-8bdbc7125542'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:12.508224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] The token cache is being invalidate because project fee5cef563e644c7835a6536210fd16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:12.508607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:12.509934 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:12.512243 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 967/1951] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:12 2022] DELETE /identity/v3/projects/fee5cef563e644c7835a6536210fd16a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:12.517438 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:12.520233 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:12.535038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:12.543738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce44bc-9d80-41a7-868c-f5573edfad18 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:12.622231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:12.652159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045af7ac-adb4-4395-b715-f220694d473e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:12.652929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2fb90-3c3a-402d-9017-8bdbc7125542 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:12.653619 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045af7ac-adb4-4395-b715-f220694d473e service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:12.653909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045af7ac-adb4-4395-b715-f220694d473e service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:12.654187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045af7ac-adb4-4395-b715-f220694d473e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:12.657481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-045af7ac-adb4-4395-b715-f220694d473e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:12.670606 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8e005-f649-4313-9995-678c0dfb63f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:12.671312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8e005-f649-4313-9995-678c0dfb63f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:12.671602 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8e005-f649-4313-9995-678c0dfb63f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:12.672802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8e005-f649-4313-9995-678c0dfb63f9 admin admin] PATH_INFO: `/v3/projects/7979ce66baf545e0928df99e63a94d5b/users/78a147fe39f34c6f80e4c57dbd7a4457/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:12.693975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8e005-f649-4313-9995-678c0dfb63f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7979ce66baf545e0928df99e63a94d5b, user_id=78a147fe39f34c6f80e4c57dbd7a4457, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:12.698128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8e005-f649-4313-9995-678c0dfb63f9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:12.716655 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 968/1952] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:12 2022] PUT /identity/v3/projects/7979ce66baf545e0928df99e63a94d5b/users/78a147fe39f34c6f80e4c57dbd7a4457/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:12.718562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55745e3-e210-410b-8333-1fef1263ebe6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:12.718931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55745e3-e210-410b-8333-1fef1263ebe6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:12.719460 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55745e3-e210-410b-8333-1fef1263ebe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:12.743683 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b55745e3-e210-410b-8333-1fef1263ebe6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:12.745272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b55745e3-e210-410b-8333-1fef1263ebe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:12.756720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045af7ac-adb4-4395-b715-f220694d473e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:12.758775 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045af7ac-adb4-4395-b715-f220694d473e service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:12.769339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 985/1953] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:12.770431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045af7ac-adb4-4395-b715-f220694d473e service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:12.771786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-045af7ac-adb4-4395-b715-f220694d473e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:12.787603 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045af7ac-adb4-4395-b715-f220694d473e service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:12.847914 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 969/1954] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:12.847914 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02642f-a911-4e77-aae0-86b3d506e08c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:12.847914 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02642f-a911-4e77-aae0-86b3d506e08c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:12.847914 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02642f-a911-4e77-aae0-86b3d506e08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:12.886831 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:12.887134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:12.887421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:12.887893 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] PATH_INFO: `/v3/projects/2b7e15b5bf5e4778bebaa4d27d94ae25` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:12.889785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7e15b5bf5e4778bebaa4d27d94ae25)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:12.890683 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1c02642f-a911-4e77-aae0-86b3d506e08c None None] MFA Rules not processed for user `78a147fe39f34c6f80e4c57dbd7a4457`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:12.891728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:12.892747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1c02642f-a911-4e77-aae0-86b3d506e08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:13.007522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7e15b5bf5e4778bebaa4d27d94ae25', 'request_id': 'req-72c524b2-eea4-4338-aa1d-7063d94361d7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:13.015331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7e15b5bf5e4778bebaa4d27d94ae25', 'request_id': 'req-72c524b2-eea4-4338-aa1d-7063d94361d7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:13.017644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:13.022594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7e15b5bf5e4778bebaa4d27d94ae25', 'request_id': 'req-72c524b2-eea4-4338-aa1d-7063d94361d7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:13.044918 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] The token cache is being invalidate because project 2b7e15b5bf5e4778bebaa4d27d94ae25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:13.045120 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:13.045672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 970/1955] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:13.045914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:13.047485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 986/1956] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:12 2022] DELETE /identity/v3/projects/2b7e15b5bf5e4778bebaa4d27d94ae25 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:13.048375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:13.049699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2c402-27ff-40c5-85f5-7a23d0029c7f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:13.050070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2c402-27ff-40c5-85f5-7a23d0029c7f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:13.050358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2c402-27ff-40c5-85f5-7a23d0029c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:13.056381 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:13.073807 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-96c2c402-27ff-40c5-85f5-7a23d0029c7f None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:13.075043 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-96c2c402-27ff-40c5-85f5-7a23d0029c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:13.131383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c524b2-eea4-4338-aa1d-7063d94361d7 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:13.135216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:13.136084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba00319-c1c1-4429-843a-2edb63c6bc38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:13.136720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00319-c1c1-4429-843a-2edb63c6bc38 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:13.137010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00319-c1c1-4429-843a-2edb63c6bc38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:13.137445 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00319-c1c1-4429-843a-2edb63c6bc38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:13.152555 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1ba00319-c1c1-4429-843a-2edb63c6bc38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:13.152670 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 971/1957] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:13.152670 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2c402-27ff-40c5-85f5-7a23d0029c7f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:13.152808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-96c2c402-27ff-40c5-85f5-7a23d0029c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:13.164511 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2c402-27ff-40c5-85f5-7a23d0029c7f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:13.169627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3b0e1-4df1-4430-af88-4ba36054459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:13.170265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3b0e1-4df1-4430-af88-4ba36054459d admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:13.170574 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3b0e1-4df1-4430-af88-4ba36054459d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:13.170817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3b0e1-4df1-4430-af88-4ba36054459d admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:13.171579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3b0e1-4df1-4430-af88-4ba36054459d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:13.173523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3b0e1-4df1-4430-af88-4ba36054459d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:13.204221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 972/1958] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:13 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:13.206847 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba00319-c1c1-4429-843a-2edb63c6bc38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:13.208026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3b0e1-4df1-4430-af88-4ba36054459d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:13.208674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba00319-c1c1-4429-843a-2edb63c6bc38 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:13.209831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f4f3b0e1-4df1-4430-af88-4ba36054459d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:13.219969 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 987/1959] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:13.220575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba00319-c1c1-4429-843a-2edb63c6bc38 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:13.233008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba00319-c1c1-4429-843a-2edb63c6bc38 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:13.322568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3b0e1-4df1-4430-af88-4ba36054459d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:13.328863 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:13.329926 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:13.330380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:13.330666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] PATH_INFO: `/v3/users/a69d53aae13640968dbb949c7e4a8c57` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:13.332556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a69d53aae13640968dbb949c7e4a8c57)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:13.334470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:13.338216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5978b-c881-4506-a00c-d1cd0d28e931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:13.338909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5978b-c881-4506-a00c-d1cd0d28e931 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:13.339198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5978b-c881-4506-a00c-d1cd0d28e931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:13.339417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5978b-c881-4506-a00c-d1cd0d28e931 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:13.341020 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5978b-c881-4506-a00c-d1cd0d28e931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:13.341346 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5978b-c881-4506-a00c-d1cd0d28e931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:13.342965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5978b-c881-4506-a00c-d1cd0d28e931 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:13.365310 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 988/1960] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:13.366171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5978b-c881-4506-a00c-d1cd0d28e931 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:13.379481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5978b-c881-4506-a00c-d1cd0d28e931 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:13.389998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c93c-b201-44cd-967c-ee3561dd876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:13.390626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c93c-b201-44cd-967c-ee3561dd876f admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:13.390918 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c93c-b201-44cd-967c-ee3561dd876f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:13.391228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c93c-b201-44cd-967c-ee3561dd876f admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:13.391905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9c93c-b201-44cd-967c-ee3561dd876f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:13.393957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9c93c-b201-44cd-967c-ee3561dd876f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:13.410773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a69d53aae13640968dbb949c7e4a8c57'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:13.420560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a69d53aae13640968dbb949c7e4a8c57'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:13.427387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 989/1961] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:13 2022] POST /identity/v3/users => generated 296 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:13.431797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c93c-b201-44cd-967c-ee3561dd876f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:13.436936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a69d53aae13640968dbb949c7e4a8c57'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:13.437966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a69d53aae13640968dbb949c7e4a8c57'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:13.439244 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a69d53aae13640968dbb949c7e4a8c57'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:13.442516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c93c-b201-44cd-967c-ee3561dd876f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:13.449752 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da2907-7137-4659-a013-1733ed9b658f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:13.450759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da2907-7137-4659-a013-1733ed9b658f admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:13.451177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da2907-7137-4659-a013-1733ed9b658f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:13.451594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da2907-7137-4659-a013-1733ed9b658f admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:13.452489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da2907-7137-4659-a013-1733ed9b658f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:13.454707 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da2907-7137-4659-a013-1733ed9b658f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:13.469930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 973/1962] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:13 2022] DELETE /identity/v3/users/a69d53aae13640968dbb949c7e4a8c57 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:13.471482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:13.474102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:13.482061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:13.514551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 990/1963] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:13 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:13.519086 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da2907-7137-4659-a013-1733ed9b658f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:13.521066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f9da2907-7137-4659-a013-1733ed9b658f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:13.633693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:13.645703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286b5c9-1171-4196-a297-37be3479620a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:13.649462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da2907-7137-4659-a013-1733ed9b658f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:13.668688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65676c0a-134c-42e5-bf86-dd21a0158a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:13.668688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65676c0a-134c-42e5-bf86-dd21a0158a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:13.668688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65676c0a-134c-42e5-bf86-dd21a0158a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:13.668688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65676c0a-134c-42e5-bf86-dd21a0158a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:13.668972 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65676c0a-134c-42e5-bf86-dd21a0158a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:13.668972 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65676c0a-134c-42e5-bf86-dd21a0158a8c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:13.669285 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcb737-147f-4339-8fb5-d36b0a1c036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:13.669285 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcb737-147f-4339-8fb5-d36b0a1c036f admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:13.673508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcb737-147f-4339-8fb5-d36b0a1c036f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:13.673508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcb737-147f-4339-8fb5-d36b0a1c036f admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:13.673508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcb737-147f-4339-8fb5-d36b0a1c036f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:13.673508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcb737-147f-4339-8fb5-d36b0a1c036f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:13.680528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 974/1964] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:13.698355 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65676c0a-134c-42e5-bf86-dd21a0158a8c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:13.744431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65676c0a-134c-42e5-bf86-dd21a0158a8c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:13.767526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 991/1965] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:13 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:13.769253 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcb737-147f-4339-8fb5-d36b0a1c036f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:13.771743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc745ad0-0f14-4a47-9eb8-2a3a9f49ea19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:13.773050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745ad0-0f14-4a47-9eb8-2a3a9f49ea19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:13.773672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745ad0-0f14-4a47-9eb8-2a3a9f49ea19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:13.777523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745ad0-0f14-4a47-9eb8-2a3a9f49ea19 admin admin] PATH_INFO: `/v3/projects/e03a7c730e4145bd8eeac6d4adbf6637/users/454cf1524b5b494db6c1170e75d5eebc/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:13.790748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcb737-147f-4339-8fb5-d36b0a1c036f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:13.798336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc745ad0-0f14-4a47-9eb8-2a3a9f49ea19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03a7c730e4145bd8eeac6d4adbf6637, user_id=454cf1524b5b494db6c1170e75d5eebc, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:13.801984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc745ad0-0f14-4a47-9eb8-2a3a9f49ea19 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:13.806844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed142f-fa1d-40f3-9997-c42bed982faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:13.807495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed142f-fa1d-40f3-9997-c42bed982faa admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:13.807929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed142f-fa1d-40f3-9997-c42bed982faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:13.808098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed142f-fa1d-40f3-9997-c42bed982faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:13.808977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed142f-fa1d-40f3-9997-c42bed982faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:13.814152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed142f-fa1d-40f3-9997-c42bed982faa admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:13.825570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 975/1966] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:13 2022] PUT /identity/v3/projects/e03a7c730e4145bd8eeac6d4adbf6637/users/454cf1524b5b494db6c1170e75d5eebc/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:13.829986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc745ad0-0f14-4a47-9eb8-2a3a9f49ea19 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:13.842460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 992/1967] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:13.846528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed142f-fa1d-40f3-9997-c42bed982faa admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:13.872853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed142f-fa1d-40f3-9997-c42bed982faa admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:13.965798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc745ad0-0f14-4a47-9eb8-2a3a9f49ea19 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:13.971822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c591e7e-0d63-45f7-883c-9654c5abea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:13.972637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c591e7e-0d63-45f7-883c-9654c5abea65 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:13.972954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c591e7e-0d63-45f7-883c-9654c5abea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:13.973237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c591e7e-0d63-45f7-883c-9654c5abea65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:13.974451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c591e7e-0d63-45f7-883c-9654c5abea65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:13.977998 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c591e7e-0d63-45f7-883c-9654c5abea65 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:13.991080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784435c-0a1d-4a37-8570-7302a042d4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:13.991728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 976/1968] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:13.992877 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784435c-0a1d-4a37-8570-7302a042d4bd admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:13.993233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784435c-0a1d-4a37-8570-7302a042d4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:13.993331 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c591e7e-0d63-45f7-883c-9654c5abea65 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:13.994808 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784435c-0a1d-4a37-8570-7302a042d4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:13.994808 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784435c-0a1d-4a37-8570-7302a042d4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:13.996552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5c591e7e-0d63-45f7-883c-9654c5abea65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:13.996671 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784435c-0a1d-4a37-8570-7302a042d4bd admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.009155 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 993/1969] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:14.012032 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c591e7e-0d63-45f7-883c-9654c5abea65 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.013586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784435c-0a1d-4a37-8570-7302a042d4bd admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:14.016869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423ea05-43a7-46ba-8f7a-af28a1d50d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.017520 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423ea05-43a7-46ba-8f7a-af28a1d50d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.017808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423ea05-43a7-46ba-8f7a-af28a1d50d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.018089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423ea05-43a7-46ba-8f7a-af28a1d50d12 admin admin] PATH_INFO: `/v3/projects/c786b8ddc6f54d53a7737898ca54f044` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.019336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423ea05-43a7-46ba-8f7a-af28a1d50d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c786b8ddc6f54d53a7737898ca54f044)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.021266 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423ea05-43a7-46ba-8f7a-af28a1d50d12 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.030761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784435c-0a1d-4a37-8570-7302a042d4bd admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.036782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9310f-eb6f-45be-862c-dbf96131f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.038445 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9310f-eb6f-45be-862c-dbf96131f4be admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.038973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9310f-eb6f-45be-862c-dbf96131f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.040117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9310f-eb6f-45be-862c-dbf96131f4be admin admin] PATH_INFO: `/v3/projects/e03a7c730e4145bd8eeac6d4adbf6637/users/454cf1524b5b494db6c1170e75d5eebc/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.043760 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9310f-eb6f-45be-862c-dbf96131f4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03a7c730e4145bd8eeac6d4adbf6637, user_id=454cf1524b5b494db6c1170e75d5eebc, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.047067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9310f-eb6f-45be-862c-dbf96131f4be admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.062967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 994/1970] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:14 2022] PUT /identity/v3/projects/e03a7c730e4145bd8eeac6d4adbf6637/users/454cf1524b5b494db6c1170e75d5eebc/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:14.064310 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9310f-eb6f-45be-862c-dbf96131f4be admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:14.082452 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3423ea05-43a7-46ba-8f7a-af28a1d50d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c786b8ddc6f54d53a7737898ca54f044', 'request_id': 'req-3423ea05-43a7-46ba-8f7a-af28a1d50d12'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:14.092459 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3423ea05-43a7-46ba-8f7a-af28a1d50d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c786b8ddc6f54d53a7737898ca54f044', 'request_id': 'req-3423ea05-43a7-46ba-8f7a-af28a1d50d12'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:14.102602 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3423ea05-43a7-46ba-8f7a-af28a1d50d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c786b8ddc6f54d53a7737898ca54f044', 'request_id': 'req-3423ea05-43a7-46ba-8f7a-af28a1d50d12'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:14.121865 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3423ea05-43a7-46ba-8f7a-af28a1d50d12 admin admin] The token cache is being invalidate because project c786b8ddc6f54d53a7737898ca54f044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:14.122317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3423ea05-43a7-46ba-8f7a-af28a1d50d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:14.123120 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3423ea05-43a7-46ba-8f7a-af28a1d50d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:14.125647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 977/1971] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:13 2022] DELETE /identity/v3/projects/c786b8ddc6f54d53a7737898ca54f044 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:14.127237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba247842-f561-4345-ba34-ae6e5e694dab None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.127526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba247842-f561-4345-ba34-ae6e5e694dab None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.127802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba247842-f561-4345-ba34-ae6e5e694dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.146034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:14.152767 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9310f-eb6f-45be-862c-dbf96131f4be admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.161101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ba247842-f561-4345-ba34-ae6e5e694dab None None] MFA Rules not processed for user `454cf1524b5b494db6c1170e75d5eebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:14.162536 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ba247842-f561-4345-ba34-ae6e5e694dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:14.221285 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:14.238509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53a583-7b5c-4648-a239-b27576f81582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.239609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53a583-7b5c-4648-a239-b27576f81582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.240083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53a583-7b5c-4648-a239-b27576f81582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.240515 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53a583-7b5c-4648-a239-b27576f81582 admin admin] PATH_INFO: `/v3/projects/ab0af7fb6c7f417684cf0d4bbc4c6ec1/users/9f96d5da564242bfa6bb4798ad05d76c/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.261688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53a583-7b5c-4648-a239-b27576f81582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0af7fb6c7f417684cf0d4bbc4c6ec1, user_id=9f96d5da564242bfa6bb4798ad05d76c, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.265380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53a583-7b5c-4648-a239-b27576f81582 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.265894 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 978/1972] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:14.267194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2703a28-3c61-4928-bb57-bc24d480d966 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.267491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2703a28-3c61-4928-bb57-bc24d480d966 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.267765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2703a28-3c61-4928-bb57-bc24d480d966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.287425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 995/1973] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:14 2022] PUT /identity/v3/projects/ab0af7fb6c7f417684cf0d4bbc4c6ec1/users/9f96d5da564242bfa6bb4798ad05d76c/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:14.288800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53a583-7b5c-4648-a239-b27576f81582 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:14.291006 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ea53a583-7b5c-4648-a239-b27576f81582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:14.305862 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a2703a28-3c61-4928-bb57-bc24d480d966 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:14.307744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a2703a28-3c61-4928-bb57-bc24d480d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:14.360158 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53a583-7b5c-4648-a239-b27576f81582 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.364500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058cfb6-c150-498d-9e11-8303c08842bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.365136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058cfb6-c150-498d-9e11-8303c08842bb service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.365423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058cfb6-c150-498d-9e11-8303c08842bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.366100 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058cfb6-c150-498d-9e11-8303c08842bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.392233 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 979/1974] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:14.392233 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca7e86-705d-4698-8e8f-09c25ce536b9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.392233 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca7e86-705d-4698-8e8f-09c25ce536b9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.392233 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca7e86-705d-4698-8e8f-09c25ce536b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.425208 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-b5ca7e86-705d-4698-8e8f-09c25ce536b9 None None] MFA Rules not processed for user `9f96d5da564242bfa6bb4798ad05d76c`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:14.426445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b5ca7e86-705d-4698-8e8f-09c25ce536b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:14.452644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058cfb6-c150-498d-9e11-8303c08842bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.468127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058cfb6-c150-498d-9e11-8303c08842bb service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.471453 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 996/1975] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:14.472807 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78226fa-0d94-4da7-b336-3123d6b2e8c9 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.473098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78226fa-0d94-4da7-b336-3123d6b2e8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.473513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78226fa-0d94-4da7-b336-3123d6b2e8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.497087 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d78226fa-0d94-4da7-b336-3123d6b2e8c9 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:14.498407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d78226fa-0d94-4da7-b336-3123d6b2e8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:14.507945 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 997/1976] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:14.512820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78226fa-0d94-4da7-b336-3123d6b2e8c9 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:14.522547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78226fa-0d94-4da7-b336-3123d6b2e8c9 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.526986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 980/1977] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:14.527584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521f77d-95eb-4403-be13-8a2e2a563669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.528253 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521f77d-95eb-4403-be13-8a2e2a563669 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.528540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521f77d-95eb-4403-be13-8a2e2a563669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.528867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521f77d-95eb-4403-be13-8a2e2a563669 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.529710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521f77d-95eb-4403-be13-8a2e2a563669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:14.530021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521f77d-95eb-4403-be13-8a2e2a563669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.531486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca7e86-705d-4698-8e8f-09c25ce536b9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:14.531677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521f77d-95eb-4403-be13-8a2e2a563669 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.537410 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b5ca7e86-705d-4698-8e8f-09c25ce536b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:14.550477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 998/1978] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:35:14.551918 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521f77d-95eb-4403-be13-8a2e2a563669 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:14.565101 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521f77d-95eb-4403-be13-8a2e2a563669 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.567182 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca7e86-705d-4698-8e8f-09c25ce536b9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.574677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf011af-9c4b-449f-8316-c77b73fb2afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.575901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf011af-9c4b-449f-8316-c77b73fb2afa admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.576429 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf011af-9c4b-449f-8316-c77b73fb2afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.576606 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf011af-9c4b-449f-8316-c77b73fb2afa admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.577182 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372f010-81a2-4f84-b7c3-2e9c1c04631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.577325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf011af-9c4b-449f-8316-c77b73fb2afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.577938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f010-81a2-4f84-b7c3-2e9c1c04631e admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.578277 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f010-81a2-4f84-b7c3-2e9c1c04631e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.578561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f010-81a2-4f84-b7c3-2e9c1c04631e admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.579568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372f010-81a2-4f84-b7c3-2e9c1c04631e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.579653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf011af-9c4b-449f-8316-c77b73fb2afa admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.581533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372f010-81a2-4f84-b7c3-2e9c1c04631e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.597190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:14.614416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 999/1979] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:14 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:14.615188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf011af-9c4b-449f-8316-c77b73fb2afa admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:14.617037 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 981/1980] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:14 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:14.619021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372f010-81a2-4f84-b7c3-2e9c1c04631e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:14.685942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf011af-9c4b-449f-8316-c77b73fb2afa admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.698352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:14.722598 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372f010-81a2-4f84-b7c3-2e9c1c04631e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.729349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46467b73-12fa-4a69-8aaa-24825f7df804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.729991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46467b73-12fa-4a69-8aaa-24825f7df804 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.730272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46467b73-12fa-4a69-8aaa-24825f7df804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.730603 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46467b73-12fa-4a69-8aaa-24825f7df804 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.731402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46467b73-12fa-4a69-8aaa-24825f7df804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.734198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46467b73-12fa-4a69-8aaa-24825f7df804 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.752057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dd41a-7b75-408a-83da-f12622f57003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.752929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dd41a-7b75-408a-83da-f12622f57003 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.753363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dd41a-7b75-408a-83da-f12622f57003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.753636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dd41a-7b75-408a-83da-f12622f57003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.756133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-686dd41a-7b75-408a-83da-f12622f57003 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:14.764664 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 982/1981] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:14 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:14.765829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46467b73-12fa-4a69-8aaa-24825f7df804 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:14.777976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46467b73-12fa-4a69-8aaa-24825f7df804 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.783366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f28434-735b-45cc-a035-42ff3546afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.784471 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f28434-735b-45cc-a035-42ff3546afac admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.784964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f28434-735b-45cc-a035-42ff3546afac admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.785442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f28434-735b-45cc-a035-42ff3546afac admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.786282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f28434-735b-45cc-a035-42ff3546afac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.788619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f28434-735b-45cc-a035-42ff3546afac admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.827166 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 983/1982] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:14 2022] POST /identity/v3/users => generated 296 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:14.828245 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f28434-735b-45cc-a035-42ff3546afac admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:14.840411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f28434-735b-45cc-a035-42ff3546afac admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.845745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa41133-05c1-43fc-89cd-7b5d615c0327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.846493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa41133-05c1-43fc-89cd-7b5d615c0327 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.846780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa41133-05c1-43fc-89cd-7b5d615c0327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.847054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa41133-05c1-43fc-89cd-7b5d615c0327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.847763 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa41133-05c1-43fc-89cd-7b5d615c0327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.848852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dd41a-7b75-408a-83da-f12622f57003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.849509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa41133-05c1-43fc-89cd-7b5d615c0327 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.851242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686dd41a-7b75-408a-83da-f12622f57003 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.863583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 984/1983] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:14.864633 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa41133-05c1-43fc-89cd-7b5d615c0327 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:14.879817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa41133-05c1-43fc-89cd-7b5d615c0327 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.887599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f886bf-a855-4357-a35f-b3c67145d1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.889017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f886bf-a855-4357-a35f-b3c67145d1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.889838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f886bf-a855-4357-a35f-b3c67145d1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.890749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f886bf-a855-4357-a35f-b3c67145d1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.894693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f886bf-a855-4357-a35f-b3c67145d1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.897035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f886bf-a855-4357-a35f-b3c67145d1b9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.907580 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1000/1984] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:14.910194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dd41a-7b75-408a-83da-f12622f57003 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:14.919487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 985/1985] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:14.920583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f886bf-a855-4357-a35f-b3c67145d1b9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:14.932703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dd41a-7b75-408a-83da-f12622f57003 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.934125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f886bf-a855-4357-a35f-b3c67145d1b9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:14.939964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717376-1b81-4354-affb-a031590e92ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.940728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717376-1b81-4354-affb-a031590e92ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.941016 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717376-1b81-4354-affb-a031590e92ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.941828 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717376-1b81-4354-affb-a031590e92ee admin admin] PATH_INFO: `/v3/projects/c7d1a42594a04e818a169f29468e860a/users/6640d6e022f34745ac64ebd1ed374249/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.941943 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083902b1-6ddd-4394-8783-e73b318cc9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:14.942565 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083902b1-6ddd-4394-8783-e73b318cc9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:14.942917 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083902b1-6ddd-4394-8783-e73b318cc9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:14.943280 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083902b1-6ddd-4394-8783-e73b318cc9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:14.944491 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083902b1-6ddd-4394-8783-e73b318cc9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.947313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083902b1-6ddd-4394-8783-e73b318cc9d3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.978480 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717376-1b81-4354-affb-a031590e92ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d1a42594a04e818a169f29468e860a, user_id=6640d6e022f34745ac64ebd1ed374249, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:14.987267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1001/1986] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:14.988753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66717376-1b81-4354-affb-a031590e92ee admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:14.991460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083902b1-6ddd-4394-8783-e73b318cc9d3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:15.013539 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083902b1-6ddd-4394-8783-e73b318cc9d3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:15.017994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 986/1987] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:14 2022] PUT /identity/v3/projects/c7d1a42594a04e818a169f29468e860a/users/6640d6e022f34745ac64ebd1ed374249/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:15.018976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717376-1b81-4354-affb-a031590e92ee admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:15.129491 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:15.141255 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66717376-1b81-4354-affb-a031590e92ee admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:15.148253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2355cf-8ed3-464e-87fd-a67b11f853af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:15.149361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2355cf-8ed3-464e-87fd-a67b11f853af admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:15.149778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2355cf-8ed3-464e-87fd-a67b11f853af admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:15.150067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2355cf-8ed3-464e-87fd-a67b11f853af admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:15.150841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2355cf-8ed3-464e-87fd-a67b11f853af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:15.156492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2355cf-8ed3-464e-87fd-a67b11f853af admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:15.162513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f7a42-2baf-4c37-9d87-eaf5e981dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:15.168922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f7a42-2baf-4c37-9d87-eaf5e981dc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:15.169749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f7a42-2baf-4c37-9d87-eaf5e981dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:15.171920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 987/1988] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:15.172837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f7a42-2baf-4c37-9d87-eaf5e981dc65 admin admin] PATH_INFO: `/v3/projects/b25649ab93c542fab006a096294f00ab/users/149af1912c254771aead8901924a78e3/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:15.175773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2355cf-8ed3-464e-87fd-a67b11f853af admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:15.201653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2355cf-8ed3-464e-87fd-a67b11f853af admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:15.211247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e3ebd-aa5d-46e5-b7eb-5a3ac3d167b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:15.213846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f7a42-2baf-4c37-9d87-eaf5e981dc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25649ab93c542fab006a096294f00ab, user_id=149af1912c254771aead8901924a78e3, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:15.214393 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3ebd-aa5d-46e5-b7eb-5a3ac3d167b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:15.214725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3ebd-aa5d-46e5-b7eb-5a3ac3d167b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:15.214982 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3ebd-aa5d-46e5-b7eb-5a3ac3d167b8 admin admin] PATH_INFO: `/v3/projects/c7d1a42594a04e818a169f29468e860a/users/6640d6e022f34745ac64ebd1ed374249/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:15.221178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e3ebd-aa5d-46e5-b7eb-5a3ac3d167b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d1a42594a04e818a169f29468e860a, user_id=6640d6e022f34745ac64ebd1ed374249, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:15.222929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f7a42-2baf-4c37-9d87-eaf5e981dc65 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:15.227488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e3ebd-aa5d-46e5-b7eb-5a3ac3d167b8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:15.249858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1002/1989] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:14 2022] PUT /identity/v3/projects/b25649ab93c542fab006a096294f00ab/users/149af1912c254771aead8901924a78e3/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:15.259941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 988/1990] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:15 2022] PUT /identity/v3/projects/c7d1a42594a04e818a169f29468e860a/users/6640d6e022f34745ac64ebd1ed374249/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:15.263835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14e12a-442c-400f-b429-40b07e82415d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:15.264160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14e12a-442c-400f-b429-40b07e82415d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:15.264444 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14e12a-442c-400f-b429-40b07e82415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:15.265611 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94005fcd-90ce-407d-8789-3e9592e05670 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:15.266185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94005fcd-90ce-407d-8789-3e9592e05670 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:15.266542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94005fcd-90ce-407d-8789-3e9592e05670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:15.307529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8e14e12a-442c-400f-b429-40b07e82415d None None] MFA Rules not processed for user `149af1912c254771aead8901924a78e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:15.309088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8e14e12a-442c-400f-b429-40b07e82415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:15.317691 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-94005fcd-90ce-407d-8789-3e9592e05670 None None] MFA Rules not processed for user `6640d6e022f34745ac64ebd1ed374249`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:15.319429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-94005fcd-90ce-407d-8789-3e9592e05670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:15.367567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:15.413741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1003/1991] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:15.423819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 989/1992] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:15.429718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14e12a-442c-400f-b429-40b07e82415d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:15.432077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8e14e12a-442c-400f-b429-40b07e82415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:15.506375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14e12a-442c-400f-b429-40b07e82415d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:15.511033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f243ca-ca67-45da-b00b-57aba893dbfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:15.511824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f243ca-ca67-45da-b00b-57aba893dbfd service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:15.512124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f243ca-ca67-45da-b00b-57aba893dbfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:15.512499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f243ca-ca67-45da-b00b-57aba893dbfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:15.521817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94005fcd-90ce-407d-8789-3e9592e05670 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:15.530330 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f243ca-ca67-45da-b00b-57aba893dbfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:15.531886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f243ca-ca67-45da-b00b-57aba893dbfd service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:15.536011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94005fcd-90ce-407d-8789-3e9592e05670 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:15.542131 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c2ece-22b7-4e48-942b-9afb84a94130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:15.542771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c2ece-22b7-4e48-942b-9afb84a94130 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:15.543889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c2ece-22b7-4e48-942b-9afb84a94130 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:15.544184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c2ece-22b7-4e48-942b-9afb84a94130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:15.546063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1004/1993] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:15.572709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f243ca-ca67-45da-b00b-57aba893dbfd service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:15.642888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c2ece-22b7-4e48-942b-9afb84a94130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:15.644547 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c2ece-22b7-4e48-942b-9afb84a94130 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:15.680450 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f243ca-ca67-45da-b00b-57aba893dbfd service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:15.688861 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1029b4-1fa4-407a-b23b-0421ee220eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:15.690821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1029b4-1fa4-407a-b23b-0421ee220eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:15.691172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1029b4-1fa4-407a-b23b-0421ee220eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:15.691602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1029b4-1fa4-407a-b23b-0421ee220eaf admin admin] PATH_INFO: `/v3/users/149af1912c254771aead8901924a78e3` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:15.692921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 990/1994] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:15.693738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1029b4-1fa4-407a-b23b-0421ee220eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=149af1912c254771aead8901924a78e3)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:15.699241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1029b4-1fa4-407a-b23b-0421ee220eaf admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:15.749829 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:15.820152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6a1029b4-1fa4-407a-b23b-0421ee220eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149af1912c254771aead8901924a78e3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:15.832011 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6a1029b4-1fa4-407a-b23b-0421ee220eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149af1912c254771aead8901924a78e3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:15.841896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6a1029b4-1fa4-407a-b23b-0421ee220eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149af1912c254771aead8901924a78e3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:15.842716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6a1029b4-1fa4-407a-b23b-0421ee220eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149af1912c254771aead8901924a78e3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:15.843497 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-6a1029b4-1fa4-407a-b23b-0421ee220eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149af1912c254771aead8901924a78e3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:15.866368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c2ece-22b7-4e48-942b-9afb84a94130 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:15.868318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a53c2ece-22b7-4e48-942b-9afb84a94130 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:15.902039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1005/1995] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:15 2022] DELETE /identity/v3/users/149af1912c254771aead8901924a78e3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:15.907681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679bec5-002f-4524-8008-6aba69f96c10 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:15.907681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679bec5-002f-4524-8008-6aba69f96c10 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:15.908115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679bec5-002f-4524-8008-6aba69f96c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:15.912058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c2ece-22b7-4e48-942b-9afb84a94130 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:15.953145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-4679bec5-002f-4524-8008-6aba69f96c10 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:15.954479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4679bec5-002f-4524-8008-6aba69f96c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:16.011211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a4ab3-c516-4159-aaad-c0b2b719b23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:16.011479 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4ab3-c516-4159-aaad-c0b2b719b23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:16.011831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4ab3-c516-4159-aaad-c0b2b719b23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:16.012190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4ab3-c516-4159-aaad-c0b2b719b23c admin admin] PATH_INFO: `/v3/users/78a147fe39f34c6f80e4c57dbd7a4457` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:16.013806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a4ab3-c516-4159-aaad-c0b2b719b23c admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a147fe39f34c6f80e4c57dbd7a4457)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:16.016480 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a4ab3-c516-4159-aaad-c0b2b719b23c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:16.071667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1006/1996] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:16.082214 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679bec5-002f-4524-8008-6aba69f96c10 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:16.086245 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4679bec5-002f-4524-8008-6aba69f96c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:16.124368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c80a4ab3-c516-4159-aaad-c0b2b719b23c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a147fe39f34c6f80e4c57dbd7a4457'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:16.137258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c80a4ab3-c516-4159-aaad-c0b2b719b23c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a147fe39f34c6f80e4c57dbd7a4457'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:16.170072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c80a4ab3-c516-4159-aaad-c0b2b719b23c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a147fe39f34c6f80e4c57dbd7a4457'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:16.171123 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c80a4ab3-c516-4159-aaad-c0b2b719b23c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a147fe39f34c6f80e4c57dbd7a4457'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:16.171962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c80a4ab3-c516-4159-aaad-c0b2b719b23c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a147fe39f34c6f80e4c57dbd7a4457'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:16.203591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:16.227972 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 991/1997] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:15 2022] DELETE /identity/v3/users/78a147fe39f34c6f80e4c57dbd7a4457 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:16.232788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20547c9-8199-4ca9-959e-8612497fe187 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:16.233165 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20547c9-8199-4ca9-959e-8612497fe187 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:16.233668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20547c9-8199-4ca9-959e-8612497fe187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:16.259364 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679bec5-002f-4524-8008-6aba69f96c10 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:16.279367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d20547c9-8199-4ca9-959e-8612497fe187 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:16.282443 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d20547c9-8199-4ca9-959e-8612497fe187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:16.326334 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:16.345062 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c6605-dd1c-446c-8e17-e46c2d82f4fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:16.346427 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c6605-dd1c-446c-8e17-e46c2d82f4fc service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:16.346540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c6605-dd1c-446c-8e17-e46c2d82f4fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:16.346808 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c6605-dd1c-446c-8e17-e46c2d82f4fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:16.349389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-909c6605-dd1c-446c-8e17-e46c2d82f4fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:16.374150 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 992/1998] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:16.383390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20547c9-8199-4ca9-959e-8612497fe187 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:16.387620 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d20547c9-8199-4ca9-959e-8612497fe187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:16.421466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20547c9-8199-4ca9-959e-8612497fe187 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:16.430165 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6544b7-741a-4b53-bbd7-c4489c88850b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:16.430823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6544b7-741a-4b53-bbd7-c4489c88850b service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:16.433095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6544b7-741a-4b53-bbd7-c4489c88850b service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:16.433452 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6544b7-741a-4b53-bbd7-c4489c88850b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:16.441194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c6605-dd1c-446c-8e17-e46c2d82f4fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:16.442917 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c6605-dd1c-446c-8e17-e46c2d82f4fc service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:16.462495 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6544b7-741a-4b53-bbd7-c4489c88850b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:16.462495 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6544b7-741a-4b53-bbd7-c4489c88850b service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:16.472865 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1007/1999] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:16.482361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 993/2000] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:17.076352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c6605-dd1c-446c-8e17-e46c2d82f4fc service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:17.078138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-909c6605-dd1c-446c-8e17-e46c2d82f4fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:17.097171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6544b7-741a-4b53-bbd7-c4489c88850b service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:17.101674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5d6544b7-741a-4b53-bbd7-c4489c88850b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:17.115685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c6605-dd1c-446c-8e17-e46c2d82f4fc service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:17.121477 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6544b7-741a-4b53-bbd7-c4489c88850b service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:17.126615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:17.127283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:17.127570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:17.127849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] PATH_INFO: `/v3/projects/7979ce66baf545e0928df99e63a94d5b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:17.129514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7979ce66baf545e0928df99e63a94d5b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:17.131427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:17.132857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:17.133548 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:17.133882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:17.134123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] PATH_INFO: `/v3/projects/b25649ab93c542fab006a096294f00ab` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:17.135491 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25649ab93c542fab006a096294f00ab)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:17.137462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:17.200431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7979ce66baf545e0928df99e63a94d5b', 'request_id': 'req-3654c0f9-4ef3-41e5-bc48-456d424c5c88'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.222466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7979ce66baf545e0928df99e63a94d5b', 'request_id': 'req-3654c0f9-4ef3-41e5-bc48-456d424c5c88'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.227058 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25649ab93c542fab006a096294f00ab', 'request_id': 'req-e7997375-6956-48b8-a5d7-b3afbeea7147'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.234805 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25649ab93c542fab006a096294f00ab', 'request_id': 'req-e7997375-6956-48b8-a5d7-b3afbeea7147'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.242492 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25649ab93c542fab006a096294f00ab', 'request_id': 'req-e7997375-6956-48b8-a5d7-b3afbeea7147'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.244071 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7979ce66baf545e0928df99e63a94d5b', 'request_id': 'req-3654c0f9-4ef3-41e5-bc48-456d424c5c88'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.271708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] The token cache is being invalidate because project 7979ce66baf545e0928df99e63a94d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:17.271708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.271708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.271708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 994/2001] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:17 2022] DELETE /identity/v3/projects/7979ce66baf545e0928df99e63a94d5b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:17.271708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:17.273409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:17.274067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] The token cache is being invalidate because project b25649ab93c542fab006a096294f00ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:17.276209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.276209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.283969 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1008/2002] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:17 2022] DELETE /identity/v3/projects/b25649ab93c542fab006a096294f00ab => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:17.285340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:17.287079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:17.367182 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654c0f9-4ef3-41e5-bc48-456d424c5c88 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:17.374089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bc5df-5083-4da0-8393-99e9c42ef4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:17.374765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bc5df-5083-4da0-8393-99e9c42ef4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:17.375086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bc5df-5083-4da0-8393-99e9c42ef4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:17.375396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bc5df-5083-4da0-8393-99e9c42ef4d5 admin admin] PATH_INFO: `/v3/users/a6402dd612f9458ab3d56056a8611584` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:17.376644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bc5df-5083-4da0-8393-99e9c42ef4d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6402dd612f9458ab3d56056a8611584)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:17.378208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7997375-6956-48b8-a5d7-b3afbeea7147 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:17.378600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bc5df-5083-4da0-8393-99e9c42ef4d5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:17.381428 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:17.384339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:17.384997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:17.385284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:17.385741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] PATH_INFO: `/v3/users/454cf1524b5b494db6c1170e75d5eebc` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:17.386942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=454cf1524b5b494db6c1170e75d5eebc)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:17.388728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:17.416255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:17.437814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fb8bc5df-5083-4da0-8393-99e9c42ef4d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6402dd612f9458ab3d56056a8611584'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.446936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fb8bc5df-5083-4da0-8393-99e9c42ef4d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6402dd612f9458ab3d56056a8611584'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.447359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454cf1524b5b494db6c1170e75d5eebc'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.456727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454cf1524b5b494db6c1170e75d5eebc'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.460141 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fb8bc5df-5083-4da0-8393-99e9c42ef4d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6402dd612f9458ab3d56056a8611584'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.461612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fb8bc5df-5083-4da0-8393-99e9c42ef4d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6402dd612f9458ab3d56056a8611584'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.462340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fb8bc5df-5083-4da0-8393-99e9c42ef4d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6402dd612f9458ab3d56056a8611584'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.466681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454cf1524b5b494db6c1170e75d5eebc'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.467306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454cf1524b5b494db6c1170e75d5eebc'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.468000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454cf1524b5b494db6c1170e75d5eebc'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:17.490564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 995/2003] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:17 2022] DELETE /identity/v3/users/a6402dd612f9458ab3d56056a8611584 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:17.491778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2725492-1e24-4da0-b85c-84a4e6ce0256 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:17.492190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2725492-1e24-4da0-b85c-84a4e6ce0256 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:17.492464 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2725492-1e24-4da0-b85c-84a4e6ce0256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:17.495428 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1009/2004] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:17 2022] DELETE /identity/v3/users/454cf1524b5b494db6c1170e75d5eebc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:17.496496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:17.498089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:17.523043 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e2725492-1e24-4da0-b85c-84a4e6ce0256 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:17.524523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e2725492-1e24-4da0-b85c-84a4e6ce0256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:17.605823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecd321-dab5-4335-bfe6-926f70ade1bc admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:17.616112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0324c-15dc-4d97-ad69-b60f7f2e7144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:17.616815 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0324c-15dc-4d97-ad69-b60f7f2e7144 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:17.617046 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0324c-15dc-4d97-ad69-b60f7f2e7144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:17.618000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0324c-15dc-4d97-ad69-b60f7f2e7144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:17.620887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b5f0324c-15dc-4d97-ad69-b60f7f2e7144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:17.649618 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 996/2005] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:17.651831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdf4cc-b437-4b46-b17f-ef42f1920599 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:17.652177 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdf4cc-b437-4b46-b17f-ef42f1920599 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:17.652462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdf4cc-b437-4b46-b17f-ef42f1920599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:17.683020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-94cdf4cc-b437-4b46-b17f-ef42f1920599 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:17.685715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-94cdf4cc-b437-4b46-b17f-ef42f1920599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:17.709035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 997/2006] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:17.710777 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb074-8b8f-4ef5-bf63-1cf07bad2774 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:17.713249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb074-8b8f-4ef5-bf63-1cf07bad2774 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:17.716355 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb074-8b8f-4ef5-bf63-1cf07bad2774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:17.739670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0324c-15dc-4d97-ad69-b60f7f2e7144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:17.741486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0324c-15dc-4d97-ad69-b60f7f2e7144 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:17.763290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5abcb074-8b8f-4ef5-bf63-1cf07bad2774 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:17.764560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5abcb074-8b8f-4ef5-bf63-1cf07bad2774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:17.766921 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1010/2007] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:17.787085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 998/2008] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:17.792015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0324c-15dc-4d97-ad69-b60f7f2e7144 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:17.808137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0324c-15dc-4d97-ad69-b60f7f2e7144 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:17.813127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fb849-ace8-49a2-bd49-1f904452f7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:17.816345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcb074-8b8f-4ef5-bf63-1cf07bad2774 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:17.818155 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fb849-ace8-49a2-bd49-1f904452f7be admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:17.818337 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5abcb074-8b8f-4ef5-bf63-1cf07bad2774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:17.818766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fb849-ace8-49a2-bd49-1f904452f7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:17.819196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fb849-ace8-49a2-bd49-1f904452f7be admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:17.821214 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fb849-ace8-49a2-bd49-1f904452f7be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:17.821698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fb849-ace8-49a2-bd49-1f904452f7be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:17.823883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fb849-ace8-49a2-bd49-1f904452f7be admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:17.838676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1011/2009] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:17.842741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fb849-ace8-49a2-bd49-1f904452f7be admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:17.857585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fb849-ace8-49a2-bd49-1f904452f7be admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:17.863955 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c49552-c9c2-492a-a59a-799866b6ccbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:17.865250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c49552-c9c2-492a-a59a-799866b6ccbe admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:17.865722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c49552-c9c2-492a-a59a-799866b6ccbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:17.866341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c49552-c9c2-492a-a59a-799866b6ccbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:17.867758 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c49552-c9c2-492a-a59a-799866b6ccbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:17.870476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c49552-c9c2-492a-a59a-799866b6ccbe admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:17.917964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1012/2010] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:17 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:17.935443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c49552-c9c2-492a-a59a-799866b6ccbe admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:17.946789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcb074-8b8f-4ef5-bf63-1cf07bad2774 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:17.972563 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:17.977687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:18.057186 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac646ab-8c1c-47af-888f-a804e3e6bbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:18.060735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac646ab-8c1c-47af-888f-a804e3e6bbcc service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:18.060735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac646ab-8c1c-47af-888f-a804e3e6bbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:18.061076 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac646ab-8c1c-47af-888f-a804e3e6bbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:18.102422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c49552-c9c2-492a-a59a-799866b6ccbe admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:18.107597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60030bbe-c25a-4603-b3b4-abc4888e7f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:18.108301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60030bbe-c25a-4603-b3b4-abc4888e7f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:18.108885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60030bbe-c25a-4603-b3b4-abc4888e7f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:18.108885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60030bbe-c25a-4603-b3b4-abc4888e7f40 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:18.110145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60030bbe-c25a-4603-b3b4-abc4888e7f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:18.113093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60030bbe-c25a-4603-b3b4-abc4888e7f40 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:18.157057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1013/2011] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:17 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:18.159267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60030bbe-c25a-4603-b3b4-abc4888e7f40 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:18.178905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60030bbe-c25a-4603-b3b4-abc4888e7f40 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:18.191484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac646ab-8c1c-47af-888f-a804e3e6bbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:18.193801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac646ab-8c1c-47af-888f-a804e3e6bbcc service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:18.206543 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2f387-8cd9-4422-bfc9-289a18bc3dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:18.207669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f387-8cd9-4422-bfc9-289a18bc3dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:18.208347 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f387-8cd9-4422-bfc9-289a18bc3dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:18.208864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f387-8cd9-4422-bfc9-289a18bc3dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:18.210205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2f387-8cd9-4422-bfc9-289a18bc3dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:18.216237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2f387-8cd9-4422-bfc9-289a18bc3dd4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:18.218692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 999/2012] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:35:18.226322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac646ab-8c1c-47af-888f-a804e3e6bbcc service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:18.237868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6ac646ab-8c1c-47af-888f-a804e3e6bbcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:18.251578 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1014/2013] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:18.254935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2f387-8cd9-4422-bfc9-289a18bc3dd4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:18.265986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac646ab-8c1c-47af-888f-a804e3e6bbcc service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:18.272802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:18.274162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:18.274646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:18.275314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0 admin admin] PATH_INFO: `/v3/projects/e03a7c730e4145bd8eeac6d4adbf6637` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:18.276988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e03a7c730e4145bd8eeac6d4adbf6637)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:18.279807 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:18.280315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2f387-8cd9-4422-bfc9-289a18bc3dd4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:18.293287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd152f6-23fa-4dd3-8d31-c677ad085b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:18.294323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd152f6-23fa-4dd3-8d31-c677ad085b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:18.294628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd152f6-23fa-4dd3-8d31-c677ad085b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:18.294896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd152f6-23fa-4dd3-8d31-c677ad085b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:18.295722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd152f6-23fa-4dd3-8d31-c677ad085b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:18.305647 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd152f6-23fa-4dd3-8d31-c677ad085b06 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:18.333804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1015/2014] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:18.337253 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd152f6-23fa-4dd3-8d31-c677ad085b06 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:18.353238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd152f6-23fa-4dd3-8d31-c677ad085b06 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:18.374117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03a7c730e4145bd8eeac6d4adbf6637', 'request_id': 'req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:18.388793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03a7c730e4145bd8eeac6d4adbf6637', 'request_id': 'req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:18.402082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03a7c730e4145bd8eeac6d4adbf6637', 'request_id': 'req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:18.429107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0 admin admin] The token cache is being invalidate because project e03a7c730e4145bd8eeac6d4adbf6637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:18.429412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:18.430938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-459f63f0-77dc-4caf-98dc-2bcfcb4eedd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:18.432952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1000/2015] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:18 2022] DELETE /identity/v3/projects/e03a7c730e4145bd8eeac6d4adbf6637 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:18.438617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14044-38c4-451f-9eee-305fdbe4a774 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:18.439211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14044-38c4-451f-9eee-305fdbe4a774 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:18.439211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14044-38c4-451f-9eee-305fdbe4a774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:18.452420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eab0a6-3b88-4d57-85cf-98100d647edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:18.453464 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eab0a6-3b88-4d57-85cf-98100d647edf admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:18.453822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eab0a6-3b88-4d57-85cf-98100d647edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:18.454164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eab0a6-3b88-4d57-85cf-98100d647edf admin admin] PATH_INFO: `/v3/projects/c03a58d889ab48f0a15f6ce8f570631e/users/f9dc90dcd94f4eae99a10f595c779118/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:18.471558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eab0a6-3b88-4d57-85cf-98100d647edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03a58d889ab48f0a15f6ce8f570631e, user_id=f9dc90dcd94f4eae99a10f595c779118, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:18.475083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eab0a6-3b88-4d57-85cf-98100d647edf admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:18.477295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-bfa14044-38c4-451f-9eee-305fdbe4a774 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:18.478991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bfa14044-38c4-451f-9eee-305fdbe4a774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:18.498446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1016/2016] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:18 2022] PUT /identity/v3/projects/c03a58d889ab48f0a15f6ce8f570631e/users/f9dc90dcd94f4eae99a10f595c779118/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:18.498833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1001/2017] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:18.508692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426a4d9-acca-482c-b50a-65ee7ee973d2 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:18.509102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fe1d5-779e-46d7-b8bf-e4f5ea2d8736 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:18.509232 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426a4d9-acca-482c-b50a-65ee7ee973d2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:18.509413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426a4d9-acca-482c-b50a-65ee7ee973d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:18.509538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fe1d5-779e-46d7-b8bf-e4f5ea2d8736 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:18.509760 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fe1d5-779e-46d7-b8bf-e4f5ea2d8736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:18.541553 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7426a4d9-acca-482c-b50a-65ee7ee973d2 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:18.542922 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7426a4d9-acca-482c-b50a-65ee7ee973d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:18.557138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ca7fe1d5-779e-46d7-b8bf-e4f5ea2d8736 None None] MFA Rules not processed for user `f9dc90dcd94f4eae99a10f595c779118`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:18.558900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ca7fe1d5-779e-46d7-b8bf-e4f5ea2d8736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:18.622081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:18.653621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1002/2018] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:18.657787 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426a4d9-acca-482c-b50a-65ee7ee973d2 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:18.670882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426a4d9-acca-482c-b50a-65ee7ee973d2 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:18.680824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:18.701293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd903e-d5ba-44ed-a5cf-a1dcc22ead15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:18.702220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd903e-d5ba-44ed-a5cf-a1dcc22ead15 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:18.703680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd903e-d5ba-44ed-a5cf-a1dcc22ead15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:18.704971 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd903e-d5ba-44ed-a5cf-a1dcc22ead15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:18.706722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1017/2019] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:18.708651 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd903e-d5ba-44ed-a5cf-a1dcc22ead15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:18.714516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fe1d5-779e-46d7-b8bf-e4f5ea2d8736 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:18.715533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd903e-d5ba-44ed-a5cf-a1dcc22ead15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:18.717359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ca7fe1d5-779e-46d7-b8bf-e4f5ea2d8736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:18.717484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd903e-d5ba-44ed-a5cf-a1dcc22ead15 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:18.742061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1003/2020] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:18.747051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd903e-d5ba-44ed-a5cf-a1dcc22ead15 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:18.775190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd903e-d5ba-44ed-a5cf-a1dcc22ead15 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:18.785012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75460c-6066-435f-bfe0-b55989b7f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:18.786047 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75460c-6066-435f-bfe0-b55989b7f244 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:18.786543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75460c-6066-435f-bfe0-b55989b7f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:18.787446 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75460c-6066-435f-bfe0-b55989b7f244 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:18.788955 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75460c-6066-435f-bfe0-b55989b7f244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:18.792315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75460c-6066-435f-bfe0-b55989b7f244 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:18.826328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fe1d5-779e-46d7-b8bf-e4f5ea2d8736 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:18.830683 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fedd43-993e-4dc6-9fb4-4c34bba154b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:18.831828 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fedd43-993e-4dc6-9fb4-4c34bba154b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:18.831828 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fedd43-993e-4dc6-9fb4-4c34bba154b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:18.832048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fedd43-993e-4dc6-9fb4-4c34bba154b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:18.843263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fedd43-993e-4dc6-9fb4-4c34bba154b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:18.845098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fedd43-993e-4dc6-9fb4-4c34bba154b4 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:18.857088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1004/2021] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:18 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:18.857990 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75460c-6066-435f-bfe0-b55989b7f244 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:18.859754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6a75460c-6066-435f-bfe0-b55989b7f244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:18.870324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1018/2022] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:35:18.871165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fedd43-993e-4dc6-9fb4-4c34bba154b4 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:18.886872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fedd43-993e-4dc6-9fb4-4c34bba154b4 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:18.952083 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75460c-6066-435f-bfe0-b55989b7f244 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:18.962536 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:18.963707 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:18.964124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:18.965403 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] PATH_INFO: `/v3/projects/2c1e6b43b1ba4f71b7228e867c0dfabf` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:18.966928 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1e6b43b1ba4f71b7228e867c0dfabf)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:18.970262 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:19.025426 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31904b9c-b36f-4d1c-888a-fb8501c58ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:19.026744 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31904b9c-b36f-4d1c-888a-fb8501c58ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:19.027922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31904b9c-b36f-4d1c-888a-fb8501c58ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:19.028287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31904b9c-b36f-4d1c-888a-fb8501c58ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:19.029141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31904b9c-b36f-4d1c-888a-fb8501c58ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:19.032030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31904b9c-b36f-4d1c-888a-fb8501c58ca9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:19.066243 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1e6b43b1ba4f71b7228e867c0dfabf', 'request_id': 'req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:19.066811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1019/2023] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:18 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:19.073007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31904b9c-b36f-4d1c-888a-fb8501c58ca9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:19.087684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1e6b43b1ba4f71b7228e867c0dfabf', 'request_id': 'req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:19.093484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31904b9c-b36f-4d1c-888a-fb8501c58ca9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:19.111941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1e6b43b1ba4f71b7228e867c0dfabf', 'request_id': 'req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:19.157452 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] The token cache is being invalidate because project 2c1e6b43b1ba4f71b7228e867c0dfabf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:19.158058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:19.161207 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:19.174718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1005/2024] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:18 2022] DELETE /identity/v3/projects/2c1e6b43b1ba4f71b7228e867c0dfabf => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:19.176324 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:19.178055 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ab755-7fec-4e06-aef3-a12e324fdef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:19.179277 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ab755-7fec-4e06-aef3-a12e324fdef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:19.181705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ab755-7fec-4e06-aef3-a12e324fdef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:19.182159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ab755-7fec-4e06-aef3-a12e324fdef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:19.182780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:19.183579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ab755-7fec-4e06-aef3-a12e324fdef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:19.187163 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ab755-7fec-4e06-aef3-a12e324fdef7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:19.215547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1020/2025] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:19.216757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ab755-7fec-4e06-aef3-a12e324fdef7 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:19.218587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def679bd-9bf5-4b2f-8f3e-df873dea7fd5 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:19.219652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-725ab755-7fec-4e06-aef3-a12e324fdef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:19.230357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:19.233706 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:19.234028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:19.234311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] PATH_INFO: `/v3/users/04d70059d7a5460d93357c8db94e151f` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:19.240470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ab755-7fec-4e06-aef3-a12e324fdef7 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:19.240976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d70059d7a5460d93357c8db94e151f)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:19.243802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:19.247166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1feba-89f9-4603-a065-67b3a7164e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:19.247796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1feba-89f9-4603-a065-67b3a7164e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:19.248203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1feba-89f9-4603-a065-67b3a7164e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:19.248503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1feba-89f9-4603-a065-67b3a7164e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:19.249376 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1feba-89f9-4603-a065-67b3a7164e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:19.251238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1feba-89f9-4603-a065-67b3a7164e50 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:19.278902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1021/2026] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:19.283937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1feba-89f9-4603-a065-67b3a7164e50 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:19.307454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1feba-89f9-4603-a065-67b3a7164e50 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:19.313946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c5ba2-76c1-451d-b7eb-f112a5cc9292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:19.314919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c5ba2-76c1-451d-b7eb-f112a5cc9292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:19.315195 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c5ba2-76c1-451d-b7eb-f112a5cc9292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:19.315470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c5ba2-76c1-451d-b7eb-f112a5cc9292 admin admin] PATH_INFO: `/v3/projects/ddf80395741449299a737da777a2d3e4/users/fd2525eb84cf40b08ae2c75f35a901d9/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:19.320011 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:19.341780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:19.343228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c5ba2-76c1-451d-b7eb-f112a5cc9292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf80395741449299a737da777a2d3e4, user_id=fd2525eb84cf40b08ae2c75f35a901d9, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:19.346309 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c5ba2-76c1-451d-b7eb-f112a5cc9292 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:19.351421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d70059d7a5460d93357c8db94e151f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:19.364204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d70059d7a5460d93357c8db94e151f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:19.378755 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1022/2027] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:19 2022] PUT /identity/v3/projects/ddf80395741449299a737da777a2d3e4/users/fd2525eb84cf40b08ae2c75f35a901d9/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:19.382135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e055-dc59-4f3f-97dd-c3b7fd86784a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:19.382431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e055-dc59-4f3f-97dd-c3b7fd86784a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:19.382829 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e055-dc59-4f3f-97dd-c3b7fd86784a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:19.394214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d70059d7a5460d93357c8db94e151f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:19.394937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d70059d7a5460d93357c8db94e151f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:19.395574 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d70059d7a5460d93357c8db94e151f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:19.429067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1006/2028] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:19 2022] DELETE /identity/v3/users/04d70059d7a5460d93357c8db94e151f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:19.454570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1704e055-dc59-4f3f-97dd-c3b7fd86784a None None] MFA Rules not processed for user `fd2525eb84cf40b08ae2c75f35a901d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:19.457773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1704e055-dc59-4f3f-97dd-c3b7fd86784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:19.584043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1023/2029] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:19.645735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:19.647738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:19.756281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b12f3-7588-4ef4-acca-83a21aefc2c6 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:19.766346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8523a-7c2a-4d78-9c43-140009d7e34d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:19.768402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8523a-7c2a-4d78-9c43-140009d7e34d service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:19.769650 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8523a-7c2a-4d78-9c43-140009d7e34d service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:19.770149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8523a-7c2a-4d78-9c43-140009d7e34d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:19.784270 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8523a-7c2a-4d78-9c43-140009d7e34d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:19.785803 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8523a-7c2a-4d78-9c43-140009d7e34d service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:19.797409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1007/2030] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:20.405631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704e055-dc59-4f3f-97dd-c3b7fd86784a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:20.407217 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1704e055-dc59-4f3f-97dd-c3b7fd86784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:20.485867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704e055-dc59-4f3f-97dd-c3b7fd86784a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:20.490849 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:20.491564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:20.491873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:20.492209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] PATH_INFO: `/v3/projects/35f48574dc9a432bbdab6865e6940663` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:20.493458 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f48574dc9a432bbdab6865e6940663)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:20.495431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:20.551586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f48574dc9a432bbdab6865e6940663', 'request_id': 'req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:20.561240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f48574dc9a432bbdab6865e6940663', 'request_id': 'req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:20.569920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f48574dc9a432bbdab6865e6940663', 'request_id': 'req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:20.606980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] The token cache is being invalidate because project 35f48574dc9a432bbdab6865e6940663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:20.607709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:20.608712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:20.614863 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1024/2031] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:20 2022] DELETE /identity/v3/projects/35f48574dc9a432bbdab6865e6940663 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:20.625593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8523a-7c2a-4d78-9c43-140009d7e34d service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:20.669571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8523a-7c2a-4d78-9c43-140009d7e34d service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:20.744108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03e2b3-2dcf-4e12-a5e7-46f04bb52dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:20.744773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e2b3-2dcf-4e12-a5e7-46f04bb52dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:20.745362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e2b3-2dcf-4e12-a5e7-46f04bb52dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:20.745705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e2b3-2dcf-4e12-a5e7-46f04bb52dc9 admin admin] PATH_INFO: `/v3/users/a99beb1fbba0488e80b10653099676d4` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:20.746843 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03e2b3-2dcf-4e12-a5e7-46f04bb52dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99beb1fbba0488e80b10653099676d4)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:20.748818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03e2b3-2dcf-4e12-a5e7-46f04bb52dc9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:20.814530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd03e2b3-2dcf-4e12-a5e7-46f04bb52dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99beb1fbba0488e80b10653099676d4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:20.827564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd03e2b3-2dcf-4e12-a5e7-46f04bb52dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99beb1fbba0488e80b10653099676d4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:20.837784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd03e2b3-2dcf-4e12-a5e7-46f04bb52dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99beb1fbba0488e80b10653099676d4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:20.838548 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd03e2b3-2dcf-4e12-a5e7-46f04bb52dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99beb1fbba0488e80b10653099676d4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:20.839755 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd03e2b3-2dcf-4e12-a5e7-46f04bb52dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99beb1fbba0488e80b10653099676d4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:20.841900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:20.869486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1008/2032] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:20 2022] DELETE /identity/v3/users/a99beb1fbba0488e80b10653099676d4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:21.174281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:21.176226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:21.187306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:21.191562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca17d9-0aff-4b3e-b194-f48dcbef07b9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:21.270186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac62f2-40d4-498c-8fd5-597f5bec4457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:21.270984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac62f2-40d4-498c-8fd5-597f5bec4457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:21.271369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac62f2-40d4-498c-8fd5-597f5bec4457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:21.271545 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac62f2-40d4-498c-8fd5-597f5bec4457 admin admin] PATH_INFO: `/v3/projects/bf0cc8b4987e4f6f882a2ca53cc964c7` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:21.272772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac62f2-40d4-498c-8fd5-597f5bec4457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0cc8b4987e4f6f882a2ca53cc964c7)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:21.276489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac62f2-40d4-498c-8fd5-597f5bec4457 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:21.341172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cbac62f2-40d4-498c-8fd5-597f5bec4457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0cc8b4987e4f6f882a2ca53cc964c7', 'request_id': 'req-cbac62f2-40d4-498c-8fd5-597f5bec4457'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:21.357184 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cbac62f2-40d4-498c-8fd5-597f5bec4457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0cc8b4987e4f6f882a2ca53cc964c7', 'request_id': 'req-cbac62f2-40d4-498c-8fd5-597f5bec4457'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:21.363784 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cbac62f2-40d4-498c-8fd5-597f5bec4457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0cc8b4987e4f6f882a2ca53cc964c7', 'request_id': 'req-cbac62f2-40d4-498c-8fd5-597f5bec4457'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:21.383686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cbac62f2-40d4-498c-8fd5-597f5bec4457 admin admin] The token cache is being invalidate because project bf0cc8b4987e4f6f882a2ca53cc964c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:21.384285 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cbac62f2-40d4-498c-8fd5-597f5bec4457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:21.385192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cbac62f2-40d4-498c-8fd5-597f5bec4457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:21.392580 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1025/2033] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:21 2022] DELETE /identity/v3/projects/bf0cc8b4987e4f6f882a2ca53cc964c7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:21.393869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b106f5-e5dd-4b11-bb8c-f899392512bc None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:21.394172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b106f5-e5dd-4b11-bb8c-f899392512bc None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:21.394507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b106f5-e5dd-4b11-bb8c-f899392512bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:21.420692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f8b106f5-e5dd-4b11-bb8c-f899392512bc None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:21.423044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f8b106f5-e5dd-4b11-bb8c-f899392512bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:21.549699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa62b6-5278-4006-bf9b-045f946d8b90 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:21.550254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa62b6-5278-4006-bf9b-045f946d8b90 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:21.550254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa62b6-5278-4006-bf9b-045f946d8b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:21.556829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1009/2034] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:21.576613 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3efa62b6-5278-4006-bf9b-045f946d8b90 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:21.577846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3efa62b6-5278-4006-bf9b-045f946d8b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:21.587940 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1026/2035] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:21.592405 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b106f5-e5dd-4b11-bb8c-f899392512bc None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:21.603988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b106f5-e5dd-4b11-bb8c-f899392512bc None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:21.622866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47eef3-d01e-4643-bd4d-a34be085357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:21.623507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47eef3-d01e-4643-bd4d-a34be085357f admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:21.623801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47eef3-d01e-4643-bd4d-a34be085357f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:21.624145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47eef3-d01e-4643-bd4d-a34be085357f admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:21.624892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47eef3-d01e-4643-bd4d-a34be085357f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:21.625168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47eef3-d01e-4643-bd4d-a34be085357f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:21.627507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47eef3-d01e-4643-bd4d-a34be085357f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:21.650363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1010/2036] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:35:21.654608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa62b6-5278-4006-bf9b-045f946d8b90 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:21.668841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa62b6-5278-4006-bf9b-045f946d8b90 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:21.674239 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139ad12-85fb-440b-8188-42532d17e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:21.674939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139ad12-85fb-440b-8188-42532d17e36a admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:21.675293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139ad12-85fb-440b-8188-42532d17e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:21.675638 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139ad12-85fb-440b-8188-42532d17e36a admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:21.676916 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139ad12-85fb-440b-8188-42532d17e36a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:21.679342 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139ad12-85fb-440b-8188-42532d17e36a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:21.719715 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1027/2037] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:21 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:21.721074 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47eef3-d01e-4643-bd4d-a34be085357f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:21.735198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47eef3-d01e-4643-bd4d-a34be085357f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:21.813380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caad123-7a00-4949-9763-0ded50751a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:21.814021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caad123-7a00-4949-9763-0ded50751a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:21.814306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caad123-7a00-4949-9763-0ded50751a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:21.814583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caad123-7a00-4949-9763-0ded50751a62 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:21.815260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caad123-7a00-4949-9763-0ded50751a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:21.817261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caad123-7a00-4949-9763-0ded50751a62 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:21.843909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1011/2038] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:21 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:21.845989 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139ad12-85fb-440b-8188-42532d17e36a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:21.878202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139ad12-85fb-440b-8188-42532d17e36a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:21.887835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b1f95-4f62-4219-96f2-de3351baa635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:21.887835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b1f95-4f62-4219-96f2-de3351baa635 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:21.887835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b1f95-4f62-4219-96f2-de3351baa635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:21.887835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b1f95-4f62-4219-96f2-de3351baa635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:21.888257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b1f95-4f62-4219-96f2-de3351baa635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:21.889060 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caad123-7a00-4949-9763-0ded50751a62 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:21.890690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b1f95-4f62-4219-96f2-de3351baa635 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:21.890837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3caad123-7a00-4949-9763-0ded50751a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:21.904349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caad123-7a00-4949-9763-0ded50751a62 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:21.908624 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1028/2039] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:21.911433 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f95a8-b1e3-4f4b-a64d-31831fb463dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:21.912092 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b1f95-4f62-4219-96f2-de3351baa635 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:21.912498 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f95a8-b1e3-4f4b-a64d-31831fb463dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:21.912796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f95a8-b1e3-4f4b-a64d-31831fb463dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:21.913236 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f95a8-b1e3-4f4b-a64d-31831fb463dc admin admin] PATH_INFO: `/v3/users/f9dc90dcd94f4eae99a10f595c779118` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:21.915057 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f95a8-b1e3-4f4b-a64d-31831fb463dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9dc90dcd94f4eae99a10f595c779118)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:21.917261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f95a8-b1e3-4f4b-a64d-31831fb463dc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:21.927574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b1f95-4f62-4219-96f2-de3351baa635 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:21.937728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1bd30-5934-4c47-b75c-048208f996e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:21.938387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1bd30-5934-4c47-b75c-048208f996e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:21.938678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1bd30-5934-4c47-b75c-048208f996e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:21.938961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1bd30-5934-4c47-b75c-048208f996e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:21.939678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1bd30-5934-4c47-b75c-048208f996e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:21.941361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1bd30-5934-4c47-b75c-048208f996e4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:21.957843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1029/2040] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:21.960336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1bd30-5934-4c47-b75c-048208f996e4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:21.974004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1bd30-5934-4c47-b75c-048208f996e4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:21.980245 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1086415-a8f3-46df-b920-1b8244c9d386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:21.980934 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086415-a8f3-46df-b920-1b8244c9d386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:21.981220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086415-a8f3-46df-b920-1b8244c9d386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:21.981525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086415-a8f3-46df-b920-1b8244c9d386 admin admin] PATH_INFO: `/v3/projects/94518b334f384ff68bf9f9bccbf31a91/users/67d412ad4890479ba2e844b6d8d7c180/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:21.987779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-840f95a8-b1e3-4f4b-a64d-31831fb463dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9dc90dcd94f4eae99a10f595c779118'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:21.994977 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:22.000549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-840f95a8-b1e3-4f4b-a64d-31831fb463dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9dc90dcd94f4eae99a10f595c779118'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:22.012332 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-840f95a8-b1e3-4f4b-a64d-31831fb463dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9dc90dcd94f4eae99a10f595c779118'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:22.014306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-840f95a8-b1e3-4f4b-a64d-31831fb463dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9dc90dcd94f4eae99a10f595c779118'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:22.015432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-840f95a8-b1e3-4f4b-a64d-31831fb463dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9dc90dcd94f4eae99a10f595c779118'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:22.020446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1086415-a8f3-46df-b920-1b8244c9d386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94518b334f384ff68bf9f9bccbf31a91, user_id=67d412ad4890479ba2e844b6d8d7c180, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:22.027790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1086415-a8f3-46df-b920-1b8244c9d386 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:22.051285 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1030/2041] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:21 2022] PUT /identity/v3/projects/94518b334f384ff68bf9f9bccbf31a91/users/67d412ad4890479ba2e844b6d8d7c180/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:22.051586 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1012/2042] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:21 2022] DELETE /identity/v3/users/f9dc90dcd94f4eae99a10f595c779118 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:22.056549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a445baa-0a1c-4c72-b3e6-38559142521c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:22.056782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a445baa-0a1c-4c72-b3e6-38559142521c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:22.057069 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a445baa-0a1c-4c72-b3e6-38559142521c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:22.066335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843811e4-beee-4e0c-9b66-3bde16e55cc5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:22.066628 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843811e4-beee-4e0c-9b66-3bde16e55cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:22.066936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843811e4-beee-4e0c-9b66-3bde16e55cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:22.098106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-1a445baa-0a1c-4c72-b3e6-38559142521c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:22.099823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1a445baa-0a1c-4c72-b3e6-38559142521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:22.129924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:22.153688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-843811e4-beee-4e0c-9b66-3bde16e55cc5 None None] MFA Rules not processed for user `67d412ad4890479ba2e844b6d8d7c180`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:22.155953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-843811e4-beee-4e0c-9b66-3bde16e55cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:22.221495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1031/2043] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:22.231482 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a445baa-0a1c-4c72-b3e6-38559142521c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:22.232983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1a445baa-0a1c-4c72-b3e6-38559142521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:22.248803 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1013/2044] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:22.253332 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843811e4-beee-4e0c-9b66-3bde16e55cc5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:22.255222 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-843811e4-beee-4e0c-9b66-3bde16e55cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:22.270847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843811e4-beee-4e0c-9b66-3bde16e55cc5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:22.279556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6e493-b74c-4fa0-b492-2f006a6cd8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:22.280397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6e493-b74c-4fa0-b492-2f006a6cd8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:22.280784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6e493-b74c-4fa0-b492-2f006a6cd8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:22.281326 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6e493-b74c-4fa0-b492-2f006a6cd8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:22.282206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6e493-b74c-4fa0-b492-2f006a6cd8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:22.284680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6e493-b74c-4fa0-b492-2f006a6cd8d1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:22.306959 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a445baa-0a1c-4c72-b3e6-38559142521c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:22.312806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e245f2-d723-4d5f-9142-8aa418442766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:22.313538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e245f2-d723-4d5f-9142-8aa418442766 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:22.313885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e245f2-d723-4d5f-9142-8aa418442766 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:22.314240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e245f2-d723-4d5f-9142-8aa418442766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:22.325115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1014/2045] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:22 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:22.326923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e245f2-d723-4d5f-9142-8aa418442766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:22.329159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e245f2-d723-4d5f-9142-8aa418442766 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:22.329318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6e493-b74c-4fa0-b492-2f006a6cd8d1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:22.352320 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1032/2046] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:22.411802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6e493-b74c-4fa0-b492-2f006a6cd8d1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:22.418676 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bf1e8-6aaf-4345-835a-a18b07703354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:22.419425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bf1e8-6aaf-4345-835a-a18b07703354 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:22.419806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bf1e8-6aaf-4345-835a-a18b07703354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:22.420277 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bf1e8-6aaf-4345-835a-a18b07703354 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:22.420916 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bf1e8-6aaf-4345-835a-a18b07703354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:22.422890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bf1e8-6aaf-4345-835a-a18b07703354 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:22.446169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1015/2047] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:22 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:22.450746 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e245f2-d723-4d5f-9142-8aa418442766 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:22.461747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e245f2-d723-4d5f-9142-8aa418442766 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:22.466718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd47f6a-2c1d-46da-8e2c-d48afdefd0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:22.467355 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd47f6a-2c1d-46da-8e2c-d48afdefd0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:22.467639 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd47f6a-2c1d-46da-8e2c-d48afdefd0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:22.467949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd47f6a-2c1d-46da-8e2c-d48afdefd0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:22.468658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd47f6a-2c1d-46da-8e2c-d48afdefd0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:22.470272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd47f6a-2c1d-46da-8e2c-d48afdefd0f5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:22.483185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1033/2048] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:22.487448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bf1e8-6aaf-4345-835a-a18b07703354 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:22.498989 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bf1e8-6aaf-4345-835a-a18b07703354 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:22.504966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f35e7b-a364-499e-953c-325e8695f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:22.505841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f35e7b-a364-499e-953c-325e8695f2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:22.505971 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f35e7b-a364-499e-953c-325e8695f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:22.506198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f35e7b-a364-499e-953c-325e8695f2cb admin admin] PATH_INFO: `/v3/projects/0db182d5c7734c20970440257dff8ace/users/ca0928906caa473cb63d80e7732d42d4/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:22.529705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f35e7b-a364-499e-953c-325e8695f2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db182d5c7734c20970440257dff8ace, user_id=ca0928906caa473cb63d80e7732d42d4, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:22.532577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f35e7b-a364-499e-953c-325e8695f2cb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:22.567417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1016/2049] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:22 2022] PUT /identity/v3/projects/0db182d5c7734c20970440257dff8ace/users/ca0928906caa473cb63d80e7732d42d4/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:22.572028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd47f6a-2c1d-46da-8e2c-d48afdefd0f5 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:22.589441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd47f6a-2c1d-46da-8e2c-d48afdefd0f5 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:22.686443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d2092-be9a-454c-b369-11f78dbeab7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:22.686690 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2092-be9a-454c-b369-11f78dbeab7d admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:22.686916 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2092-be9a-454c-b369-11f78dbeab7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:22.687421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2092-be9a-454c-b369-11f78dbeab7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:22.688790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d2092-be9a-454c-b369-11f78dbeab7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:22.690895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d2092-be9a-454c-b369-11f78dbeab7d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:22.714084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1034/2050] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:22.718476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f35e7b-a364-499e-953c-325e8695f2cb admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:22.728622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:22.765997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f35e7b-a364-499e-953c-325e8695f2cb admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:22.779818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdfcaf-7b0a-46de-b0ec-4b114ffec543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:22.780896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdfcaf-7b0a-46de-b0ec-4b114ffec543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:22.782066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdfcaf-7b0a-46de-b0ec-4b114ffec543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:22.782692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdfcaf-7b0a-46de-b0ec-4b114ffec543 admin admin] PATH_INFO: `/v3/projects/0db182d5c7734c20970440257dff8ace/users/ca0928906caa473cb63d80e7732d42d4/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:22.787773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdfcaf-7b0a-46de-b0ec-4b114ffec543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db182d5c7734c20970440257dff8ace, user_id=ca0928906caa473cb63d80e7732d42d4, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:22.796129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdfcaf-7b0a-46de-b0ec-4b114ffec543 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:22.837878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1017/2051] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:22 2022] PUT /identity/v3/projects/0db182d5c7734c20970440257dff8ace/users/ca0928906caa473cb63d80e7732d42d4/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:22.848622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f47f8e-8425-4fbe-8781-0748a454c32d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:22.849033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f47f8e-8425-4fbe-8781-0748a454c32d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:22.849420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f47f8e-8425-4fbe-8781-0748a454c32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:22.885772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdfcaf-7b0a-46de-b0ec-4b114ffec543 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:22.887595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-16bdfcaf-7b0a-46de-b0ec-4b114ffec543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:22.945033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-84f47f8e-8425-4fbe-8781-0748a454c32d None None] MFA Rules not processed for user `ca0928906caa473cb63d80e7732d42d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:22.946549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-84f47f8e-8425-4fbe-8781-0748a454c32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:23.028499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:23.032309 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdfcaf-7b0a-46de-b0ec-4b114ffec543 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:23.039170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329972a-b8c1-43c1-a636-c6385de708f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:23.040238 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329972a-b8c1-43c1-a636-c6385de708f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:23.040627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329972a-b8c1-43c1-a636-c6385de708f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:23.041006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329972a-b8c1-43c1-a636-c6385de708f4 admin admin] PATH_INFO: `/v3/projects/c03a58d889ab48f0a15f6ce8f570631e` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:23.042577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329972a-b8c1-43c1-a636-c6385de708f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03a58d889ab48f0a15f6ce8f570631e)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:23.044989 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329972a-b8c1-43c1-a636-c6385de708f4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:23.101375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1035/2052] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:23.115521 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f47f8e-8425-4fbe-8781-0748a454c32d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:23.117946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-84f47f8e-8425-4fbe-8781-0748a454c32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:23.150031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1329972a-b8c1-43c1-a636-c6385de708f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03a58d889ab48f0a15f6ce8f570631e', 'request_id': 'req-1329972a-b8c1-43c1-a636-c6385de708f4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:23.166456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1329972a-b8c1-43c1-a636-c6385de708f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03a58d889ab48f0a15f6ce8f570631e', 'request_id': 'req-1329972a-b8c1-43c1-a636-c6385de708f4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:23.180641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1329972a-b8c1-43c1-a636-c6385de708f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03a58d889ab48f0a15f6ce8f570631e', 'request_id': 'req-1329972a-b8c1-43c1-a636-c6385de708f4'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:23.210819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1329972a-b8c1-43c1-a636-c6385de708f4 admin admin] The token cache is being invalidate because project c03a58d889ab48f0a15f6ce8f570631e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:23.214318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1329972a-b8c1-43c1-a636-c6385de708f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:23.216053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f47f8e-8425-4fbe-8781-0748a454c32d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:23.216699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-1329972a-b8c1-43c1-a636-c6385de708f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:23.220024 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1018/2053] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:22 2022] DELETE /identity/v3/projects/c03a58d889ab48f0a15f6ce8f570631e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:23.224627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579de844-a204-4fe4-a534-995074922d18 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:23.224923 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579de844-a204-4fe4-a534-995074922d18 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:23.225245 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579de844-a204-4fe4-a534-995074922d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:23.270006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-579de844-a204-4fe4-a534-995074922d18 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:23.272031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-579de844-a204-4fe4-a534-995074922d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:23.312223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defbf0d-4e5d-4581-9ae7-bcaa2d8bf1c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:23.313119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defbf0d-4e5d-4581-9ae7-bcaa2d8bf1c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:23.313559 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defbf0d-4e5d-4581-9ae7-bcaa2d8bf1c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:23.313931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defbf0d-4e5d-4581-9ae7-bcaa2d8bf1c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:23.316068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6defbf0d-4e5d-4581-9ae7-bcaa2d8bf1c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:23.372933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1019/2054] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:23.374125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579de844-a204-4fe4-a534-995074922d18 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:23.375711 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-579de844-a204-4fe4-a534-995074922d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:23.401796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579de844-a204-4fe4-a534-995074922d18 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:23.407282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05565d58-7246-4e71-8fd1-05d43a743c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:23.408237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05565d58-7246-4e71-8fd1-05d43a743c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:23.408620 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05565d58-7246-4e71-8fd1-05d43a743c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:23.408992 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05565d58-7246-4e71-8fd1-05d43a743c24 admin admin] PATH_INFO: `/v3/users/9f96d5da564242bfa6bb4798ad05d76c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:23.410558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05565d58-7246-4e71-8fd1-05d43a743c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f96d5da564242bfa6bb4798ad05d76c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:23.413022 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05565d58-7246-4e71-8fd1-05d43a743c24 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:23.422964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defbf0d-4e5d-4581-9ae7-bcaa2d8bf1c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:23.424551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defbf0d-4e5d-4581-9ae7-bcaa2d8bf1c5 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:23.434921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:23.439320 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1036/2055] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:23.442472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49525ca0-748c-4815-9a7a-c9e82d96d483 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:23.444568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49525ca0-748c-4815-9a7a-c9e82d96d483 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:23.445165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49525ca0-748c-4815-9a7a-c9e82d96d483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:23.473626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-49525ca0-748c-4815-9a7a-c9e82d96d483 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:23.476190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-49525ca0-748c-4815-9a7a-c9e82d96d483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:23.491266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1037/2056] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:23.499527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49525ca0-748c-4815-9a7a-c9e82d96d483 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:23.517218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49525ca0-748c-4815-9a7a-c9e82d96d483 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:23.524375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f36324-89fe-48ee-b427-b5ef2fea6922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:23.525042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36324-89fe-48ee-b427-b5ef2fea6922 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:23.525298 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36324-89fe-48ee-b427-b5ef2fea6922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:23.525651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36324-89fe-48ee-b427-b5ef2fea6922 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:23.526640 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f36324-89fe-48ee-b427-b5ef2fea6922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:23.526996 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f36324-89fe-48ee-b427-b5ef2fea6922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:23.528773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f36324-89fe-48ee-b427-b5ef2fea6922 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:23.533919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-05565d58-7246-4e71-8fd1-05d43a743c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f96d5da564242bfa6bb4798ad05d76c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:23.546251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1038/2057] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:35:23.552051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f36324-89fe-48ee-b427-b5ef2fea6922 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:23.564619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-05565d58-7246-4e71-8fd1-05d43a743c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f96d5da564242bfa6bb4798ad05d76c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:23.565623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f36324-89fe-48ee-b427-b5ef2fea6922 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:23.573816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735fd0d-0341-4800-ad80-02faf3b8bd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:23.574487 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735fd0d-0341-4800-ad80-02faf3b8bd7d admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:23.575162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735fd0d-0341-4800-ad80-02faf3b8bd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:23.575588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735fd0d-0341-4800-ad80-02faf3b8bd7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:23.576512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735fd0d-0341-4800-ad80-02faf3b8bd7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:23.579449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735fd0d-0341-4800-ad80-02faf3b8bd7d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:23.584768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-05565d58-7246-4e71-8fd1-05d43a743c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f96d5da564242bfa6bb4798ad05d76c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:23.585595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-05565d58-7246-4e71-8fd1-05d43a743c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f96d5da564242bfa6bb4798ad05d76c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:23.586754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-05565d58-7246-4e71-8fd1-05d43a743c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f96d5da564242bfa6bb4798ad05d76c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:23.612661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:23.620393 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1020/2058] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:23 2022] DELETE /identity/v3/users/9f96d5da564242bfa6bb4798ad05d76c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:23.625001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0eb6c-6937-47f5-9534-56dccb0c0e70 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:23.625539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0eb6c-6937-47f5-9534-56dccb0c0e70 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:23.626105 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0eb6c-6937-47f5-9534-56dccb0c0e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:23.641225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1039/2059] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:23 2022] POST /identity/v3/projects => generated 391 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:23.642189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735fd0d-0341-4800-ad80-02faf3b8bd7d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:23.644480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a735fd0d-0341-4800-ad80-02faf3b8bd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:23.682198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a1b0eb6c-6937-47f5-9534-56dccb0c0e70 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:23.689947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a1b0eb6c-6937-47f5-9534-56dccb0c0e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:23.832615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1021/2060] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:23.838814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735fd0d-0341-4800-ad80-02faf3b8bd7d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:23.844022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175a7c2-721c-453c-8278-3b6656a7418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:23.844669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175a7c2-721c-453c-8278-3b6656a7418c admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:23.844956 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175a7c2-721c-453c-8278-3b6656a7418c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:23.845187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0eb6c-6937-47f5-9534-56dccb0c0e70 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:23.845394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175a7c2-721c-453c-8278-3b6656a7418c admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:23.845908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175a7c2-721c-453c-8278-3b6656a7418c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:23.846917 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a1b0eb6c-6937-47f5-9534-56dccb0c0e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:23.847874 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175a7c2-721c-453c-8278-3b6656a7418c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:23.889228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1040/2061] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:23 2022] POST /identity/v3/users => generated 296 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:23.898959 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175a7c2-721c-453c-8278-3b6656a7418c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:23.930932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175a7c2-721c-453c-8278-3b6656a7418c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:23.941160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a8d45-aee8-4f74-8627-a17841d291b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:23.941748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a8d45-aee8-4f74-8627-a17841d291b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:23.942033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a8d45-aee8-4f74-8627-a17841d291b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:23.942312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a8d45-aee8-4f74-8627-a17841d291b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:23.943022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a8d45-aee8-4f74-8627-a17841d291b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:23.944657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a8d45-aee8-4f74-8627-a17841d291b3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:23.962710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1041/2062] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:23.963937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a8d45-aee8-4f74-8627-a17841d291b3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:23.971756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0eb6c-6937-47f5-9534-56dccb0c0e70 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:23.976003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da69ac-dcd0-44c7-8054-4f8da954f230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:23.976497 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a8d45-aee8-4f74-8627-a17841d291b3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:23.976901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da69ac-dcd0-44c7-8054-4f8da954f230 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:23.977414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da69ac-dcd0-44c7-8054-4f8da954f230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:23.977793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da69ac-dcd0-44c7-8054-4f8da954f230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:23.982266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d2f5f-c541-4a61-bd12-012f790ed7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:23.984420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d2f5f-c541-4a61-bd12-012f790ed7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:23.989172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d2f5f-c541-4a61-bd12-012f790ed7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:23.989476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d2f5f-c541-4a61-bd12-012f790ed7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:23.990309 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d2f5f-c541-4a61-bd12-012f790ed7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:23.993272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da69ac-dcd0-44c7-8054-4f8da954f230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:23.994221 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d2f5f-c541-4a61-bd12-012f790ed7e3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:23.995225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da69ac-dcd0-44c7-8054-4f8da954f230 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:24.015573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1022/2063] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:24.019737 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1042/2064] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:24.024731 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da69ac-dcd0-44c7-8054-4f8da954f230 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:24.037099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da69ac-dcd0-44c7-8054-4f8da954f230 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:24.042852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7423ed0-6e5c-46c8-9dc1-d0f556a8ca4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:24.043764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7423ed0-6e5c-46c8-9dc1-d0f556a8ca4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:24.044174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7423ed0-6e5c-46c8-9dc1-d0f556a8ca4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:24.044529 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7423ed0-6e5c-46c8-9dc1-d0f556a8ca4a admin admin] PATH_INFO: `/v3/projects/e2e19a1a2ef94e8faa6364e84ed44d37/users/7fc45af3e4374612a42d33f921f336e9/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:24.068175 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7423ed0-6e5c-46c8-9dc1-d0f556a8ca4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e19a1a2ef94e8faa6364e84ed44d37, user_id=7fc45af3e4374612a42d33f921f336e9, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:24.073286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7423ed0-6e5c-46c8-9dc1-d0f556a8ca4a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:24.093798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1023/2065] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:24 2022] PUT /identity/v3/projects/e2e19a1a2ef94e8faa6364e84ed44d37/users/7fc45af3e4374612a42d33f921f336e9/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:24.107294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc9cad-4fd7-453b-9087-8f305ee53589 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:24.107747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc9cad-4fd7-453b-9087-8f305ee53589 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:24.108137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc9cad-4fd7-453b-9087-8f305ee53589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:24.142001 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-90fc9cad-4fd7-453b-9087-8f305ee53589 None None] MFA Rules not processed for user `7fc45af3e4374612a42d33f921f336e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:24.143484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-90fc9cad-4fd7-453b-9087-8f305ee53589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:24.247897 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1043/2066] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:24.260205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7423ed0-6e5c-46c8-9dc1-d0f556a8ca4a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:24.262263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d7423ed0-6e5c-46c8-9dc1-d0f556a8ca4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:24.282836 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:24.313516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc9cad-4fd7-453b-9087-8f305ee53589 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:24.318794 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-90fc9cad-4fd7-453b-9087-8f305ee53589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:24.353381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7423ed0-6e5c-46c8-9dc1-d0f556a8ca4a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:24.358388 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a4a9c-cf42-4fd8-86cb-d1a5c05d20dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:24.359084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a4a9c-cf42-4fd8-86cb-d1a5c05d20dc service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:24.359457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a4a9c-cf42-4fd8-86cb-d1a5c05d20dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:24.359742 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a4a9c-cf42-4fd8-86cb-d1a5c05d20dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:24.377804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a4a9c-cf42-4fd8-86cb-d1a5c05d20dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:24.381394 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a4a9c-cf42-4fd8-86cb-d1a5c05d20dc service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:24.403895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1024/2067] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:24.437994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:24.448685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc9cad-4fd7-453b-9087-8f305ee53589 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:24.456843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f097c-744d-4984-94a1-74a87e644bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:24.457739 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f097c-744d-4984-94a1-74a87e644bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:24.458175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f097c-744d-4984-94a1-74a87e644bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:24.458628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f097c-744d-4984-94a1-74a87e644bed admin admin] PATH_INFO: `/v3/users/67d412ad4890479ba2e844b6d8d7c180` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:24.460163 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f097c-744d-4984-94a1-74a87e644bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d412ad4890479ba2e844b6d8d7c180)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:24.463002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f097c-744d-4984-94a1-74a87e644bed admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:24.520583 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e00f097c-744d-4984-94a1-74a87e644bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d412ad4890479ba2e844b6d8d7c180'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.521820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a4a9c-cf42-4fd8-86cb-d1a5c05d20dc service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:24.524867 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3d4a4a9c-cf42-4fd8-86cb-d1a5c05d20dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:24.530359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e00f097c-744d-4984-94a1-74a87e644bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d412ad4890479ba2e844b6d8d7c180'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.540774 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e00f097c-744d-4984-94a1-74a87e644bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d412ad4890479ba2e844b6d8d7c180'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.541548 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e00f097c-744d-4984-94a1-74a87e644bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d412ad4890479ba2e844b6d8d7c180'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.542179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e00f097c-744d-4984-94a1-74a87e644bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d412ad4890479ba2e844b6d8d7c180'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.544170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a4a9c-cf42-4fd8-86cb-d1a5c05d20dc service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:24.549434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:24.550073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:24.550369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:24.550646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] PATH_INFO: `/v3/projects/ab0af7fb6c7f417684cf0d4bbc4c6ec1` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:24.552144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0af7fb6c7f417684cf0d4bbc4c6ec1)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:24.555583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:24.566629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1044/2068] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:24 2022] DELETE /identity/v3/users/67d412ad4890479ba2e844b6d8d7c180 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:24.571975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44c734-2037-42f7-aaa1-b77f4413beae None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:24.572341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44c734-2037-42f7-aaa1-b77f4413beae None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:24.572687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44c734-2037-42f7-aaa1-b77f4413beae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:24.595451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0f44c734-2037-42f7-aaa1-b77f4413beae None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:24.596836 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0f44c734-2037-42f7-aaa1-b77f4413beae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:24.618117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0af7fb6c7f417684cf0d4bbc4c6ec1', 'request_id': 'req-03a7fa60-fbb5-458d-af78-40879649060f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.629381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0af7fb6c7f417684cf0d4bbc4c6ec1', 'request_id': 'req-03a7fa60-fbb5-458d-af78-40879649060f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.638442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0af7fb6c7f417684cf0d4bbc4c6ec1', 'request_id': 'req-03a7fa60-fbb5-458d-af78-40879649060f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.654357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] The token cache is being invalidate because project ab0af7fb6c7f417684cf0d4bbc4c6ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:24.655039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.655604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.657262 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1025/2069] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:24 2022] DELETE /identity/v3/projects/ab0af7fb6c7f417684cf0d4bbc4c6ec1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:24.661185 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:24.662577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:24.685473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1045/2070] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:24.696670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44c734-2037-42f7-aaa1-b77f4413beae None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:24.698240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0f44c734-2037-42f7-aaa1-b77f4413beae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:24.779814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7fa60-fbb5-458d-af78-40879649060f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:24.785597 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:24.787381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:24.787814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:24.788126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] PATH_INFO: `/v3/users/6640d6e022f34745ac64ebd1ed374249` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:24.790323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6640d6e022f34745ac64ebd1ed374249)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:24.793284 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:24.795004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44c734-2037-42f7-aaa1-b77f4413beae None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:24.808523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcae86b-02a7-40ef-9a4e-dd8f03b7f3f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:24.809176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcae86b-02a7-40ef-9a4e-dd8f03b7f3f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:24.809470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcae86b-02a7-40ef-9a4e-dd8f03b7f3f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:24.809755 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcae86b-02a7-40ef-9a4e-dd8f03b7f3f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:24.844626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcae86b-02a7-40ef-9a4e-dd8f03b7f3f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:24.846147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcae86b-02a7-40ef-9a4e-dd8f03b7f3f7 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:24.864332 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1046/2071] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:24.884587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:24.910734 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6640d6e022f34745ac64ebd1ed374249'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.922072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6640d6e022f34745ac64ebd1ed374249'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.934713 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6640d6e022f34745ac64ebd1ed374249'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.935664 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6640d6e022f34745ac64ebd1ed374249'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.936555 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6640d6e022f34745ac64ebd1ed374249'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:24.975898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1026/2072] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:24 2022] DELETE /identity/v3/users/6640d6e022f34745ac64ebd1ed374249 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:25.253842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcae86b-02a7-40ef-9a4e-dd8f03b7f3f7 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:25.255324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4bcae86b-02a7-40ef-9a4e-dd8f03b7f3f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:25.278245 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcae86b-02a7-40ef-9a4e-dd8f03b7f3f7 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:25.298126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:25.338713 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:25.340412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:25.352735 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:25.353396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:25.353698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:25.353958 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] PATH_INFO: `/v3/projects/94518b334f384ff68bf9f9bccbf31a91` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:25.355258 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94518b334f384ff68bf9f9bccbf31a91)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:25.357277 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:25.441567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07263eae-d4ba-4429-b670-971cce45f718 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:25.450679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94518b334f384ff68bf9f9bccbf31a91', 'request_id': 'req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.456552 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94518b334f384ff68bf9f9bccbf31a91', 'request_id': 'req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.465079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94518b334f384ff68bf9f9bccbf31a91', 'request_id': 'req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.482981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] The token cache is being invalidate because project 94518b334f384ff68bf9f9bccbf31a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:25.482981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.483809 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.485694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1047/2073] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:25 2022] DELETE /identity/v3/projects/94518b334f384ff68bf9f9bccbf31a91 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:25.490174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:25.491780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:25.549213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:25.549967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:25.550184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:25.550466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3 admin admin] PATH_INFO: `/v3/projects/c7d1a42594a04e818a169f29468e860a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:25.551849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d1a42594a04e818a169f29468e860a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:25.554466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:25.568121 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ec1ae-6e97-4237-a27c-2f6b7629cc79 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:25.574216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ab6b0-2d7c-4df5-a16c-28dc61476264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:25.575001 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ab6b0-2d7c-4df5-a16c-28dc61476264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:25.575366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ab6b0-2d7c-4df5-a16c-28dc61476264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:25.575720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ab6b0-2d7c-4df5-a16c-28dc61476264 admin admin] PATH_INFO: `/v3/users/ca0928906caa473cb63d80e7732d42d4` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:25.577025 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ab6b0-2d7c-4df5-a16c-28dc61476264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca0928906caa473cb63d80e7732d42d4)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:25.579057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ab6b0-2d7c-4df5-a16c-28dc61476264 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:25.621842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d1a42594a04e818a169f29468e860a', 'request_id': 'req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.637736 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d1a42594a04e818a169f29468e860a', 'request_id': 'req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.639117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2e9ab6b0-2d7c-4df5-a16c-28dc61476264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca0928906caa473cb63d80e7732d42d4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.643731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:25.649382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d1a42594a04e818a169f29468e860a', 'request_id': 'req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.650245 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2e9ab6b0-2d7c-4df5-a16c-28dc61476264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca0928906caa473cb63d80e7732d42d4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.656569 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:25.665266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2e9ab6b0-2d7c-4df5-a16c-28dc61476264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca0928906caa473cb63d80e7732d42d4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.666633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2e9ab6b0-2d7c-4df5-a16c-28dc61476264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca0928906caa473cb63d80e7732d42d4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.667607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2e9ab6b0-2d7c-4df5-a16c-28dc61476264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca0928906caa473cb63d80e7732d42d4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.668264 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3 admin admin] The token cache is being invalidate because project c7d1a42594a04e818a169f29468e860a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:25.668739 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.670015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f570a54d-ab11-4ac4-b9d9-bc61d64e16e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:25.677192 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1027/2074] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:25 2022] DELETE /identity/v3/projects/c7d1a42594a04e818a169f29468e860a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:25.678519 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa58149-0cae-421a-98ff-2a903c3dba8f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:25.678789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa58149-0cae-421a-98ff-2a903c3dba8f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:25.679072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa58149-0cae-421a-98ff-2a903c3dba8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:25.698529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1048/2075] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:25 2022] DELETE /identity/v3/users/ca0928906caa473cb63d80e7732d42d4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:25.712149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-8aa58149-0cae-421a-98ff-2a903c3dba8f None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:25.713394 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8aa58149-0cae-421a-98ff-2a903c3dba8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:25.782897 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1028/2076] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:25.791419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa275bc-06e0-4a26-b1a2-1bf52ff7f857 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:25.791709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa275bc-06e0-4a26-b1a2-1bf52ff7f857 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:25.792123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa275bc-06e0-4a26-b1a2-1bf52ff7f857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:25.813817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5aa275bc-06e0-4a26-b1a2-1bf52ff7f857 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:25.815283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5aa275bc-06e0-4a26-b1a2-1bf52ff7f857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:25.823597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1049/2077] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:25.827894 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa58149-0cae-421a-98ff-2a903c3dba8f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:25.839192 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa58149-0cae-421a-98ff-2a903c3dba8f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:25.845220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfb553-fd29-48f2-8d8d-eb9ec37f22ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:25.845911 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfb553-fd29-48f2-8d8d-eb9ec37f22ac admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:25.846199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfb553-fd29-48f2-8d8d-eb9ec37f22ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:25.846473 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfb553-fd29-48f2-8d8d-eb9ec37f22ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:25.847234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfb553-fd29-48f2-8d8d-eb9ec37f22ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:25.847544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfb553-fd29-48f2-8d8d-eb9ec37f22ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:25.849322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfb553-fd29-48f2-8d8d-eb9ec37f22ac admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:25.868874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1029/2078] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:25.869566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa275bc-06e0-4a26-b1a2-1bf52ff7f857 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:25.879084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa275bc-06e0-4a26-b1a2-1bf52ff7f857 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:25.884908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fdff3-0bbf-4f3d-a675-c0afcd317ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:25.885604 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fdff3-0bbf-4f3d-a675-c0afcd317ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:25.885913 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fdff3-0bbf-4f3d-a675-c0afcd317ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:25.886160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fdff3-0bbf-4f3d-a675-c0afcd317ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:25.887134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fdff3-0bbf-4f3d-a675-c0afcd317ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:25.889045 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fdff3-0bbf-4f3d-a675-c0afcd317ec7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:25.928196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1050/2079] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:25 2022] POST /identity/v3/projects => generated 359 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:25.933128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfb553-fd29-48f2-8d8d-eb9ec37f22ac admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:25.948866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfb553-fd29-48f2-8d8d-eb9ec37f22ac admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:25.982770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fdff3-0bbf-4f3d-a675-c0afcd317ec7 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:25.984714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-690fdff3-0bbf-4f3d-a675-c0afcd317ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:26.045005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6c832-4699-418b-9730-814f2a1dfc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.045630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6c832-4699-418b-9730-814f2a1dfc67 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.045967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6c832-4699-418b-9730-814f2a1dfc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.046292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6c832-4699-418b-9730-814f2a1dfc67 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.047017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6c832-4699-418b-9730-814f2a1dfc67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.049011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6c832-4699-418b-9730-814f2a1dfc67 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.080251 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1030/2080] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:25 2022] POST /identity/v3/users => generated 280 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:26.082031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6c832-4699-418b-9730-814f2a1dfc67 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:26.086690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-76c6c832-4699-418b-9730-814f2a1dfc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:26.088866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fdff3-0bbf-4f3d-a675-c0afcd317ec7 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.095158 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.095914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.096340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.096625 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] PATH_INFO: `/v3/users/fd2525eb84cf40b08ae2c75f35a901d9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.098186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2525eb84cf40b08ae2c75f35a901d9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.100467 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.120879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6c832-4699-418b-9730-814f2a1dfc67 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.127826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.128738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.129029 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.129309 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6 admin admin] PATH_INFO: `/v3/projects/0db182d5c7734c20970440257dff8ace` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.130534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db182d5c7734c20970440257dff8ace)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.132617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.178318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2525eb84cf40b08ae2c75f35a901d9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:26.186274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2525eb84cf40b08ae2c75f35a901d9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:26.187794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db182d5c7734c20970440257dff8ace', 'request_id': 'req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:26.194499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2525eb84cf40b08ae2c75f35a901d9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:26.195835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2525eb84cf40b08ae2c75f35a901d9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:26.196632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2525eb84cf40b08ae2c75f35a901d9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:26.203036 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db182d5c7734c20970440257dff8ace', 'request_id': 'req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:26.210263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db182d5c7734c20970440257dff8ace', 'request_id': 'req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:26.215154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:26.217900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1051/2081] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:25 2022] DELETE /identity/v3/users/fd2525eb84cf40b08ae2c75f35a901d9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:26.218971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:26.220677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:26.224490 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6 admin admin] The token cache is being invalidate because project 0db182d5c7734c20970440257dff8ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:26.224864 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:26.225900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-378a0d70-4e4b-4f90-bdb8-75beb1f83fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:26.227821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1031/2082] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:26 2022] DELETE /identity/v3/projects/0db182d5c7734c20970440257dff8ace => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:26.229046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c2689-5aac-4397-a280-5a5904984499 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.229330 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c2689-5aac-4397-a280-5a5904984499 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.229596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c2689-5aac-4397-a280-5a5904984499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.245370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:26.251306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ba8c2689-5aac-4397-a280-5a5904984499 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:26.252588 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ba8c2689-5aac-4397-a280-5a5904984499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:26.294201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6d1e2-2c83-4758-875e-564cb337a0b3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.299355 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50e6a6-9a2b-4a7b-a9f0-2812fd95a76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.300013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50e6a6-9a2b-4a7b-a9f0-2812fd95a76e admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.300301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50e6a6-9a2b-4a7b-a9f0-2812fd95a76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.300578 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50e6a6-9a2b-4a7b-a9f0-2812fd95a76e admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.301274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50e6a6-9a2b-4a7b-a9f0-2812fd95a76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.302890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50e6a6-9a2b-4a7b-a9f0-2812fd95a76e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.313738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1032/2083] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:26.314816 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfd1ea-bc59-483f-bd4d-bccc2c9a8379 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.315171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfd1ea-bc59-483f-bd4d-bccc2c9a8379 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.315402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfd1ea-bc59-483f-bd4d-bccc2c9a8379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.317742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1052/2084] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:26.324942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50e6a6-9a2b-4a7b-a9f0-2812fd95a76e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:26.327040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0f50e6a6-9a2b-4a7b-a9f0-2812fd95a76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:26.339637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-15dfd1ea-bc59-483f-bd4d-bccc2c9a8379 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:26.340150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50e6a6-9a2b-4a7b-a9f0-2812fd95a76e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.340878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-15dfd1ea-bc59-483f-bd4d-bccc2c9a8379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:26.345052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b64833-068e-4e01-aad5-258105bd8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.345980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b64833-068e-4e01-aad5-258105bd8e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.346268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b64833-068e-4e01-aad5-258105bd8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.346610 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b64833-068e-4e01-aad5-258105bd8e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.347322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b64833-068e-4e01-aad5-258105bd8e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.348962 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b64833-068e-4e01-aad5-258105bd8e89 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.349061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1033/2085] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:26.349838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfd1ea-bc59-483f-bd4d-bccc2c9a8379 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:26.351135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-15dfd1ea-bc59-483f-bd4d-bccc2c9a8379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:26.364759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1053/2086] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:26.364759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b3751-2533-40c7-87cf-94d21c56e76d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.364759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b3751-2533-40c7-87cf-94d21c56e76d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.364759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b3751-2533-40c7-87cf-94d21c56e76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.384766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-044b3751-2533-40c7-87cf-94d21c56e76d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:26.385912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-044b3751-2533-40c7-87cf-94d21c56e76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:26.394224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1054/2087] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:26.395217 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b3751-2533-40c7-87cf-94d21c56e76d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:26.405370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b3751-2533-40c7-87cf-94d21c56e76d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.410126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90984811-798f-4b4f-a39a-f5b88865da04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.410787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90984811-798f-4b4f-a39a-f5b88865da04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.411076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90984811-798f-4b4f-a39a-f5b88865da04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.411356 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90984811-798f-4b4f-a39a-f5b88865da04 admin admin] PATH_INFO: `/v3/projects/783bea73e54f4651b51f3714f6f5d69a/users/894bc0699b834739926296d24c58cf77/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.416519 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfd1ea-bc59-483f-bd4d-bccc2c9a8379 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.420276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32cd68-311f-478d-9e95-2f555473ed4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.420971 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32cd68-311f-478d-9e95-2f555473ed4b service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.421329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32cd68-311f-478d-9e95-2f555473ed4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.421684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32cd68-311f-478d-9e95-2f555473ed4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.426506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90984811-798f-4b4f-a39a-f5b88865da04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=783bea73e54f4651b51f3714f6f5d69a, user_id=894bc0699b834739926296d24c58cf77, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.429256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90984811-798f-4b4f-a39a-f5b88865da04 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.431618 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32cd68-311f-478d-9e95-2f555473ed4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.433471 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32cd68-311f-478d-9e95-2f555473ed4b service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.443898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1055/2088] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:26 2022] PUT /identity/v3/projects/783bea73e54f4651b51f3714f6f5d69a/users/894bc0699b834739926296d24c58cf77/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:26.444522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1034/2089] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:26.445032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90984811-798f-4b4f-a39a-f5b88865da04 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:26.456218 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2310-d537-4303-aafa-d292bea36397 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.456878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2310-d537-4303-aafa-d292bea36397 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.457987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f2310-d537-4303-aafa-d292bea36397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.502830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-123f2310-d537-4303-aafa-d292bea36397 None None] MFA Rules not processed for user `894bc0699b834739926296d24c58cf77`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:26.504910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-123f2310-d537-4303-aafa-d292bea36397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:26.548368 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90984811-798f-4b4f-a39a-f5b88865da04 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.556069 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eed963-e330-4c1a-a89b-abd2152e6ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.556779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eed963-e330-4c1a-a89b-abd2152e6ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.557074 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eed963-e330-4c1a-a89b-abd2152e6ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.557355 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eed963-e330-4c1a-a89b-abd2152e6ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.558067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eed963-e330-4c1a-a89b-abd2152e6ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:26.558373 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eed963-e330-4c1a-a89b-abd2152e6ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.560318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eed963-e330-4c1a-a89b-abd2152e6ef6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.574615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1056/2090] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:26.578525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eed963-e330-4c1a-a89b-abd2152e6ef6 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:26.582312 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1035/2091] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:26.597876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eed963-e330-4c1a-a89b-abd2152e6ef6 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.608483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2a8e8-ac1c-49a2-a604-8703d78edbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.612664 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2a8e8-ac1c-49a2-a604-8703d78edbfd admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.613207 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2a8e8-ac1c-49a2-a604-8703d78edbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.613502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2a8e8-ac1c-49a2-a604-8703d78edbfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.614261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2a8e8-ac1c-49a2-a604-8703d78edbfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.616375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2a8e8-ac1c-49a2-a604-8703d78edbfd admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.620817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f2310-d537-4303-aafa-d292bea36397 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:26.622369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-123f2310-d537-4303-aafa-d292bea36397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:26.653028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1057/2092] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:26 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:26.666375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2a8e8-ac1c-49a2-a604-8703d78edbfd admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:26.666557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:26.722987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f2310-d537-4303-aafa-d292bea36397 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.750229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:26.772727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2a8e8-ac1c-49a2-a604-8703d78edbfd admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.778872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed90012-66cd-4c52-b2b6-74f657ce86f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.779665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed90012-66cd-4c52-b2b6-74f657ce86f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.780162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed90012-66cd-4c52-b2b6-74f657ce86f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.780545 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed90012-66cd-4c52-b2b6-74f657ce86f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.781319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed90012-66cd-4c52-b2b6-74f657ce86f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.781631 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b86e7-97cd-45b5-8296-72ac472f1659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.782262 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b86e7-97cd-45b5-8296-72ac472f1659 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.782548 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b86e7-97cd-45b5-8296-72ac472f1659 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.782827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b86e7-97cd-45b5-8296-72ac472f1659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.783769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed90012-66cd-4c52-b2b6-74f657ce86f6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.810527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1058/2093] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:26 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:26.815660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed90012-66cd-4c52-b2b6-74f657ce86f6 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:26.828026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed90012-66cd-4c52-b2b6-74f657ce86f6 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.834004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7ff60-3fe0-4db3-9c4e-b6b9a9a792c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.834740 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7ff60-3fe0-4db3-9c4e-b6b9a9a792c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.835151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7ff60-3fe0-4db3-9c4e-b6b9a9a792c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.835506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7ff60-3fe0-4db3-9c4e-b6b9a9a792c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.837303 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7ff60-3fe0-4db3-9c4e-b6b9a9a792c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.839973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7ff60-3fe0-4db3-9c4e-b6b9a9a792c1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.848959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b86e7-97cd-45b5-8296-72ac472f1659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.850391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b86e7-97cd-45b5-8296-72ac472f1659 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.860032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1059/2094] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:26.860376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1036/2095] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:26 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:35:26.880688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7ff60-3fe0-4db3-9c4e-b6b9a9a792c1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:26.881689 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b86e7-97cd-45b5-8296-72ac472f1659 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:26.883412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-701b86e7-97cd-45b5-8296-72ac472f1659 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:26.886838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7ff60-3fe0-4db3-9c4e-b6b9a9a792c1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.892783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f33cda-cc02-45d7-9a33-ca1f00fdb937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.893563 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f33cda-cc02-45d7-9a33-ca1f00fdb937 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.893854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f33cda-cc02-45d7-9a33-ca1f00fdb937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.894136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f33cda-cc02-45d7-9a33-ca1f00fdb937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.895035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f33cda-cc02-45d7-9a33-ca1f00fdb937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.896835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f33cda-cc02-45d7-9a33-ca1f00fdb937 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.903873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b86e7-97cd-45b5-8296-72ac472f1659 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.910671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.910671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.910671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.910671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] PATH_INFO: `/v3/projects/ddf80395741449299a737da777a2d3e4` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.911262 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf80395741449299a737da777a2d3e4)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.913291 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.918573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1060/2096] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:26.919748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f33cda-cc02-45d7-9a33-ca1f00fdb937 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:26.932973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f33cda-cc02-45d7-9a33-ca1f00fdb937 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:26.938063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86748a2a-86c6-4a95-ba4c-e76ede654810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:26.938786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86748a2a-86c6-4a95-ba4c-e76ede654810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:26.939149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86748a2a-86c6-4a95-ba4c-e76ede654810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:26.939506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86748a2a-86c6-4a95-ba4c-e76ede654810 admin admin] PATH_INFO: `/v3/users/894bc0699b834739926296d24c58cf77` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:26.941336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86748a2a-86c6-4a95-ba4c-e76ede654810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=894bc0699b834739926296d24c58cf77)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:26.943369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86748a2a-86c6-4a95-ba4c-e76ede654810 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:26.980885 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf80395741449299a737da777a2d3e4', 'request_id': 'req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:26.990969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf80395741449299a737da777a2d3e4', 'request_id': 'req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:26.997724 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf80395741449299a737da777a2d3e4', 'request_id': 'req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:27.010914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86748a2a-86c6-4a95-ba4c-e76ede654810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '894bc0699b834739926296d24c58cf77'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:27.011412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] The token cache is being invalidate because project ddf80395741449299a737da777a2d3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:27.011700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:27.012399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:27.014128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1037/2097] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:26 2022] DELETE /identity/v3/projects/ddf80395741449299a737da777a2d3e4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:27.014687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:27.016032 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:27.023212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86748a2a-86c6-4a95-ba4c-e76ede654810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '894bc0699b834739926296d24c58cf77'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:27.031362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:27.032465 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86748a2a-86c6-4a95-ba4c-e76ede654810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '894bc0699b834739926296d24c58cf77'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:27.033183 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86748a2a-86c6-4a95-ba4c-e76ede654810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '894bc0699b834739926296d24c58cf77'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:27.034053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-86748a2a-86c6-4a95-ba4c-e76ede654810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '894bc0699b834739926296d24c58cf77'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:27.059800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1061/2098] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:26 2022] DELETE /identity/v3/users/894bc0699b834739926296d24c58cf77 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:27.059800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693f23-19c7-4f1d-ae45-8e990e14c792 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:27.059800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693f23-19c7-4f1d-ae45-8e990e14c792 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:27.059800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693f23-19c7-4f1d-ae45-8e990e14c792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:27.085268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-af693f23-19c7-4f1d-ae45-8e990e14c792 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:27.087223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-af693f23-19c7-4f1d-ae45-8e990e14c792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:27.092788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb84db-540f-4f60-87dd-d03b1bf3bf5d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:27.157067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0751c14-cbe3-4f13-8100-606a92676408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:27.158040 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0751c14-cbe3-4f13-8100-606a92676408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:27.158476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0751c14-cbe3-4f13-8100-606a92676408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:27.158925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0751c14-cbe3-4f13-8100-606a92676408 admin admin] PATH_INFO: `/v3/projects/f436e02bd05f49aca2394429190d77f0/users/853055b8e13449758b18766435a5a91e/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:27.163724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1062/2099] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:27.165363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319f11c-bc2a-4f70-b487-6f718fe17eb8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:27.165652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319f11c-bc2a-4f70-b487-6f718fe17eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:27.165936 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319f11c-bc2a-4f70-b487-6f718fe17eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:27.177339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0751c14-cbe3-4f13-8100-606a92676408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f436e02bd05f49aca2394429190d77f0, user_id=853055b8e13449758b18766435a5a91e, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:27.181219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0751c14-cbe3-4f13-8100-606a92676408 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:27.189190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7319f11c-bc2a-4f70-b487-6f718fe17eb8 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:27.190617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7319f11c-bc2a-4f70-b487-6f718fe17eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:27.203901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1038/2100] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:27 2022] PUT /identity/v3/projects/f436e02bd05f49aca2394429190d77f0/users/853055b8e13449758b18766435a5a91e/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:27.203901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c5f4c-1d6c-4ca9-a723-d7e81b50a0a1 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:27.203901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c5f4c-1d6c-4ca9-a723-d7e81b50a0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:27.203901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c5f4c-1d6c-4ca9-a723-d7e81b50a0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:27.227668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-cc9c5f4c-1d6c-4ca9-a723-d7e81b50a0a1 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:27.229389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cc9c5f4c-1d6c-4ca9-a723-d7e81b50a0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:27.232430 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:27.300772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1063/2101] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:27.302568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f9801-6810-4ac1-9143-809e0613bdfc None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:27.303049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f9801-6810-4ac1-9143-809e0613bdfc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:27.303540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f9801-6810-4ac1-9143-809e0613bdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:27.314920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1039/2102] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:27.314920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c5f4c-1d6c-4ca9-a723-d7e81b50a0a1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:27.315174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cc9c5f4c-1d6c-4ca9-a723-d7e81b50a0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:27.345428 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-fb9f9801-6810-4ac1-9143-809e0613bdfc None None] MFA Rules not processed for user `853055b8e13449758b18766435a5a91e`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:27.347059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fb9f9801-6810-4ac1-9143-809e0613bdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:27.391359 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:27.411566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c5f4c-1d6c-4ca9-a723-d7e81b50a0a1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:27.417021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f414528-4b8e-423c-8eac-40bba80f36b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:27.417980 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f414528-4b8e-423c-8eac-40bba80f36b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:27.418353 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f414528-4b8e-423c-8eac-40bba80f36b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:27.418719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f414528-4b8e-423c-8eac-40bba80f36b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:27.431224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f414528-4b8e-423c-8eac-40bba80f36b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:27.432837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f414528-4b8e-423c-8eac-40bba80f36b9 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:27.446360 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1040/2103] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:27.447439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f414528-4b8e-423c-8eac-40bba80f36b9 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:27.462866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f414528-4b8e-423c-8eac-40bba80f36b9 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:27.466608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1064/2104] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:27.469576 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ac1b4-8ad0-44dc-bf8c-672d56efd41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:27.471966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ac1b4-8ad0-44dc-bf8c-672d56efd41f admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:27.472251 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ac1b4-8ad0-44dc-bf8c-672d56efd41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:27.472594 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ac1b4-8ad0-44dc-bf8c-672d56efd41f admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:27.473445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ac1b4-8ad0-44dc-bf8c-672d56efd41f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:27.473829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ac1b4-8ad0-44dc-bf8c-672d56efd41f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:27.475771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ac1b4-8ad0-44dc-bf8c-672d56efd41f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:27.477771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f9801-6810-4ac1-9143-809e0613bdfc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:27.479413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fb9f9801-6810-4ac1-9143-809e0613bdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:27.488829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1041/2105] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:27.494661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ac1b4-8ad0-44dc-bf8c-672d56efd41f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:27.510213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ac1b4-8ad0-44dc-bf8c-672d56efd41f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:27.517768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28e61f-1294-44f6-837f-f3d6f6a7e757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:27.518684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28e61f-1294-44f6-837f-f3d6f6a7e757 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:27.519808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28e61f-1294-44f6-837f-f3d6f6a7e757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:27.520323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28e61f-1294-44f6-837f-f3d6f6a7e757 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:27.523376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28e61f-1294-44f6-837f-f3d6f6a7e757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:27.527190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28e61f-1294-44f6-837f-f3d6f6a7e757 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:27.571900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1042/2106] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:27 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:27.576082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28e61f-1294-44f6-837f-f3d6f6a7e757 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:27.596898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f9801-6810-4ac1-9143-809e0613bdfc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:27.685979 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8281d-1e99-4789-9c80-c327179e6125 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1832d9988604b81bcb075ae77db6d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:27.687009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8281d-1e99-4789-9c80-c327179e6125 service glance] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:27.687009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8281d-1e99-4789-9c80-c327179e6125 service glance] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:27.687271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8281d-1e99-4789-9c80-c327179e6125 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:27.687798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28e61f-1294-44f6-837f-f3d6f6a7e757 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:27.696772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:27.698455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ab593-8af9-42e1-bf9b-5361e3b92916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:27.699157 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ab593-8af9-42e1-bf9b-5361e3b92916 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:27.699458 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ab593-8af9-42e1-bf9b-5361e3b92916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:27.699749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ab593-8af9-42e1-bf9b-5361e3b92916 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:27.701635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ab593-8af9-42e1-bf9b-5361e3b92916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:27.706679 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ab593-8af9-42e1-bf9b-5361e3b92916 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:27.748329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1043/2107] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:27 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:27.760516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ab593-8af9-42e1-bf9b-5361e3b92916 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:27.785960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ab593-8af9-42e1-bf9b-5361e3b92916 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:27.801178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a95555-39a0-40b7-91c2-87ec35280fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:27.801910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a95555-39a0-40b7-91c2-87ec35280fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:27.802233 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a95555-39a0-40b7-91c2-87ec35280fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:27.802533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a95555-39a0-40b7-91c2-87ec35280fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:27.803245 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a95555-39a0-40b7-91c2-87ec35280fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:27.805716 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a95555-39a0-40b7-91c2-87ec35280fcf admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:27.832098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8281d-1e99-4789-9c80-c327179e6125 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:27.833874 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8281d-1e99-4789-9c80-c327179e6125 service glance] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:27.839005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1044/2108] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:27.840715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a95555-39a0-40b7-91c2-87ec35280fcf admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:27.850710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1065/2109] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:27.869701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a95555-39a0-40b7-91c2-87ec35280fcf admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:27.880778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f696de3-e210-495d-bcb3-cc00f2863986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:27.882056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f696de3-e210-495d-bcb3-cc00f2863986 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:27.882142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f696de3-e210-495d-bcb3-cc00f2863986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:27.882401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f696de3-e210-495d-bcb3-cc00f2863986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:27.883712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f696de3-e210-495d-bcb3-cc00f2863986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:27.885407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f696de3-e210-495d-bcb3-cc00f2863986 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:27.898244 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1045/2110] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:27.903195 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8281d-1e99-4789-9c80-c327179e6125 service glance] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:27.915982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8281d-1e99-4789-9c80-c327179e6125 service glance] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:27.922117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aaa392-1c7f-42d6-bbc4-28f39878a678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:27.922823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaa392-1c7f-42d6-bbc4-28f39878a678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:27.923110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaa392-1c7f-42d6-bbc4-28f39878a678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:27.923389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaa392-1c7f-42d6-bbc4-28f39878a678 admin admin] PATH_INFO: `/v3/projects/0941bf3ed76742b9bcee4ffeea249699/users/b2c654edcab3432a8e7e6a0d84607b63/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:27.948653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aaa392-1c7f-42d6-bbc4-28f39878a678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0941bf3ed76742b9bcee4ffeea249699, user_id=b2c654edcab3432a8e7e6a0d84607b63, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:27.952534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aaa392-1c7f-42d6-bbc4-28f39878a678 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:27.954482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f696de3-e210-495d-bcb3-cc00f2863986 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:27.956605 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9f696de3-e210-495d-bcb3-cc00f2863986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:28.028220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1066/2111] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:27 2022] PUT /identity/v3/projects/0941bf3ed76742b9bcee4ffeea249699/users/b2c654edcab3432a8e7e6a0d84607b63/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:28.028417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f696de3-e210-495d-bcb3-cc00f2863986 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:28.031848 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec902e8-4cd5-4b14-b0b4-25081bb58962 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:28.032061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec902e8-4cd5-4b14-b0b4-25081bb58962 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:28.034762 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec902e8-4cd5-4b14-b0b4-25081bb58962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:28.059589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-fec902e8-4cd5-4b14-b0b4-25081bb58962 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:28.061171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fec902e8-4cd5-4b14-b0b4-25081bb58962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:28.133422 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d260-831f-42bd-9fe6-45ed47d7825d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:28.134441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d260-831f-42bd-9fe6-45ed47d7825d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:28.134973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d260-831f-42bd-9fe6-45ed47d7825d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:28.135085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d260-831f-42bd-9fe6-45ed47d7825d admin admin] PATH_INFO: `/v3/projects/783bea73e54f4651b51f3714f6f5d69a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:28.136533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d260-831f-42bd-9fe6-45ed47d7825d admin admin] RBAC: Authorizing `identity:delete_project(project_id=783bea73e54f4651b51f3714f6f5d69a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:28.139532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d260-831f-42bd-9fe6-45ed47d7825d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:28.145633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1067/2112] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:28.157953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec902e8-4cd5-4b14-b0b4-25081bb58962 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:28.175104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:28.230208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec902e8-4cd5-4b14-b0b4-25081bb58962 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:28.232502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f911d260-831f-42bd-9fe6-45ed47d7825d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783bea73e54f4651b51f3714f6f5d69a', 'request_id': 'req-f911d260-831f-42bd-9fe6-45ed47d7825d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:28.255133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f911d260-831f-42bd-9fe6-45ed47d7825d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783bea73e54f4651b51f3714f6f5d69a', 'request_id': 'req-f911d260-831f-42bd-9fe6-45ed47d7825d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:28.264562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f911d260-831f-42bd-9fe6-45ed47d7825d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783bea73e54f4651b51f3714f6f5d69a', 'request_id': 'req-f911d260-831f-42bd-9fe6-45ed47d7825d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:28.297182 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f911d260-831f-42bd-9fe6-45ed47d7825d admin admin] The token cache is being invalidate because project 783bea73e54f4651b51f3714f6f5d69a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:28.297551 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f911d260-831f-42bd-9fe6-45ed47d7825d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:28.298177 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f911d260-831f-42bd-9fe6-45ed47d7825d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:28.300264 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1046/2113] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:27 2022] DELETE /identity/v3/projects/783bea73e54f4651b51f3714f6f5d69a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:28.306864 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76581ef6-76d9-46db-8d13-7c6a135c3ed0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:28.307161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76581ef6-76d9-46db-8d13-7c6a135c3ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:28.307443 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76581ef6-76d9-46db-8d13-7c6a135c3ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:28.310842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:28.338727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a5257-e6e0-4845-953f-0af1323f0ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:28.340154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a5257-e6e0-4845-953f-0af1323f0ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:28.340897 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a5257-e6e0-4845-953f-0af1323f0ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:28.341733 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a5257-e6e0-4845-953f-0af1323f0ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:28.344794 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d47a5257-e6e0-4845-953f-0af1323f0ca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:28.468060 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a5257-e6e0-4845-953f-0af1323f0ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:28.469547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a5257-e6e0-4845-953f-0af1323f0ca5 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:28.496554 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1068/2114] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:28.557557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-76581ef6-76d9-46db-8d13-7c6a135c3ed0 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:28.559293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-76581ef6-76d9-46db-8d13-7c6a135c3ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:28.578345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80081066-a75f-448b-b160-e32deb25b322 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:28.579066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80081066-a75f-448b-b160-e32deb25b322 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:28.579545 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80081066-a75f-448b-b160-e32deb25b322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:28.588061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1047/2115] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:28.600930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-80081066-a75f-448b-b160-e32deb25b322 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:28.612103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-80081066-a75f-448b-b160-e32deb25b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:28.645699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1069/2116] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:28.651114 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76581ef6-76d9-46db-8d13-7c6a135c3ed0 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:28.662227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76581ef6-76d9-46db-8d13-7c6a135c3ed0 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:28.673825 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e562b09-00d6-4930-8b68-c20519278ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:28.674876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562b09-00d6-4930-8b68-c20519278ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:28.675168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562b09-00d6-4930-8b68-c20519278ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:28.676700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562b09-00d6-4930-8b68-c20519278ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:28.677922 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e562b09-00d6-4930-8b68-c20519278ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:28.678247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e562b09-00d6-4930-8b68-c20519278ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:28.680692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e562b09-00d6-4930-8b68-c20519278ee5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:28.721407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1048/2117] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:28.725735 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80081066-a75f-448b-b160-e32deb25b322 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:28.735786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80081066-a75f-448b-b160-e32deb25b322 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:28.741478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181d8bf-318c-414e-9690-d24455655280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:28.742127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181d8bf-318c-414e-9690-d24455655280 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:28.742950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181d8bf-318c-414e-9690-d24455655280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:28.743226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181d8bf-318c-414e-9690-d24455655280 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:28.743957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181d8bf-318c-414e-9690-d24455655280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:28.745878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181d8bf-318c-414e-9690-d24455655280 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:28.781771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1070/2118] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:28 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:28.786706 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e562b09-00d6-4930-8b68-c20519278ee5 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:28.810471 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e562b09-00d6-4930-8b68-c20519278ee5 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:28.908315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756297-8571-4a9e-8ae8-1d3794685de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:28.908963 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756297-8571-4a9e-8ae8-1d3794685de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:28.909250 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756297-8571-4a9e-8ae8-1d3794685de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:28.909529 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756297-8571-4a9e-8ae8-1d3794685de3 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:28.910206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3756297-8571-4a9e-8ae8-1d3794685de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:28.912132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3756297-8571-4a9e-8ae8-1d3794685de3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:28.937104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1049/2119] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:28 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:28.943934 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181d8bf-318c-414e-9690-d24455655280 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:28.965737 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181d8bf-318c-414e-9690-d24455655280 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:28.972581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a653c0-fc8f-4170-8542-7bf736940a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:28.973336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a653c0-fc8f-4170-8542-7bf736940a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:28.973567 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a653c0-fc8f-4170-8542-7bf736940a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:28.974540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a653c0-fc8f-4170-8542-7bf736940a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:28.974652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a653c0-fc8f-4170-8542-7bf736940a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:28.977936 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a653c0-fc8f-4170-8542-7bf736940a08 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:28.996560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1071/2120] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:28.997752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756297-8571-4a9e-8ae8-1d3794685de3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:29.022541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756297-8571-4a9e-8ae8-1d3794685de3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:29.038349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46ff74-50ba-4287-86bd-924c2b1afa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:29.039818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ff74-50ba-4287-86bd-924c2b1afa21 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:29.040206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ff74-50ba-4287-86bd-924c2b1afa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:29.040489 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ff74-50ba-4287-86bd-924c2b1afa21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:29.041204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46ff74-50ba-4287-86bd-924c2b1afa21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:29.042805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46ff74-50ba-4287-86bd-924c2b1afa21 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:29.071705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1050/2121] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:29.072942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a653c0-fc8f-4170-8542-7bf736940a08 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:29.092187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a653c0-fc8f-4170-8542-7bf736940a08 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:29.102935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4009583-dcd9-4f1a-bd80-6f09552d9a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:29.104551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009583-dcd9-4f1a-bd80-6f09552d9a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:29.104837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009583-dcd9-4f1a-bd80-6f09552d9a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:29.105114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009583-dcd9-4f1a-bd80-6f09552d9a99 admin admin] PATH_INFO: `/v3/projects/a592f5b651114cc8a054c45e0759efe8/users/1b37655347e747b4a5bb44b0891b9796/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:29.143939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4009583-dcd9-4f1a-bd80-6f09552d9a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a592f5b651114cc8a054c45e0759efe8, user_id=1b37655347e747b4a5bb44b0891b9796, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:29.146807 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4009583-dcd9-4f1a-bd80-6f09552d9a99 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:29.173947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1072/2122] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:29 2022] PUT /identity/v3/projects/a592f5b651114cc8a054c45e0759efe8/users/1b37655347e747b4a5bb44b0891b9796/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:29.188087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87dc31-3e5c-4a62-ad2f-f6ea2fc527db None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:29.188316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87dc31-3e5c-4a62-ad2f-f6ea2fc527db None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:29.188600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87dc31-3e5c-4a62-ad2f-f6ea2fc527db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:29.245033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6f87dc31-3e5c-4a62-ad2f-f6ea2fc527db None None] MFA Rules not processed for user `1b37655347e747b4a5bb44b0891b9796`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:29.246747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6f87dc31-3e5c-4a62-ad2f-f6ea2fc527db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:29.331591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:29.339042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1051/2123] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:29.351267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4009583-dcd9-4f1a-bd80-6f09552d9a99 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:29.353896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b4009583-dcd9-4f1a-bd80-6f09552d9a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:29.522886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4009583-dcd9-4f1a-bd80-6f09552d9a99 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:29.529214 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625295e0-9869-4ce7-ad4c-b71a7100bb6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:29.530359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625295e0-9869-4ce7-ad4c-b71a7100bb6b service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:29.531145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625295e0-9869-4ce7-ad4c-b71a7100bb6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:29.531451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625295e0-9869-4ce7-ad4c-b71a7100bb6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:29.549313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625295e0-9869-4ce7-ad4c-b71a7100bb6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:29.552252 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625295e0-9869-4ce7-ad4c-b71a7100bb6b service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:29.573473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1073/2124] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:29.588402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235770a-50e7-4182-a8f2-1f35a5673640 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:29.589150 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235770a-50e7-4182-a8f2-1f35a5673640 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:29.589150 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235770a-50e7-4182-a8f2-1f35a5673640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:29.642757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5235770a-50e7-4182-a8f2-1f35a5673640 None None] MFA Rules not processed for user `b2c654edcab3432a8e7e6a0d84607b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:29.646102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5235770a-50e7-4182-a8f2-1f35a5673640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:29.806063 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1052/2125] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:29.832399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625295e0-9869-4ce7-ad4c-b71a7100bb6b service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:29.834078 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-625295e0-9869-4ce7-ad4c-b71a7100bb6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:29.858241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625295e0-9869-4ce7-ad4c-b71a7100bb6b service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:29.872717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcf904-83b2-46d4-b360-15ba3bf71e53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:29.873337 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcf904-83b2-46d4-b360-15ba3bf71e53 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:29.873621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcf904-83b2-46d4-b360-15ba3bf71e53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:29.873929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcf904-83b2-46d4-b360-15ba3bf71e53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:29.922423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcf904-83b2-46d4-b360-15ba3bf71e53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:29.923981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcf904-83b2-46d4-b360-15ba3bf71e53 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:29.936200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1074/2126] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:31.463480 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0d858-d482-4287-b602-13e138419301 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:31.464643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0d858-d482-4287-b602-13e138419301 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:31.464643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0d858-d482-4287-b602-13e138419301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:31.501814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ebc0d858-d482-4287-b602-13e138419301 None None] MFA Rules not processed for user `b2c654edcab3432a8e7e6a0d84607b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:31.501814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ebc0d858-d482-4287-b602-13e138419301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:31.513346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1053/2127] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:31.877515 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12319-1a78-4d98-b3f6-14b8fce921c8 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:31.878073 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12319-1a78-4d98-b3f6-14b8fce921c8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:31.878293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12319-1a78-4d98-b3f6-14b8fce921c8 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:31.879772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1075/2128] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:35:31.913472 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e57c0e-35b5-4041-a819-7077532c6e6d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:31.913837 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e57c0e-35b5-4041-a819-7077532c6e6d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:31.914872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e57c0e-35b5-4041-a819-7077532c6e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:31.948154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-77e57c0e-35b5-4041-a819-7077532c6e6d None None] MFA Rules not processed for user `f602decb26be477b867493429352bd03`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:31.948154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-77e57c0e-35b5-4041-a819-7077532c6e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:32.053519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d12319-1a78-4d98-b3f6-14b8fce921c8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:32.057726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d8d12319-1a78-4d98-b3f6-14b8fce921c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:32.079408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1054/2129] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:32.080437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:32.119732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e57c0e-35b5-4041-a819-7077532c6e6d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:32.131848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-77e57c0e-35b5-4041-a819-7077532c6e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:32.160820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e57c0e-35b5-4041-a819-7077532c6e6d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:32.162686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d12319-1a78-4d98-b3f6-14b8fce921c8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:32.170457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111acb-e74f-4dd7-bf95-5c616bf4c0f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f602decb26be477b867493429352bd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:32.171140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111acb-e74f-4dd7-bf95-5c616bf4c0f6 service placement] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:32.171366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111acb-e74f-4dd7-bf95-5c616bf4c0f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:32.172277 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111acb-e74f-4dd7-bf95-5c616bf4c0f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:32.173878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7285b2e-d7fd-4181-8ec0-ff820384a1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:32.174656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285b2e-d7fd-4181-8ec0-ff820384a1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:32.174967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285b2e-d7fd-4181-8ec0-ff820384a1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:32.177833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285b2e-d7fd-4181-8ec0-ff820384a1a3 admin admin] PATH_INFO: `/v3/users/ec8c8a0717a5437b99cf55cead181390` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:32.181123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7285b2e-d7fd-4181-8ec0-ff820384a1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8c8a0717a5437b99cf55cead181390)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:32.183137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7285b2e-d7fd-4181-8ec0-ff820384a1a3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:32.202435 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d111acb-e74f-4dd7-bf95-5c616bf4c0f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:32.202617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d111acb-e74f-4dd7-bf95-5c616bf4c0f6 service placement] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:32.217817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1055/2130] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:35:32.275676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7285b2e-d7fd-4181-8ec0-ff820384a1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8c8a0717a5437b99cf55cead181390'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:32.288597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7285b2e-d7fd-4181-8ec0-ff820384a1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8c8a0717a5437b99cf55cead181390'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:32.296305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7285b2e-d7fd-4181-8ec0-ff820384a1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8c8a0717a5437b99cf55cead181390'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:32.297940 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7285b2e-d7fd-4181-8ec0-ff820384a1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8c8a0717a5437b99cf55cead181390'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:32.298761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7285b2e-d7fd-4181-8ec0-ff820384a1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8c8a0717a5437b99cf55cead181390'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:32.323406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1076/2131] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:32 2022] DELETE /identity/v3/users/ec8c8a0717a5437b99cf55cead181390 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:32.717434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111acb-e74f-4dd7-bf95-5c616bf4c0f6 service placement] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:32.730261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111acb-e74f-4dd7-bf95-5c616bf4c0f6 service placement] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:32.797015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767895a-7f40-487f-b177-fef3291de56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:32.797670 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767895a-7f40-487f-b177-fef3291de56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:32.797957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767895a-7f40-487f-b177-fef3291de56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:32.798236 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767895a-7f40-487f-b177-fef3291de56f admin admin] PATH_INFO: `/v3/projects/3e437e0b87954c92aefb75335ae5ba73` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:32.799499 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767895a-7f40-487f-b177-fef3291de56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e437e0b87954c92aefb75335ae5ba73)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:32.801425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767895a-7f40-487f-b177-fef3291de56f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:32.808572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:32.855310 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8767895a-7f40-487f-b177-fef3291de56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e437e0b87954c92aefb75335ae5ba73', 'request_id': 'req-8767895a-7f40-487f-b177-fef3291de56f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:32.863295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8767895a-7f40-487f-b177-fef3291de56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e437e0b87954c92aefb75335ae5ba73', 'request_id': 'req-8767895a-7f40-487f-b177-fef3291de56f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:32.871057 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8767895a-7f40-487f-b177-fef3291de56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e437e0b87954c92aefb75335ae5ba73', 'request_id': 'req-8767895a-7f40-487f-b177-fef3291de56f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:32.882061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8767895a-7f40-487f-b177-fef3291de56f admin admin] The token cache is being invalidate because project 3e437e0b87954c92aefb75335ae5ba73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:32.882350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8767895a-7f40-487f-b177-fef3291de56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:32.883084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8767895a-7f40-487f-b177-fef3291de56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:32.884813 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1056/2132] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:32 2022] DELETE /identity/v3/projects/3e437e0b87954c92aefb75335ae5ba73 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:32.889878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e1906-c002-4521-b0b4-e0a9f0269656 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:32.890695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e1906-c002-4521-b0b4-e0a9f0269656 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:32.891136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e1906-c002-4521-b0b4-e0a9f0269656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:32.913198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-812e1906-c002-4521-b0b4-e0a9f0269656 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:32.915696 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-812e1906-c002-4521-b0b4-e0a9f0269656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:32.982828 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1077/2133] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:32.990924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d6746-87ff-4b17-9499-b2c3b55d8372 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:32.991284 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d6746-87ff-4b17-9499-b2c3b55d8372 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:32.991630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d6746-87ff-4b17-9499-b2c3b55d8372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:33.018869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-839d6746-87ff-4b17-9499-b2c3b55d8372 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:33.020412 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-839d6746-87ff-4b17-9499-b2c3b55d8372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:33.030547 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1057/2134] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:33.034913 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e1906-c002-4521-b0b4-e0a9f0269656 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:33.045770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e1906-c002-4521-b0b4-e0a9f0269656 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:33.050686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084a980-4caf-4dda-9ffc-f865f6ede5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:33.051394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084a980-4caf-4dda-9ffc-f865f6ede5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:33.051760 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084a980-4caf-4dda-9ffc-f865f6ede5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:33.052125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084a980-4caf-4dda-9ffc-f865f6ede5f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:33.052929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084a980-4caf-4dda-9ffc-f865f6ede5f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:33.053302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084a980-4caf-4dda-9ffc-f865f6ede5f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:33.055067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084a980-4caf-4dda-9ffc-f865f6ede5f3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:33.076583 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1078/2135] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:33.080590 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d6746-87ff-4b17-9499-b2c3b55d8372 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:33.090987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d6746-87ff-4b17-9499-b2c3b55d8372 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:33.095812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc42f-fd56-40b3-8a12-49c8e0695587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:33.096493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc42f-fd56-40b3-8a12-49c8e0695587 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:33.099971 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc42f-fd56-40b3-8a12-49c8e0695587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:33.100525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc42f-fd56-40b3-8a12-49c8e0695587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:33.101608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fc42f-fd56-40b3-8a12-49c8e0695587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:33.103650 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fc42f-fd56-40b3-8a12-49c8e0695587 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:33.134833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1058/2136] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:33 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:33.138950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084a980-4caf-4dda-9ffc-f865f6ede5f3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:33.150070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084a980-4caf-4dda-9ffc-f865f6ede5f3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:33.170548 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:33.220729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f49437-84e3-411f-9138-4cf4198db9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:33.221627 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f49437-84e3-411f-9138-4cf4198db9ff admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:33.221989 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f49437-84e3-411f-9138-4cf4198db9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:33.222322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f49437-84e3-411f-9138-4cf4198db9ff admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:33.223084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f49437-84e3-411f-9138-4cf4198db9ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:33.225103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f49437-84e3-411f-9138-4cf4198db9ff admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:33.234615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc42f-fd56-40b3-8a12-49c8e0695587 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:33.237201 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6e9fc42f-fd56-40b3-8a12-49c8e0695587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:33.247780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1079/2137] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:33 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:33.252149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f49437-84e3-411f-9138-4cf4198db9ff admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:33.264776 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f49437-84e3-411f-9138-4cf4198db9ff admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:33.266663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc42f-fd56-40b3-8a12-49c8e0695587 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:33.271209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80e8fe-ddfc-483d-a182-1da095d68237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:33.271945 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80e8fe-ddfc-483d-a182-1da095d68237 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:33.272311 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80e8fe-ddfc-483d-a182-1da095d68237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:33.272426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9d29d-c007-484c-b337-75f54b3c080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:33.272726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80e8fe-ddfc-483d-a182-1da095d68237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:33.273209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9d29d-c007-484c-b337-75f54b3c080c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:33.274113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9d29d-c007-484c-b337-75f54b3c080c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:33.274393 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9d29d-c007-484c-b337-75f54b3c080c admin admin] PATH_INFO: `/v3/users/1b37655347e747b4a5bb44b0891b9796` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:33.275173 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80e8fe-ddfc-483d-a182-1da095d68237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:33.275883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9d29d-c007-484c-b337-75f54b3c080c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b37655347e747b4a5bb44b0891b9796)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:33.277827 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80e8fe-ddfc-483d-a182-1da095d68237 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:33.277947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9d29d-c007-484c-b337-75f54b3c080c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:33.294601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1080/2138] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:33.298419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80e8fe-ddfc-483d-a182-1da095d68237 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:33.325803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80e8fe-ddfc-483d-a182-1da095d68237 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:33.338223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7faab4-9800-48b2-b2b3-297dc10aef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:33.338559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dcd9d29d-c007-484c-b337-75f54b3c080c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b37655347e747b4a5bb44b0891b9796'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:33.339322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7faab4-9800-48b2-b2b3-297dc10aef2b admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:33.340100 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7faab4-9800-48b2-b2b3-297dc10aef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:33.340552 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7faab4-9800-48b2-b2b3-297dc10aef2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:33.341490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7faab4-9800-48b2-b2b3-297dc10aef2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:33.343695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7faab4-9800-48b2-b2b3-297dc10aef2b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:33.346189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dcd9d29d-c007-484c-b337-75f54b3c080c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b37655347e747b4a5bb44b0891b9796'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:33.361726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1081/2139] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:33.361931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dcd9d29d-c007-484c-b337-75f54b3c080c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b37655347e747b4a5bb44b0891b9796'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:33.361931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dcd9d29d-c007-484c-b337-75f54b3c080c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b37655347e747b4a5bb44b0891b9796'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:33.361931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dcd9d29d-c007-484c-b337-75f54b3c080c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b37655347e747b4a5bb44b0891b9796'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:33.363114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7faab4-9800-48b2-b2b3-297dc10aef2b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:33.365740 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4b7faab4-9800-48b2-b2b3-297dc10aef2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:33.385893 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7faab4-9800-48b2-b2b3-297dc10aef2b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:33.397477 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1059/2140] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:33 2022] DELETE /identity/v3/users/1b37655347e747b4a5bb44b0891b9796 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:33.399766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce6891-e911-41f3-9ee0-ef20014f5657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:33.400485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce6891-e911-41f3-9ee0-ef20014f5657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:33.402796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa11c0-2175-41c0-9dcf-a89d3b08c0e1 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:33.402796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa11c0-2175-41c0-9dcf-a89d3b08c0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:33.402796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa11c0-2175-41c0-9dcf-a89d3b08c0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:33.404117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce6891-e911-41f3-9ee0-ef20014f5657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:33.404669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce6891-e911-41f3-9ee0-ef20014f5657 admin admin] PATH_INFO: `/v3/projects/a77c69cf348c4028873d1dc27e087632/users/daced50101b140aa8b976bcd7cf8c755/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:33.426709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce6891-e911-41f3-9ee0-ef20014f5657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77c69cf348c4028873d1dc27e087632, user_id=daced50101b140aa8b976bcd7cf8c755, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:33.430876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce6891-e911-41f3-9ee0-ef20014f5657 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:33.434350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a7fa11c0-2175-41c0-9dcf-a89d3b08c0e1 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:33.437096 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a7fa11c0-2175-41c0-9dcf-a89d3b08c0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:33.463901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1082/2141] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:33 2022] PUT /identity/v3/projects/a77c69cf348c4028873d1dc27e087632/users/daced50101b140aa8b976bcd7cf8c755/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:33.473695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9807a-46cd-458a-905d-435908bb2cba None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:33.474089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:33.474835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9807a-46cd-458a-905d-435908bb2cba None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:33.475899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9807a-46cd-458a-905d-435908bb2cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:33.503629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1060/2142] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:33.505276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-cba9807a-46cd-458a-905d-435908bb2cba None None] MFA Rules not processed for user `daced50101b140aa8b976bcd7cf8c755`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:33.506590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cba9807a-46cd-458a-905d-435908bb2cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:33.514591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa11c0-2175-41c0-9dcf-a89d3b08c0e1 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:33.515962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a7fa11c0-2175-41c0-9dcf-a89d3b08c0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:33.574310 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa11c0-2175-41c0-9dcf-a89d3b08c0e1 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:33.576364 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1083/2143] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:33.587898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9807a-46cd-458a-905d-435908bb2cba None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:33.589312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cba9807a-46cd-458a-905d-435908bb2cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:33.628631 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f8a2d-24d4-4c7d-bf53-f90c23caecc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:33.629290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f8a2d-24d4-4c7d-bf53-f90c23caecc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:33.629577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f8a2d-24d4-4c7d-bf53-f90c23caecc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:33.629850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f8a2d-24d4-4c7d-bf53-f90c23caecc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:33.663129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:33.700294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9807a-46cd-458a-905d-435908bb2cba None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:33.707732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454df0c-9746-4f30-bb74-c3f9c6336b29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:33.708645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454df0c-9746-4f30-bb74-c3f9c6336b29 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:33.708981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454df0c-9746-4f30-bb74-c3f9c6336b29 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:33.709271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454df0c-9746-4f30-bb74-c3f9c6336b29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:33.717224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f8a2d-24d4-4c7d-bf53-f90c23caecc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:33.718730 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f8a2d-24d4-4c7d-bf53-f90c23caecc8 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:33.719363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454df0c-9746-4f30-bb74-c3f9c6336b29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:33.721479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454df0c-9746-4f30-bb74-c3f9c6336b29 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:33.729612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1061/2144] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:35:33.732159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1084/2145] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:35:34.135958 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f8a2d-24d4-4c7d-bf53-f90c23caecc8 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:34.137632 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1b9f8a2d-24d4-4c7d-bf53-f90c23caecc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:34.165820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f8a2d-24d4-4c7d-bf53-f90c23caecc8 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:34.185766 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:34.185766 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:34.185766 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:34.185766 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7 admin admin] PATH_INFO: `/v3/projects/a592f5b651114cc8a054c45e0759efe8` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:34.188251 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a592f5b651114cc8a054c45e0759efe8)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:34.191688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:34.253925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:34.263641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a592f5b651114cc8a054c45e0759efe8', 'request_id': 'req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:34.272111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a592f5b651114cc8a054c45e0759efe8', 'request_id': 'req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:34.279146 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a592f5b651114cc8a054c45e0759efe8', 'request_id': 'req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:34.290146 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7 admin admin] The token cache is being invalidate because project a592f5b651114cc8a054c45e0759efe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:34.290591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:34.291224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-574d2fd8-01c9-4f6b-9844-8b61fbb08ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:34.292903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1062/2146] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:34 2022] DELETE /identity/v3/projects/a592f5b651114cc8a054c45e0759efe8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:34.297824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112a4f0-f5e0-43dd-af81-8049c1dfba65 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:34.298322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112a4f0-f5e0-43dd-af81-8049c1dfba65 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:34.298417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112a4f0-f5e0-43dd-af81-8049c1dfba65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:34.318677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c112a4f0-f5e0-43dd-af81-8049c1dfba65 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:34.319978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c112a4f0-f5e0-43dd-af81-8049c1dfba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:34.382751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1085/2147] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:34.390524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d65fd-e00f-40d8-83ca-0bcda7a813ba None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:34.390817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d65fd-e00f-40d8-83ca-0bcda7a813ba None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:34.391102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d65fd-e00f-40d8-83ca-0bcda7a813ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:34.412044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-164d65fd-e00f-40d8-83ca-0bcda7a813ba None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:34.413259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-164d65fd-e00f-40d8-83ca-0bcda7a813ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:34.421996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1063/2148] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:34.426346 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112a4f0-f5e0-43dd-af81-8049c1dfba65 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:34.436877 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112a4f0-f5e0-43dd-af81-8049c1dfba65 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:34.441551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6161c8d-2ccc-436c-9bd6-e5e3b5093631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:34.442163 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6161c8d-2ccc-436c-9bd6-e5e3b5093631 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:34.442469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6161c8d-2ccc-436c-9bd6-e5e3b5093631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:34.442919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6161c8d-2ccc-436c-9bd6-e5e3b5093631 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:34.443636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6161c8d-2ccc-436c-9bd6-e5e3b5093631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:34.443982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6161c8d-2ccc-436c-9bd6-e5e3b5093631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:34.446770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6161c8d-2ccc-436c-9bd6-e5e3b5093631 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:34.463169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1086/2149] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:34.468426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d65fd-e00f-40d8-83ca-0bcda7a813ba None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:34.478589 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d65fd-e00f-40d8-83ca-0bcda7a813ba None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:34.484018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100967d-8177-4f1b-87e2-d4b271cd496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:34.484612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100967d-8177-4f1b-87e2-d4b271cd496a admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:34.484962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100967d-8177-4f1b-87e2-d4b271cd496a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:34.485298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100967d-8177-4f1b-87e2-d4b271cd496a admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:34.486380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100967d-8177-4f1b-87e2-d4b271cd496a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:34.488395 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100967d-8177-4f1b-87e2-d4b271cd496a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:34.532389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1064/2150] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:34 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:34.533835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6161c8d-2ccc-436c-9bd6-e5e3b5093631 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:34.546016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6161c8d-2ccc-436c-9bd6-e5e3b5093631 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:34.666098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f59990-590b-42f0-ad76-3e94d2b03c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:34.666822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f59990-590b-42f0-ad76-3e94d2b03c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:34.667174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f59990-590b-42f0-ad76-3e94d2b03c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:34.667523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f59990-590b-42f0-ad76-3e94d2b03c1d admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:34.668402 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f59990-590b-42f0-ad76-3e94d2b03c1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:34.670371 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f59990-590b-42f0-ad76-3e94d2b03c1d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:34.694331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1087/2151] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:34 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:34.699352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100967d-8177-4f1b-87e2-d4b271cd496a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:34.710721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100967d-8177-4f1b-87e2-d4b271cd496a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:34.718056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4649d0-70a5-44c8-a124-2f6c8e4d8b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:34.719072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4649d0-70a5-44c8-a124-2f6c8e4d8b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:34.719564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4649d0-70a5-44c8-a124-2f6c8e4d8b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:34.719797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4649d0-70a5-44c8-a124-2f6c8e4d8b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:34.720665 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4649d0-70a5-44c8-a124-2f6c8e4d8b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:34.724637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4649d0-70a5-44c8-a124-2f6c8e4d8b54 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:34.738353 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1065/2152] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:34.743406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f59990-590b-42f0-ad76-3e94d2b03c1d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:34.758599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f59990-590b-42f0-ad76-3e94d2b03c1d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:34.764456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f7c34-e12d-4755-a8f4-b85dfe7e0533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:34.765091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f7c34-e12d-4755-a8f4-b85dfe7e0533 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:34.765379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f7c34-e12d-4755-a8f4-b85dfe7e0533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:34.765658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f7c34-e12d-4755-a8f4-b85dfe7e0533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:34.766371 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f7c34-e12d-4755-a8f4-b85dfe7e0533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:34.768017 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f7c34-e12d-4755-a8f4-b85dfe7e0533 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:34.780540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1088/2153] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:34.784125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4649d0-70a5-44c8-a124-2f6c8e4d8b54 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:34.795596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4649d0-70a5-44c8-a124-2f6c8e4d8b54 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:34.801962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b0a31-8993-47f5-a542-d33a1721f716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:34.802732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b0a31-8993-47f5-a542-d33a1721f716 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:34.803197 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b0a31-8993-47f5-a542-d33a1721f716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:34.803583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b0a31-8993-47f5-a542-d33a1721f716 admin admin] PATH_INFO: `/v3/projects/2f5e785fa03a40608281e9dd0129b489/users/619081d7803a468f94b86491011b699b/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:34.829223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b0a31-8993-47f5-a542-d33a1721f716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5e785fa03a40608281e9dd0129b489, user_id=619081d7803a468f94b86491011b699b, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:34.832054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b0a31-8993-47f5-a542-d33a1721f716 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:34.848613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1066/2154] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:34 2022] PUT /identity/v3/projects/2f5e785fa03a40608281e9dd0129b489/users/619081d7803a468f94b86491011b699b/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:34.860952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1f597-7da8-4d93-850d-b77be16f92f5 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:34.860952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1f597-7da8-4d93-850d-b77be16f92f5 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:34.860952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1f597-7da8-4d93-850d-b77be16f92f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:34.903168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-9fc1f597-7da8-4d93-850d-b77be16f92f5 None None] MFA Rules not processed for user `619081d7803a468f94b86491011b699b`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:34.903168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9fc1f597-7da8-4d93-850d-b77be16f92f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:34.940094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:34.975131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1089/2155] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:34.979914 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b0a31-8993-47f5-a542-d33a1721f716 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:35.046632 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b0a31-8993-47f5-a542-d33a1721f716 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:35.051693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eaa070-4a37-4362-9482-db878cc2fcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:35.052345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaa070-4a37-4362-9482-db878cc2fcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:35.052629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaa070-4a37-4362-9482-db878cc2fcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:35.052907 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaa070-4a37-4362-9482-db878cc2fcf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:35.053581 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eaa070-4a37-4362-9482-db878cc2fcf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:35.056647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eaa070-4a37-4362-9482-db878cc2fcf8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:35.090623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1067/2156] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:34 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:35.094432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1f597-7da8-4d93-850d-b77be16f92f5 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:35.107952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1f597-7da8-4d93-850d-b77be16f92f5 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:35.177573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2c894-a1a9-4171-901a-d0d23d50651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:35.178220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c894-a1a9-4171-901a-d0d23d50651d admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:35.178503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c894-a1a9-4171-901a-d0d23d50651d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:35.178774 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c894-a1a9-4171-901a-d0d23d50651d admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:35.179769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2c894-a1a9-4171-901a-d0d23d50651d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:35.182122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2c894-a1a9-4171-901a-d0d23d50651d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:35.210470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1090/2157] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:35 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:35.215726 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eaa070-4a37-4362-9482-db878cc2fcf8 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:35.226888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eaa070-4a37-4362-9482-db878cc2fcf8 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:35.231749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3146c3-1b75-4db3-99dc-a147779c540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:35.232428 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3146c3-1b75-4db3-99dc-a147779c540b admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:35.232709 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3146c3-1b75-4db3-99dc-a147779c540b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:35.232980 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3146c3-1b75-4db3-99dc-a147779c540b admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:35.233709 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3146c3-1b75-4db3-99dc-a147779c540b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:35.235292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3146c3-1b75-4db3-99dc-a147779c540b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:35.247376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1068/2158] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:35.251404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2c894-a1a9-4171-901a-d0d23d50651d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:35.276537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2c894-a1a9-4171-901a-d0d23d50651d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:35.281549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a713f8e-b730-43e9-a827-724dfd72a368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:35.282334 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713f8e-b730-43e9-a827-724dfd72a368 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:35.283083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713f8e-b730-43e9-a827-724dfd72a368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:35.283377 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713f8e-b730-43e9-a827-724dfd72a368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:35.284135 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a713f8e-b730-43e9-a827-724dfd72a368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:35.286267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a713f8e-b730-43e9-a827-724dfd72a368 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:35.301648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1091/2159] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:35.303491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3146c3-1b75-4db3-99dc-a147779c540b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:35.317005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3146c3-1b75-4db3-99dc-a147779c540b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:35.324271 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d697b22-e88e-4f11-9719-6d05e707add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:35.325189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d697b22-e88e-4f11-9719-6d05e707add0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:35.325485 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d697b22-e88e-4f11-9719-6d05e707add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:35.325763 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d697b22-e88e-4f11-9719-6d05e707add0 admin admin] PATH_INFO: `/v3/projects/0dd0c9863c12405ebca17e2d22b3afdc/users/5e3c597423c2460a8935205614374b2e/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:35.349424 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d697b22-e88e-4f11-9719-6d05e707add0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd0c9863c12405ebca17e2d22b3afdc, user_id=5e3c597423c2460a8935205614374b2e, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:35.354205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d697b22-e88e-4f11-9719-6d05e707add0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:35.373849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1069/2160] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:35 2022] PUT /identity/v3/projects/0dd0c9863c12405ebca17e2d22b3afdc/users/5e3c597423c2460a8935205614374b2e/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:35.395053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c4629-7d26-429b-a904-e0dae68551f0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:35.395444 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c4629-7d26-429b-a904-e0dae68551f0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:35.396675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c4629-7d26-429b-a904-e0dae68551f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:35.439105 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e35c4629-7d26-429b-a904-e0dae68551f0 None None] MFA Rules not processed for user `5e3c597423c2460a8935205614374b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:35.440394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e35c4629-7d26-429b-a904-e0dae68551f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:35.526564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1092/2161] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:35.530845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d697b22-e88e-4f11-9719-6d05e707add0 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:35.546282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:35.607043 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d697b22-e88e-4f11-9719-6d05e707add0 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:35.612131 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b30f3-b885-4bd3-bac3-cd9b56cfc115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:35.612800 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b30f3-b885-4bd3-bac3-cd9b56cfc115 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:35.613170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b30f3-b885-4bd3-bac3-cd9b56cfc115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:35.613455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b30f3-b885-4bd3-bac3-cd9b56cfc115 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:35.614293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b30f3-b885-4bd3-bac3-cd9b56cfc115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:35.616228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b30f3-b885-4bd3-bac3-cd9b56cfc115 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:35.645512 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1070/2162] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:35 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:35.650677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c4629-7d26-429b-a904-e0dae68551f0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:35.660501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b30f3-b885-4bd3-bac3-cd9b56cfc115 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:35.662353 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-751b30f3-b885-4bd3-bac3-cd9b56cfc115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:35.663487 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c4629-7d26-429b-a904-e0dae68551f0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:35.718260 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:35.743663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b30f3-b885-4bd3-bac3-cd9b56cfc115 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:35.748821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77903237-bfeb-4db4-8fd2-fae366d6afa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:35.749487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77903237-bfeb-4db4-8fd2-fae366d6afa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:35.751376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77903237-bfeb-4db4-8fd2-fae366d6afa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:35.751376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77903237-bfeb-4db4-8fd2-fae366d6afa8 admin admin] PATH_INFO: `/v3/users/7fc45af3e4374612a42d33f921f336e9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:35.751376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77903237-bfeb-4db4-8fd2-fae366d6afa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc45af3e4374612a42d33f921f336e9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:35.753224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77903237-bfeb-4db4-8fd2-fae366d6afa8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:35.765887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f0e06-32d0-4795-bdfd-12b5adf4bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:35.767494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f0e06-32d0-4795-bdfd-12b5adf4bb73 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:35.768526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f0e06-32d0-4795-bdfd-12b5adf4bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:35.770638 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f0e06-32d0-4795-bdfd-12b5adf4bb73 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:35.772212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f0e06-32d0-4795-bdfd-12b5adf4bb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:35.776162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f0e06-32d0-4795-bdfd-12b5adf4bb73 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:35.811850 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1093/2163] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:35 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:35.816090 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f0e06-32d0-4795-bdfd-12b5adf4bb73 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:35.828451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-77903237-bfeb-4db4-8fd2-fae366d6afa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc45af3e4374612a42d33f921f336e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:35.831752 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f0e06-32d0-4795-bdfd-12b5adf4bb73 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:35.840380 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590abf6-da0a-4831-aff7-3aa04caa4027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:35.841279 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590abf6-da0a-4831-aff7-3aa04caa4027 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:35.841899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590abf6-da0a-4831-aff7-3aa04caa4027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:35.842331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590abf6-da0a-4831-aff7-3aa04caa4027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:35.843520 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590abf6-da0a-4831-aff7-3aa04caa4027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:35.845020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-77903237-bfeb-4db4-8fd2-fae366d6afa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc45af3e4374612a42d33f921f336e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:35.845410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590abf6-da0a-4831-aff7-3aa04caa4027 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:35.859349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-77903237-bfeb-4db4-8fd2-fae366d6afa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc45af3e4374612a42d33f921f336e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:35.860118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-77903237-bfeb-4db4-8fd2-fae366d6afa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc45af3e4374612a42d33f921f336e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:35.860880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-77903237-bfeb-4db4-8fd2-fae366d6afa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc45af3e4374612a42d33f921f336e9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:35.862469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1094/2164] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:35.866417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590abf6-da0a-4831-aff7-3aa04caa4027 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:35.870006 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d590abf6-da0a-4831-aff7-3aa04caa4027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:35.887452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590abf6-da0a-4831-aff7-3aa04caa4027 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:35.894157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adde08-6da6-44ab-85b5-f3571826d903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:35.894902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adde08-6da6-44ab-85b5-f3571826d903 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:35.895197 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adde08-6da6-44ab-85b5-f3571826d903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:35.895594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adde08-6da6-44ab-85b5-f3571826d903 admin admin] PATH_INFO: `/v3/projects/823d120bb1364484ac707b95e4a67dfe/users/8f24f15f1d7e460fb8feb8a1512094ae/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:35.898891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1071/2165] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:35 2022] DELETE /identity/v3/users/7fc45af3e4374612a42d33f921f336e9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:35.901744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e796ef-85bd-4cd1-a28e-6a6ea3fdd4a4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:35.902042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e796ef-85bd-4cd1-a28e-6a6ea3fdd4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:35.902321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e796ef-85bd-4cd1-a28e-6a6ea3fdd4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:35.927669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-23e796ef-85bd-4cd1-a28e-6a6ea3fdd4a4 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:35.928822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adde08-6da6-44ab-85b5-f3571826d903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=823d120bb1364484ac707b95e4a67dfe, user_id=8f24f15f1d7e460fb8feb8a1512094ae, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:35.929217 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-23e796ef-85bd-4cd1-a28e-6a6ea3fdd4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:35.944394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adde08-6da6-44ab-85b5-f3571826d903 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:35.955769 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:35.968629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1095/2166] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:35 2022] PUT /identity/v3/projects/823d120bb1364484ac707b95e4a67dfe/users/8f24f15f1d7e460fb8feb8a1512094ae/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:35.973703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adde08-6da6-44ab-85b5-f3571826d903 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:36.027404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1072/2167] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:36.039115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e796ef-85bd-4cd1-a28e-6a6ea3fdd4a4 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:36.041149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-23e796ef-85bd-4cd1-a28e-6a6ea3fdd4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:36.057857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adde08-6da6-44ab-85b5-f3571826d903 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:36.062716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3034354-a84b-4e23-aeac-3e2f383e8869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:36.063524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3034354-a84b-4e23-aeac-3e2f383e8869 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:36.063817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3034354-a84b-4e23-aeac-3e2f383e8869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:36.064130 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3034354-a84b-4e23-aeac-3e2f383e8869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:36.064838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3034354-a84b-4e23-aeac-3e2f383e8869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:36.066444 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3034354-a84b-4e23-aeac-3e2f383e8869 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:36.080850 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1096/2168] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:36.085185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3034354-a84b-4e23-aeac-3e2f383e8869 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:36.095738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3034354-a84b-4e23-aeac-3e2f383e8869 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:36.100729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60f5fd-dcfe-4321-a5dd-38f519e3b4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:36.101264 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f5fd-dcfe-4321-a5dd-38f519e3b4dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:36.101601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f5fd-dcfe-4321-a5dd-38f519e3b4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:36.101878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f5fd-dcfe-4321-a5dd-38f519e3b4dd admin admin] PATH_INFO: `/v3/projects/823d120bb1364484ac707b95e4a67dfe/users/8f24f15f1d7e460fb8feb8a1512094ae/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:36.104076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60f5fd-dcfe-4321-a5dd-38f519e3b4dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=823d120bb1364484ac707b95e4a67dfe, user_id=8f24f15f1d7e460fb8feb8a1512094ae, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:36.107898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60f5fd-dcfe-4321-a5dd-38f519e3b4dd admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:36.113635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e796ef-85bd-4cd1-a28e-6a6ea3fdd4a4 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:36.118918 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1097/2169] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:36 2022] PUT /identity/v3/projects/823d120bb1364484ac707b95e4a67dfe/users/8f24f15f1d7e460fb8feb8a1512094ae/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:36.129705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ed3dc-4e3a-4ff5-ae59-503f7239c646 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:36.130078 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ed3dc-4e3a-4ff5-ae59-503f7239c646 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:36.130453 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ed3dc-4e3a-4ff5-ae59-503f7239c646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:36.168739 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b09ed3dc-4e3a-4ff5-ae59-503f7239c646 None None] MFA Rules not processed for user `8f24f15f1d7e460fb8feb8a1512094ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:36.169950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b09ed3dc-4e3a-4ff5-ae59-503f7239c646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:36.171399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8077e25-a537-4ea8-968e-44254e192889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:36.172021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8077e25-a537-4ea8-968e-44254e192889 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:36.172310 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8077e25-a537-4ea8-968e-44254e192889 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:36.172585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8077e25-a537-4ea8-968e-44254e192889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:36.246483 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8077e25-a537-4ea8-968e-44254e192889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:36.248281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8077e25-a537-4ea8-968e-44254e192889 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:36.250576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1098/2170] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:36.259051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1073/2171] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:35:36.263376 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ed3dc-4e3a-4ff5-ae59-503f7239c646 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:36.264864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b09ed3dc-4e3a-4ff5-ae59-503f7239c646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:36.271276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:36.333099 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ed3dc-4e3a-4ff5-ae59-503f7239c646 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:36.337602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaeb03-8b2f-4bc3-a509-925eadeff1ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:36.338243 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaeb03-8b2f-4bc3-a509-925eadeff1ce service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:36.338570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaeb03-8b2f-4bc3-a509-925eadeff1ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:36.338887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaeb03-8b2f-4bc3-a509-925eadeff1ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:36.340882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bacaeb03-8b2f-4bc3-a509-925eadeff1ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:36.405123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacaeb03-8b2f-4bc3-a509-925eadeff1ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:36.406825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacaeb03-8b2f-4bc3-a509-925eadeff1ce service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:36.418059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1099/2172] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:36.557049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8077e25-a537-4ea8-968e-44254e192889 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:36.558802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a8077e25-a537-4ea8-968e-44254e192889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:36.575782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8077e25-a537-4ea8-968e-44254e192889 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:36.580730 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a025b1-3075-49d0-b8ec-460f289b044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:36.581545 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a025b1-3075-49d0-b8ec-460f289b044b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:36.582007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a025b1-3075-49d0-b8ec-460f289b044b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:36.582491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a025b1-3075-49d0-b8ec-460f289b044b admin admin] PATH_INFO: `/v3/projects/e2e19a1a2ef94e8faa6364e84ed44d37` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:36.587059 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a025b1-3075-49d0-b8ec-460f289b044b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e19a1a2ef94e8faa6364e84ed44d37)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:36.589952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a025b1-3075-49d0-b8ec-460f289b044b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:36.618774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:36.647140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaeb03-8b2f-4bc3-a509-925eadeff1ce service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:36.648698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bacaeb03-8b2f-4bc3-a509-925eadeff1ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:36.658137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-45a025b1-3075-49d0-b8ec-460f289b044b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e19a1a2ef94e8faa6364e84ed44d37', 'request_id': 'req-45a025b1-3075-49d0-b8ec-460f289b044b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:36.663315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaeb03-8b2f-4bc3-a509-925eadeff1ce service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:36.668161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-45a025b1-3075-49d0-b8ec-460f289b044b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e19a1a2ef94e8faa6364e84ed44d37', 'request_id': 'req-45a025b1-3075-49d0-b8ec-460f289b044b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:36.677643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-45a025b1-3075-49d0-b8ec-460f289b044b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e19a1a2ef94e8faa6364e84ed44d37', 'request_id': 'req-45a025b1-3075-49d0-b8ec-460f289b044b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:36.692990 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-45a025b1-3075-49d0-b8ec-460f289b044b admin admin] The token cache is being invalidate because project e2e19a1a2ef94e8faa6364e84ed44d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:36.694137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-45a025b1-3075-49d0-b8ec-460f289b044b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:36.694813 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-45a025b1-3075-49d0-b8ec-460f289b044b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:36.697109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1074/2173] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:36 2022] DELETE /identity/v3/projects/e2e19a1a2ef94e8faa6364e84ed44d37 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:36.759461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:36.760493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:36.760879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:36.761293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] PATH_INFO: `/v3/users/daced50101b140aa8b976bcd7cf8c755` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:36.762672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] RBAC: Authorizing `identity:delete_user(user_id=daced50101b140aa8b976bcd7cf8c755)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:36.765923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:36.844375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daced50101b140aa8b976bcd7cf8c755'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:36.855512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daced50101b140aa8b976bcd7cf8c755'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:36.862598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:36.864935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daced50101b140aa8b976bcd7cf8c755'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:36.865787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daced50101b140aa8b976bcd7cf8c755'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:36.866882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daced50101b140aa8b976bcd7cf8c755'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:36.890328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1100/2174] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:36 2022] DELETE /identity/v3/users/daced50101b140aa8b976bcd7cf8c755 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:36.895124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0b56d-d85a-4671-8d06-213af25dbee9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:36.895645 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0b56d-d85a-4671-8d06-213af25dbee9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:36.895780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0b56d-d85a-4671-8d06-213af25dbee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:36.915402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-36a0b56d-d85a-4671-8d06-213af25dbee9 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:36.916894 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-36a0b56d-d85a-4671-8d06-213af25dbee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:36.983084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1075/2175] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:36.995723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:36.997240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:37.056247 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d1c5d-c49d-42b3-b0d3-0712fbaca10a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:37.059953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282b422-de21-4bb6-850c-cd92abc19f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:37.060584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282b422-de21-4bb6-850c-cd92abc19f5e service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:37.060870 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282b422-de21-4bb6-850c-cd92abc19f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:37.061149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282b422-de21-4bb6-850c-cd92abc19f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:37.070947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282b422-de21-4bb6-850c-cd92abc19f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:37.072434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282b422-de21-4bb6-850c-cd92abc19f5e service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:37.083754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1101/2176] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:37.550590 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0b56d-d85a-4671-8d06-213af25dbee9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:37.552358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-36a0b56d-d85a-4671-8d06-213af25dbee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:37.574111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0b56d-d85a-4671-8d06-213af25dbee9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:37.579112 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0147196-56e4-40f6-b07a-a4ec4c0a3052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:37.579756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0147196-56e4-40f6-b07a-a4ec4c0a3052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:37.580085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0147196-56e4-40f6-b07a-a4ec4c0a3052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:37.580337 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0147196-56e4-40f6-b07a-a4ec4c0a3052 admin admin] PATH_INFO: `/v3/projects/a77c69cf348c4028873d1dc27e087632` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:37.581508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0147196-56e4-40f6-b07a-a4ec4c0a3052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a77c69cf348c4028873d1dc27e087632)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:37.583473 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0147196-56e4-40f6-b07a-a4ec4c0a3052 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:37.646110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d0147196-56e4-40f6-b07a-a4ec4c0a3052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a77c69cf348c4028873d1dc27e087632', 'request_id': 'req-d0147196-56e4-40f6-b07a-a4ec4c0a3052'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:37.657103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d0147196-56e4-40f6-b07a-a4ec4c0a3052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a77c69cf348c4028873d1dc27e087632', 'request_id': 'req-d0147196-56e4-40f6-b07a-a4ec4c0a3052'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:37.664696 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d0147196-56e4-40f6-b07a-a4ec4c0a3052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a77c69cf348c4028873d1dc27e087632', 'request_id': 'req-d0147196-56e4-40f6-b07a-a4ec4c0a3052'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:37.675486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d0147196-56e4-40f6-b07a-a4ec4c0a3052 admin admin] The token cache is being invalidate because project a77c69cf348c4028873d1dc27e087632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:37.675780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d0147196-56e4-40f6-b07a-a4ec4c0a3052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:37.676475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-d0147196-56e4-40f6-b07a-a4ec4c0a3052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:37.678384 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1076/2177] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:37 2022] DELETE /identity/v3/projects/a77c69cf348c4028873d1dc27e087632 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:37.683416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a1f94-f09a-4e43-8c9b-9e3f8dede002 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:37.683918 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a1f94-f09a-4e43-8c9b-9e3f8dede002 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:37.684088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a1f94-f09a-4e43-8c9b-9e3f8dede002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:37.705323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-623a1f94-f09a-4e43-8c9b-9e3f8dede002 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:37.706538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-623a1f94-f09a-4e43-8c9b-9e3f8dede002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:37.766930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1102/2178] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:37.775279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d038e0b-e7e8-4fec-a68f-1c3de3be84c6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:37.775569 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d038e0b-e7e8-4fec-a68f-1c3de3be84c6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:37.775849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d038e0b-e7e8-4fec-a68f-1c3de3be84c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:37.796035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2d038e0b-e7e8-4fec-a68f-1c3de3be84c6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:37.797239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2d038e0b-e7e8-4fec-a68f-1c3de3be84c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:37.805886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1077/2179] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:37.810205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a1f94-f09a-4e43-8c9b-9e3f8dede002 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:37.820866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a1f94-f09a-4e43-8c9b-9e3f8dede002 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:37.825882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c256f6-d950-49c1-8c65-404314b65eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:37.826526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c256f6-d950-49c1-8c65-404314b65eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:37.826804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c256f6-d950-49c1-8c65-404314b65eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:37.827074 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c256f6-d950-49c1-8c65-404314b65eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:37.827843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c256f6-d950-49c1-8c65-404314b65eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:37.828103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c256f6-d950-49c1-8c65-404314b65eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:37.829782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c256f6-d950-49c1-8c65-404314b65eb2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:37.845621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1103/2180] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:37.846983 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d038e0b-e7e8-4fec-a68f-1c3de3be84c6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:37.857456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d038e0b-e7e8-4fec-a68f-1c3de3be84c6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:37.862653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d92f1f-764f-451e-83da-515971dde7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:37.863379 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d92f1f-764f-451e-83da-515971dde7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:37.863675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d92f1f-764f-451e-83da-515971dde7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:37.864232 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d92f1f-764f-451e-83da-515971dde7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:37.864642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d92f1f-764f-451e-83da-515971dde7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:37.866720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d92f1f-764f-451e-83da-515971dde7d2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:37.895969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1078/2181] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:37 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:37.900825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c256f6-d950-49c1-8c65-404314b65eb2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:37.911677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c256f6-d950-49c1-8c65-404314b65eb2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:37.980428 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660692a-2182-425b-b846-9dab613073b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:37.981053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660692a-2182-425b-b846-9dab613073b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:37.981364 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660692a-2182-425b-b846-9dab613073b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:37.981654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660692a-2182-425b-b846-9dab613073b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:37.982326 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660692a-2182-425b-b846-9dab613073b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:37.984313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660692a-2182-425b-b846-9dab613073b4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:38.006829 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:38.018280 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1104/2182] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:37 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:38.019469 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d92f1f-764f-451e-83da-515971dde7d2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:38.028001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:38.034980 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d92f1f-764f-451e-83da-515971dde7d2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:38.035434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660692a-2182-425b-b846-9dab613073b4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:38.037420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c660692a-2182-425b-b846-9dab613073b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:38.041335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014562d-d0ab-4063-b29f-0ed5ae01fe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:38.042029 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014562d-d0ab-4063-b29f-0ed5ae01fe2d admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:38.042379 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014562d-d0ab-4063-b29f-0ed5ae01fe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:38.042741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014562d-d0ab-4063-b29f-0ed5ae01fe2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:38.043511 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014562d-d0ab-4063-b29f-0ed5ae01fe2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:38.045171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014562d-d0ab-4063-b29f-0ed5ae01fe2d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:38.056342 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1079/2183] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:38.060561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014562d-d0ab-4063-b29f-0ed5ae01fe2d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:38.072064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014562d-d0ab-4063-b29f-0ed5ae01fe2d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:38.076707 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c5032-3e42-47fb-8af5-27aee955ae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:38.077408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5032-3e42-47fb-8af5-27aee955ae50 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:38.077693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5032-3e42-47fb-8af5-27aee955ae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:38.077966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5032-3e42-47fb-8af5-27aee955ae50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:38.078657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c5032-3e42-47fb-8af5-27aee955ae50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:38.080271 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c5032-3e42-47fb-8af5-27aee955ae50 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:38.091409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1080/2184] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:38.095518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c5032-3e42-47fb-8af5-27aee955ae50 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:38.103208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660692a-2182-425b-b846-9dab613073b4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:38.105679 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c5032-3e42-47fb-8af5-27aee955ae50 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:38.106876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225040a8-30aa-4783-8c2b-9b13da17dbf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:38.107496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225040a8-30aa-4783-8c2b-9b13da17dbf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:38.107779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225040a8-30aa-4783-8c2b-9b13da17dbf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:38.108097 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225040a8-30aa-4783-8c2b-9b13da17dbf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:38.109812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-225040a8-30aa-4783-8c2b-9b13da17dbf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:38.110344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85012938-4c9e-4d0a-8599-d9d56110589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:38.110995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85012938-4c9e-4d0a-8599-d9d56110589f admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:38.111275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85012938-4c9e-4d0a-8599-d9d56110589f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:38.111791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85012938-4c9e-4d0a-8599-d9d56110589f admin admin] PATH_INFO: `/v3/projects/d12bafc165e44bbb980d3c41791bbdb1/users/0427d57009cd4312932b1cf90f7d5d14/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:38.130902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85012938-4c9e-4d0a-8599-d9d56110589f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12bafc165e44bbb980d3c41791bbdb1, user_id=0427d57009cd4312932b1cf90f7d5d14, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:38.134125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85012938-4c9e-4d0a-8599-d9d56110589f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:38.152379 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1081/2185] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:38 2022] PUT /identity/v3/projects/d12bafc165e44bbb980d3c41791bbdb1/users/0427d57009cd4312932b1cf90f7d5d14/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:38.164965 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b605c2-c846-4aa3-a836-00127bbfb6ec None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:38.165253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b605c2-c846-4aa3-a836-00127bbfb6ec None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:38.165535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b605c2-c846-4aa3-a836-00127bbfb6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:38.183057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225040a8-30aa-4783-8c2b-9b13da17dbf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:38.184573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225040a8-30aa-4783-8c2b-9b13da17dbf0 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:38.195110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1105/2186] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:35:38.198845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-25b605c2-c846-4aa3-a836-00127bbfb6ec None None] MFA Rules not processed for user `0427d57009cd4312932b1cf90f7d5d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:38.200242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-25b605c2-c846-4aa3-a836-00127bbfb6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:38.284959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1082/2187] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:38.289807 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225040a8-30aa-4783-8c2b-9b13da17dbf0 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:38.304355 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225040a8-30aa-4783-8c2b-9b13da17dbf0 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:38.395726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a876d-461d-44d5-b807-89b6366b3c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:38.395726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a876d-461d-44d5-b807-89b6366b3c20 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:38.395726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a876d-461d-44d5-b807-89b6366b3c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:38.395726 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a876d-461d-44d5-b807-89b6366b3c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:38.396275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a876d-461d-44d5-b807-89b6366b3c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:38.397593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a876d-461d-44d5-b807-89b6366b3c20 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:38.431816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1106/2188] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:38 2022] POST /identity/v3/projects => generated 401 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:38.435954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b605c2-c846-4aa3-a836-00127bbfb6ec None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:38.450026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b605c2-c846-4aa3-a836-00127bbfb6ec None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:38.528721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020eb87-f4ee-434e-be68-d414d47754e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:38.529354 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020eb87-f4ee-434e-be68-d414d47754e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:38.529639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020eb87-f4ee-434e-be68-d414d47754e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:38.529935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020eb87-f4ee-434e-be68-d414d47754e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:38.530608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020eb87-f4ee-434e-be68-d414d47754e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:38.532638 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020eb87-f4ee-434e-be68-d414d47754e3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:38.556322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1083/2189] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:38 2022] POST /identity/v3/users => generated 307 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:38.560429 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a876d-461d-44d5-b807-89b6366b3c20 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:38.571391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a876d-461d-44d5-b807-89b6366b3c20 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:38.576560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440adb4-7b45-4c74-8688-c0bc32e833ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:38.577205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440adb4-7b45-4c74-8688-c0bc32e833ca admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:38.577507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440adb4-7b45-4c74-8688-c0bc32e833ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:38.577800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440adb4-7b45-4c74-8688-c0bc32e833ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:38.578490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440adb4-7b45-4c74-8688-c0bc32e833ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:38.580132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440adb4-7b45-4c74-8688-c0bc32e833ca admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:38.592222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1107/2190] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:38.596320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020eb87-f4ee-434e-be68-d414d47754e3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:38.607820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020eb87-f4ee-434e-be68-d414d47754e3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:38.612761 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416b8f5-4e72-453a-a447-18e3f3b775a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:38.613430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416b8f5-4e72-453a-a447-18e3f3b775a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:38.613716 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416b8f5-4e72-453a-a447-18e3f3b775a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:38.613997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416b8f5-4e72-453a-a447-18e3f3b775a5 admin admin] PATH_INFO: `/v3/projects/91acd6ba477f44a69063c468e378239e/users/e27a87739880412b941adc1528430f6f/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:38.629507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416b8f5-4e72-453a-a447-18e3f3b775a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91acd6ba477f44a69063c468e378239e, user_id=e27a87739880412b941adc1528430f6f, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:38.633289 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416b8f5-4e72-453a-a447-18e3f3b775a5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:38.650009 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1084/2191] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:38 2022] PUT /identity/v3/projects/91acd6ba477f44a69063c468e378239e/users/e27a87739880412b941adc1528430f6f/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:38.659362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440adb4-7b45-4c74-8688-c0bc32e833ca admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:38.671202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440adb4-7b45-4c74-8688-c0bc32e833ca admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:38.696543 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:38.739036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb16d83-69fe-46f9-8640-d146825161d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:38.740212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16d83-69fe-46f9-8640-d146825161d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:38.740697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16d83-69fe-46f9-8640-d146825161d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:38.741276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16d83-69fe-46f9-8640-d146825161d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:38.742716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb16d83-69fe-46f9-8640-d146825161d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:38.744922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb16d83-69fe-46f9-8640-d146825161d6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:38.756329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1108/2192] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:38.761130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416b8f5-4e72-453a-a447-18e3f3b775a5 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:38.771964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416b8f5-4e72-453a-a447-18e3f3b775a5 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:38.778668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee635aa-3ed5-47b5-8b75-dff3a707940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:38.779354 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee635aa-3ed5-47b5-8b75-dff3a707940c admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:38.779645 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee635aa-3ed5-47b5-8b75-dff3a707940c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:38.779963 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee635aa-3ed5-47b5-8b75-dff3a707940c admin admin] PATH_INFO: `/v3/projects/91acd6ba477f44a69063c468e378239e/users/e27a87739880412b941adc1528430f6f/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:38.782012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee635aa-3ed5-47b5-8b75-dff3a707940c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91acd6ba477f44a69063c468e378239e, user_id=e27a87739880412b941adc1528430f6f, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:38.784698 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee635aa-3ed5-47b5-8b75-dff3a707940c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:38.791319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:38.798421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1085/2193] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:38 2022] PUT /identity/v3/projects/91acd6ba477f44a69063c468e378239e/users/e27a87739880412b941adc1528430f6f/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:38.810051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f62ac8-1d90-4d0e-9098-425fd004ece4 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:38.810276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f62ac8-1d90-4d0e-9098-425fd004ece4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:38.810557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f62ac8-1d90-4d0e-9098-425fd004ece4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:38.843206 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d3f62ac8-1d90-4d0e-9098-425fd004ece4 None None] MFA Rules not processed for user `e27a87739880412b941adc1528430f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:38.844511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d3f62ac8-1d90-4d0e-9098-425fd004ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:38.920603 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee635aa-3ed5-47b5-8b75-dff3a707940c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:38.931795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1109/2194] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:38.939391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f62ac8-1d90-4d0e-9098-425fd004ece4 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:38.941053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d3f62ac8-1d90-4d0e-9098-425fd004ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:38.994690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee635aa-3ed5-47b5-8b75-dff3a707940c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:38.998631 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fd74a-f2a3-4e02-a62a-f15221d39ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:38.999252 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fd74a-f2a3-4e02-a62a-f15221d39ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:38.999535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fd74a-f2a3-4e02-a62a-f15221d39ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:38.999812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fd74a-f2a3-4e02-a62a-f15221d39ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:39.002184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2a0fd74a-f2a3-4e02-a62a-f15221d39ad6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:39.011146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f62ac8-1d90-4d0e-9098-425fd004ece4 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:39.015520 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f5a51-1b5a-43bd-b439-f712416292a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:39.016363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f5a51-1b5a-43bd-b439-f712416292a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:39.016725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f5a51-1b5a-43bd-b439-f712416292a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:39.017004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f5a51-1b5a-43bd-b439-f712416292a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:39.027734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f5a51-1b5a-43bd-b439-f712416292a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:39.029208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f5a51-1b5a-43bd-b439-f712416292a6 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:39.039230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1110/2195] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:35:39.072804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fd74a-f2a3-4e02-a62a-f15221d39ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:39.074280 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fd74a-f2a3-4e02-a62a-f15221d39ad6 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:39.085214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1086/2196] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:35:39.119483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f5a51-1b5a-43bd-b439-f712416292a6 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:39.128721 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f5a51-1b5a-43bd-b439-f712416292a6 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:39.133746 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77158f-b1ae-4d92-9444-c3fa6c9e58bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:39.135308 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77158f-b1ae-4d92-9444-c3fa6c9e58bc service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:39.135661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77158f-b1ae-4d92-9444-c3fa6c9e58bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:39.136042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77158f-b1ae-4d92-9444-c3fa6c9e58bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:39.189180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:39.202301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77158f-b1ae-4d92-9444-c3fa6c9e58bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:39.203750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77158f-b1ae-4d92-9444-c3fa6c9e58bc service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:39.213338 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1111/2197] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:42.992806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fd74a-f2a3-4e02-a62a-f15221d39ad6 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:42.994341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2a0fd74a-f2a3-4e02-a62a-f15221d39ad6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:43.060515 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fd74a-f2a3-4e02-a62a-f15221d39ad6 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:43.064950 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:43.065601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:43.065877 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:43.066149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] PATH_INFO: `/v3/users/619081d7803a468f94b86491011b699b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:43.067305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] RBAC: Authorizing `identity:delete_user(user_id=619081d7803a468f94b86491011b699b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:43.069299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:43.133090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619081d7803a468f94b86491011b699b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.136347 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:43.142308 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619081d7803a468f94b86491011b699b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.150689 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619081d7803a468f94b86491011b699b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.151992 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619081d7803a468f94b86491011b699b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.152738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619081d7803a468f94b86491011b699b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.171671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1087/2198] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:42 2022] DELETE /identity/v3/users/619081d7803a468f94b86491011b699b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:43.176819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95ffd8-a6a9-4189-913a-5a9947870d16 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:43.177336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95ffd8-a6a9-4189-913a-5a9947870d16 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:43.177506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95ffd8-a6a9-4189-913a-5a9947870d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:43.198130 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3c95ffd8-a6a9-4189-913a-5a9947870d16 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:43.199535 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3c95ffd8-a6a9-4189-913a-5a9947870d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:43.303136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1112/2199] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:43.313402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:43.314994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:43.382256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbe064-396d-4941-b28e-073dbd4f638a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:43.386531 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c33ec5-3e6b-4ec6-84ba-e430c6cf8cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:43.387154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c33ec5-3e6b-4ec6-84ba-e430c6cf8cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:43.387435 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c33ec5-3e6b-4ec6-84ba-e430c6cf8cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:43.387708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c33ec5-3e6b-4ec6-84ba-e430c6cf8cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:43.397493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c33ec5-3e6b-4ec6-84ba-e430c6cf8cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:43.399322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c33ec5-3e6b-4ec6-84ba-e430c6cf8cb6 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:43.409862 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1088/2200] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:43.429705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95ffd8-a6a9-4189-913a-5a9947870d16 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:43.431392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3c95ffd8-a6a9-4189-913a-5a9947870d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:43.443915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95ffd8-a6a9-4189-913a-5a9947870d16 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:43.452296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:43.453176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:43.453526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:43.454163 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] PATH_INFO: `/v3/users/0427d57009cd4312932b1cf90f7d5d14` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:43.455677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0427d57009cd4312932b1cf90f7d5d14)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:43.457727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:43.516977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0427d57009cd4312932b1cf90f7d5d14'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.526070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0427d57009cd4312932b1cf90f7d5d14'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.533687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0427d57009cd4312932b1cf90f7d5d14'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.534385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0427d57009cd4312932b1cf90f7d5d14'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.535022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0427d57009cd4312932b1cf90f7d5d14'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.559236 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1113/2201] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:43 2022] DELETE /identity/v3/users/0427d57009cd4312932b1cf90f7d5d14 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:43.563246 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d22b-673c-46c5-8e0d-969dad91b4fd None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:43.563540 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d22b-673c-46c5-8e0d-969dad91b4fd None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:43.563822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d22b-673c-46c5-8e0d-969dad91b4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:43.596141 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5360d22b-673c-46c5-8e0d-969dad91b4fd None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:43.597339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5360d22b-673c-46c5-8e0d-969dad91b4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:43.669725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1089/2202] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:43.680168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:43.681822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:43.713531 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360d22b-673c-46c5-8e0d-969dad91b4fd None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:43.715140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5360d22b-673c-46c5-8e0d-969dad91b4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:43.728064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360d22b-673c-46c5-8e0d-969dad91b4fd None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:43.732966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:43.733798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:43.734390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:43.734549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] PATH_INFO: `/v3/projects/2f5e785fa03a40608281e9dd0129b489` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:43.735886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5e785fa03a40608281e9dd0129b489)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:43.740889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:43.750919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45bd7b-10c1-4e86-b7ab-21b39def3742 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:43.754859 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dedadfb-3844-418f-bd1a-7cae990bd13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:43.755482 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedadfb-3844-418f-bd1a-7cae990bd13d service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:43.755771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedadfb-3844-418f-bd1a-7cae990bd13d service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:43.756083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedadfb-3844-418f-bd1a-7cae990bd13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:43.766575 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dedadfb-3844-418f-bd1a-7cae990bd13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:43.768044 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dedadfb-3844-418f-bd1a-7cae990bd13d service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:43.778888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1114/2203] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:43.793832 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5e785fa03a40608281e9dd0129b489', 'request_id': 'req-82d62d42-6cf5-420d-8087-a70d13e89058'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.805835 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5e785fa03a40608281e9dd0129b489', 'request_id': 'req-82d62d42-6cf5-420d-8087-a70d13e89058'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.812815 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5e785fa03a40608281e9dd0129b489', 'request_id': 'req-82d62d42-6cf5-420d-8087-a70d13e89058'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.817512 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:43.828087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] The token cache is being invalidate because project 2f5e785fa03a40608281e9dd0129b489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:43.828746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.830158 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.831764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1090/2204] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:43 2022] DELETE /identity/v3/projects/2f5e785fa03a40608281e9dd0129b489 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:43.836821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dedadfb-3844-418f-bd1a-7cae990bd13d service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:43.845990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:43.851213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dedadfb-3844-418f-bd1a-7cae990bd13d service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:43.920467 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:43.921149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:43.921436 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:43.921718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] PATH_INFO: `/v3/users/5e3c597423c2460a8935205614374b2e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:43.923018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3c597423c2460a8935205614374b2e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:43.925023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:43.981746 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3c597423c2460a8935205614374b2e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.990808 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3c597423c2460a8935205614374b2e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.998620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3c597423c2460a8935205614374b2e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:43.999293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3c597423c2460a8935205614374b2e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.000117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3c597423c2460a8935205614374b2e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.019998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1115/2205] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:43 2022] DELETE /identity/v3/users/5e3c597423c2460a8935205614374b2e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:44.069539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:44.071675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:44.086851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d62d42-6cf5-420d-8087-a70d13e89058 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:44.162866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:44.163903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:44.165457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:44.165809 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] PATH_INFO: `/v3/projects/d12bafc165e44bbb980d3c41791bbdb1` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:44.167882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12bafc165e44bbb980d3c41791bbdb1)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:44.169926 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:44.235516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12bafc165e44bbb980d3c41791bbdb1', 'request_id': 'req-0641830b-573e-482f-b90b-f8acf5a49efd'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.245883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12bafc165e44bbb980d3c41791bbdb1', 'request_id': 'req-0641830b-573e-482f-b90b-f8acf5a49efd'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.253241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12bafc165e44bbb980d3c41791bbdb1', 'request_id': 'req-0641830b-573e-482f-b90b-f8acf5a49efd'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.265964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] The token cache is being invalidate because project d12bafc165e44bbb980d3c41791bbdb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:44.266396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.267165 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.268862 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1091/2206] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:44 2022] DELETE /identity/v3/projects/d12bafc165e44bbb980d3c41791bbdb1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:44.273742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:44.275525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:44.291258 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903fbf2-7be7-49fa-a799-085294f69933 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:44.366922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:44.367626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:44.368042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:44.368393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] PATH_INFO: `/v3/users/e27a87739880412b941adc1528430f6f` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:44.369760 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27a87739880412b941adc1528430f6f)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:44.371938 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:44.381763 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:44.384085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:44.400520 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641830b-573e-482f-b90b-f8acf5a49efd admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:44.405035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:44.406782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:44.407067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:44.407347 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] PATH_INFO: `/v3/projects/0dd0c9863c12405ebca17e2d22b3afdc` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:44.408672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd0c9863c12405ebca17e2d22b3afdc)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:44.410479 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:44.424882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:44.454748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27a87739880412b941adc1528430f6f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.465211 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27a87739880412b941adc1528430f6f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.473976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27a87739880412b941adc1528430f6f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.475225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27a87739880412b941adc1528430f6f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.475541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27a87739880412b941adc1528430f6f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.481623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd0c9863c12405ebca17e2d22b3afdc', 'request_id': 'req-c23e49ca-0570-4246-9b7a-4b9206c23acf'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.492256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd0c9863c12405ebca17e2d22b3afdc', 'request_id': 'req-c23e49ca-0570-4246-9b7a-4b9206c23acf'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.499278 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1116/2207] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:44 2022] DELETE /identity/v3/users/e27a87739880412b941adc1528430f6f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:44.500495 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd0c9863c12405ebca17e2d22b3afdc', 'request_id': 'req-c23e49ca-0570-4246-9b7a-4b9206c23acf'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.524436 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] The token cache is being invalidate because project 0dd0c9863c12405ebca17e2d22b3afdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:44.524737 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.525457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.527125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1092/2208] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:44 2022] DELETE /identity/v3/projects/0dd0c9863c12405ebca17e2d22b3afdc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:44.531170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:44.532725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:44.638934 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12207c4c-0e27-4d31-b4e8-11f985bffc8f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:44.644880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cd3a0-501b-4935-9fd9-51f3a372247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:44.645677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cd3a0-501b-4935-9fd9-51f3a372247d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:44.647302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cd3a0-501b-4935-9fd9-51f3a372247d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:44.647302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cd3a0-501b-4935-9fd9-51f3a372247d admin admin] PATH_INFO: `/v3/users/8f24f15f1d7e460fb8feb8a1512094ae` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:44.648035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cd3a0-501b-4935-9fd9-51f3a372247d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f24f15f1d7e460fb8feb8a1512094ae)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:44.655759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cd3a0-501b-4935-9fd9-51f3a372247d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:44.756673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea4cd3a0-501b-4935-9fd9-51f3a372247d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f24f15f1d7e460fb8feb8a1512094ae'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.767662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea4cd3a0-501b-4935-9fd9-51f3a372247d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f24f15f1d7e460fb8feb8a1512094ae'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.779605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea4cd3a0-501b-4935-9fd9-51f3a372247d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f24f15f1d7e460fb8feb8a1512094ae'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.781590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea4cd3a0-501b-4935-9fd9-51f3a372247d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f24f15f1d7e460fb8feb8a1512094ae'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.783004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ea4cd3a0-501b-4935-9fd9-51f3a372247d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f24f15f1d7e460fb8feb8a1512094ae'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:44.806566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1117/2209] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:44 2022] DELETE /identity/v3/users/8f24f15f1d7e460fb8feb8a1512094ae => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:44.856935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:44.858619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:44.870538 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:44.960091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e49ca-0570-4246-9b7a-4b9206c23acf admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.048669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.049383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.049722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.050005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] PATH_INFO: `/v3/projects/91acd6ba477f44a69063c468e378239e` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.051891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=91acd6ba477f44a69063c468e378239e)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.055613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.121563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91acd6ba477f44a69063c468e378239e', 'request_id': 'req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:45.131213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91acd6ba477f44a69063c468e378239e', 'request_id': 'req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:45.142994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91acd6ba477f44a69063c468e378239e', 'request_id': 'req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:45.156702 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] The token cache is being invalidate because project 91acd6ba477f44a69063c468e378239e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:45.157080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:45.157916 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:45.159512 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1093/2210] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:44 2022] DELETE /identity/v3/projects/91acd6ba477f44a69063c468e378239e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:45.165956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.166829 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579198ee-d370-4cef-9520-958a841b3354 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.167197 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579198ee-d370-4cef-9520-958a841b3354 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.167520 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579198ee-d370-4cef-9520-958a841b3354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.167793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:45.207138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-579198ee-d370-4cef-9520-958a841b3354 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:45.208472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-579198ee-d370-4cef-9520-958a841b3354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:45.219293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:45.228512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:45.240528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c233-0ccc-464e-aafe-e14dcbbb31fa admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.246158 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.246805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.247093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.247375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c admin admin] PATH_INFO: `/v3/projects/823d120bb1364484ac707b95e4a67dfe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.248664 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=823d120bb1364484ac707b95e4a67dfe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.250582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.277936 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1118/2211] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:45.287085 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95234bc5-ea70-44c9-b2a8-c4c665ea3ecc None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.287386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95234bc5-ea70-44c9-b2a8-c4c665ea3ecc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.287660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95234bc5-ea70-44c9-b2a8-c4c665ea3ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.302300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823d120bb1364484ac707b95e4a67dfe', 'request_id': 'req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:45.311258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823d120bb1364484ac707b95e4a67dfe', 'request_id': 'req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:45.311415 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-95234bc5-ea70-44c9-b2a8-c4c665ea3ecc None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:45.312993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-95234bc5-ea70-44c9-b2a8-c4c665ea3ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:45.318472 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823d120bb1364484ac707b95e4a67dfe', 'request_id': 'req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:45.331946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c admin admin] The token cache is being invalidate because project 823d120bb1364484ac707b95e4a67dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:45.332372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:45.333277 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-703e8177-e5ae-4ce9-bd3e-ed35ecb0fe7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:45.339178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1094/2212] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:45 2022] DELETE /identity/v3/projects/823d120bb1364484ac707b95e4a67dfe => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:45.340269 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14a849-2468-46c2-81f0-f47faac62634 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.340563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14a849-2468-46c2-81f0-f47faac62634 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.340842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14a849-2468-46c2-81f0-f47faac62634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.365070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-dc14a849-2468-46c2-81f0-f47faac62634 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:45.366313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-dc14a849-2468-46c2-81f0-f47faac62634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:45.405408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1119/2213] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:45.409632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95234bc5-ea70-44c9-b2a8-c4c665ea3ecc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.419473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95234bc5-ea70-44c9-b2a8-c4c665ea3ecc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.424801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80db1f-9dcc-4ca7-90f2-1335bc842188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.425423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80db1f-9dcc-4ca7-90f2-1335bc842188 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.425717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80db1f-9dcc-4ca7-90f2-1335bc842188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.425997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80db1f-9dcc-4ca7-90f2-1335bc842188 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.426725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80db1f-9dcc-4ca7-90f2-1335bc842188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:45.427037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80db1f-9dcc-4ca7-90f2-1335bc842188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.429194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80db1f-9dcc-4ca7-90f2-1335bc842188 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.445057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1120/2214] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:45.449237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80db1f-9dcc-4ca7-90f2-1335bc842188 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.449806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1095/2215] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:45.457942 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78f9d-fadc-4b86-a778-0594d15aa477 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.458273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78f9d-fadc-4b86-a778-0594d15aa477 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.458675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78f9d-fadc-4b86-a778-0594d15aa477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.465790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80db1f-9dcc-4ca7-90f2-1335bc842188 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.471698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705532-d43a-4049-b030-e8cc2329b390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.472315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705532-d43a-4049-b030-e8cc2329b390 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.472606 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705532-d43a-4049-b030-e8cc2329b390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.472883 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705532-d43a-4049-b030-e8cc2329b390 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.473556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d705532-d43a-4049-b030-e8cc2329b390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.475486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d705532-d43a-4049-b030-e8cc2329b390 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.482865 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-25b78f9d-fadc-4b86-a778-0594d15aa477 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:45.484279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-25b78f9d-fadc-4b86-a778-0594d15aa477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:45.495899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1096/2216] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:45.497996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b78f9d-fadc-4b86-a778-0594d15aa477 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.508428 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b78f9d-fadc-4b86-a778-0594d15aa477 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.509914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1121/2217] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:45 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:45.513755 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705532-d43a-4049-b030-e8cc2329b390 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.576454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12330d7d-f4c9-4ee1-845b-f3c12be860dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.577204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12330d7d-f4c9-4ee1-845b-f3c12be860dc admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.577639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12330d7d-f4c9-4ee1-845b-f3c12be860dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.578009 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12330d7d-f4c9-4ee1-845b-f3c12be860dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.578839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12330d7d-f4c9-4ee1-845b-f3c12be860dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:45.580057 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12330d7d-f4c9-4ee1-845b-f3c12be860dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.581897 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12330d7d-f4c9-4ee1-845b-f3c12be860dc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.586611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705532-d43a-4049-b030-e8cc2329b390 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.592003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abae69f-803a-49fa-a9f1-081e2fc815cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.592657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abae69f-803a-49fa-a9f1-081e2fc815cd admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.593139 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abae69f-803a-49fa-a9f1-081e2fc815cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.593270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abae69f-803a-49fa-a9f1-081e2fc815cd admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.593889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abae69f-803a-49fa-a9f1-081e2fc815cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.595897 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abae69f-803a-49fa-a9f1-081e2fc815cd admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.601754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1097/2218] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:35:45.606377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12330d7d-f4c9-4ee1-845b-f3c12be860dc admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.612282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:45.619229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12330d7d-f4c9-4ee1-845b-f3c12be860dc admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.622884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1122/2219] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:45 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:45.626362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174e61b-ae1d-48f8-a7b9-097935e0781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.626643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abae69f-803a-49fa-a9f1-081e2fc815cd admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.627329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174e61b-ae1d-48f8-a7b9-097935e0781a admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.628085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174e61b-ae1d-48f8-a7b9-097935e0781a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.628381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174e61b-ae1d-48f8-a7b9-097935e0781a admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.629267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174e61b-ae1d-48f8-a7b9-097935e0781a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.631280 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174e61b-ae1d-48f8-a7b9-097935e0781a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.640277 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abae69f-803a-49fa-a9f1-081e2fc815cd admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.645806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b38b7-13ee-4fe5-9b5e-e38f6c1b3db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.646800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b38b7-13ee-4fe5-9b5e-e38f6c1b3db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.647101 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b38b7-13ee-4fe5-9b5e-e38f6c1b3db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.647410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b38b7-13ee-4fe5-9b5e-e38f6c1b3db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.648257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b38b7-13ee-4fe5-9b5e-e38f6c1b3db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.650592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b38b7-13ee-4fe5-9b5e-e38f6c1b3db7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.664332 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1123/2220] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:45.668361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1098/2221] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:45 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:45.668524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b38b7-13ee-4fe5-9b5e-e38f6c1b3db7 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.672296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174e61b-ae1d-48f8-a7b9-097935e0781a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.681628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b38b7-13ee-4fe5-9b5e-e38f6c1b3db7 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.685308 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:45.739572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174e61b-ae1d-48f8-a7b9-097935e0781a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.745535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55be46-366e-4164-9111-ab2b0dd6fe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.746350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55be46-366e-4164-9111-ab2b0dd6fe29 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.746873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55be46-366e-4164-9111-ab2b0dd6fe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.747254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55be46-366e-4164-9111-ab2b0dd6fe29 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.747937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55be46-366e-4164-9111-ab2b0dd6fe29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.749884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55be46-366e-4164-9111-ab2b0dd6fe29 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.755122 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae57a2b-8a3b-4191-b740-7123265826ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.756006 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae57a2b-8a3b-4191-b740-7123265826ac admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.756429 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae57a2b-8a3b-4191-b740-7123265826ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.756989 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae57a2b-8a3b-4191-b740-7123265826ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.758693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae57a2b-8a3b-4191-b740-7123265826ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.761139 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae57a2b-8a3b-4191-b740-7123265826ac admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.776430 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1124/2222] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:45.780565 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae57a2b-8a3b-4191-b740-7123265826ac admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.784025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1099/2223] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:45 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:45.785488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55be46-366e-4164-9111-ab2b0dd6fe29 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.795905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55be46-366e-4164-9111-ab2b0dd6fe29 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.797519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae57a2b-8a3b-4191-b740-7123265826ac admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.800531 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819df32e-d061-4b3b-9cbc-07048fefa733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.801135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819df32e-d061-4b3b-9cbc-07048fefa733 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.801426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819df32e-d061-4b3b-9cbc-07048fefa733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.801726 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819df32e-d061-4b3b-9cbc-07048fefa733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.802271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef290f-aa87-42f5-9ba9-2c55e8356ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.802414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819df32e-d061-4b3b-9cbc-07048fefa733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.802936 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef290f-aa87-42f5-9ba9-2c55e8356ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.803224 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef290f-aa87-42f5-9ba9-2c55e8356ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.803506 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef290f-aa87-42f5-9ba9-2c55e8356ee5 admin admin] PATH_INFO: `/v3/projects/43bb88f109f34f24b70dd071f9b46469/users/23a5ca755f69455b8621aaef71ef2304/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.804080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819df32e-d061-4b3b-9cbc-07048fefa733 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.818263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1100/2224] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:45.822950 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819df32e-d061-4b3b-9cbc-07048fefa733 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.824284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef290f-aa87-42f5-9ba9-2c55e8356ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bb88f109f34f24b70dd071f9b46469, user_id=23a5ca755f69455b8621aaef71ef2304, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.827080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef290f-aa87-42f5-9ba9-2c55e8356ee5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.833117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819df32e-d061-4b3b-9cbc-07048fefa733 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.839741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323e54c-b820-430a-8231-f1ad86f4d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.840326 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323e54c-b820-430a-8231-f1ad86f4d13c admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.840609 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323e54c-b820-430a-8231-f1ad86f4d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.840887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323e54c-b820-430a-8231-f1ad86f4d13c admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.841743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323e54c-b820-430a-8231-f1ad86f4d13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.849688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1125/2225] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:45 2022] PUT /identity/v3/projects/43bb88f109f34f24b70dd071f9b46469/users/23a5ca755f69455b8621aaef71ef2304/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:45.849847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323e54c-b820-430a-8231-f1ad86f4d13c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.854049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e40ab-2ebe-40b5-8f3b-e1493dac008a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.854483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e40ab-2ebe-40b5-8f3b-e1493dac008a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.854846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e40ab-2ebe-40b5-8f3b-e1493dac008a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.860794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1101/2226] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:45.865377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323e54c-b820-430a-8231-f1ad86f4d13c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.875736 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323e54c-b820-430a-8231-f1ad86f4d13c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.887880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-9e6e40ab-2ebe-40b5-8f3b-e1493dac008a None None] MFA Rules not processed for user `23a5ca755f69455b8621aaef71ef2304`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:45.889120 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9e6e40ab-2ebe-40b5-8f3b-e1493dac008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:45.944924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794061c4-0514-483e-bc56-5b28a36c540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:45.946117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794061c4-0514-483e-bc56-5b28a36c540f admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.946409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794061c4-0514-483e-bc56-5b28a36c540f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.946691 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794061c4-0514-483e-bc56-5b28a36c540f admin admin] PATH_INFO: `/v3/projects/452dfcdbc50f49beae6ec4522f36bfea/users/14f5dc7d0dfb4aec96cc90ae8fa2d496/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:45.963124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794061c4-0514-483e-bc56-5b28a36c540f admin admin] RBAC: Authorizing `identity:create_grant(project_id=452dfcdbc50f49beae6ec4522f36bfea, user_id=14f5dc7d0dfb4aec96cc90ae8fa2d496, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:45.964607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1126/2227] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:45.965846 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794061c4-0514-483e-bc56-5b28a36c540f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:45.968846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e40ab-2ebe-40b5-8f3b-e1493dac008a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:45.980174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1102/2228] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:45 2022] PUT /identity/v3/projects/452dfcdbc50f49beae6ec4522f36bfea/users/14f5dc7d0dfb4aec96cc90ae8fa2d496/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:45.980556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e40ab-2ebe-40b5-8f3b-e1493dac008a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:45.991781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d610c2-414b-4d91-8522-784385cb3782 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:45.992861 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d610c2-414b-4d91-8522-784385cb3782 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:45.992996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d610c2-414b-4d91-8522-784385cb3782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:46.023217 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d6d610c2-414b-4d91-8522-784385cb3782 None None] MFA Rules not processed for user `14f5dc7d0dfb4aec96cc90ae8fa2d496`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:46.025086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d6d610c2-414b-4d91-8522-784385cb3782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:46.039441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62bdbf-d4be-49f3-bfb8-bfe7b764141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:46.040199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62bdbf-d4be-49f3-bfb8-bfe7b764141b admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:46.040488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62bdbf-d4be-49f3-bfb8-bfe7b764141b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:46.040769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62bdbf-d4be-49f3-bfb8-bfe7b764141b admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:46.041439 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62bdbf-d4be-49f3-bfb8-bfe7b764141b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:46.043356 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62bdbf-d4be-49f3-bfb8-bfe7b764141b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:46.045635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:46.059488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:46.073089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1127/2229] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:45 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:46.077242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62bdbf-d4be-49f3-bfb8-bfe7b764141b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:46.106433 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1103/2230] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:46.118488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d610c2-414b-4d91-8522-784385cb3782 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:46.132025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d6d610c2-414b-4d91-8522-784385cb3782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:46.145709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62bdbf-d4be-49f3-bfb8-bfe7b764141b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:46.151357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035e10a-0b2d-45ff-88e4-79c1d98bae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:46.152021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035e10a-0b2d-45ff-88e4-79c1d98bae1a admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:46.152311 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035e10a-0b2d-45ff-88e4-79c1d98bae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:46.152603 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035e10a-0b2d-45ff-88e4-79c1d98bae1a admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:46.153274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035e10a-0b2d-45ff-88e4-79c1d98bae1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:46.155225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035e10a-0b2d-45ff-88e4-79c1d98bae1a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:46.178687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1128/2231] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:46 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:46.183659 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035e10a-0b2d-45ff-88e4-79c1d98bae1a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:46.193363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035e10a-0b2d-45ff-88e4-79c1d98bae1a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:46.193960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d610c2-414b-4d91-8522-784385cb3782 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:46.198754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1691eb4-a6ef-4fe8-ac7f-ddc69da8438b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:46.199364 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1691eb4-a6ef-4fe8-ac7f-ddc69da8438b admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:46.199766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1691eb4-a6ef-4fe8-ac7f-ddc69da8438b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:46.200079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1691eb4-a6ef-4fe8-ac7f-ddc69da8438b admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:46.200772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1691eb4-a6ef-4fe8-ac7f-ddc69da8438b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:46.202363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1691eb4-a6ef-4fe8-ac7f-ddc69da8438b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:46.213843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1129/2232] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:46.217707 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1691eb4-a6ef-4fe8-ac7f-ddc69da8438b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:46.227817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1691eb4-a6ef-4fe8-ac7f-ddc69da8438b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:46.232529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a59d0-3841-438c-8c00-9ffba76b01d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:46.233186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a59d0-3841-438c-8c00-9ffba76b01d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:46.233469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a59d0-3841-438c-8c00-9ffba76b01d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:46.233749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a59d0-3841-438c-8c00-9ffba76b01d4 admin admin] PATH_INFO: `/v3/projects/76bb2db3ccc34719b2b2e0720c22f8ce/users/7860187dbe874594967f72404255b13f/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:46.249541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e76f7-6c69-4f62-8f7b-180e4582e094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:46.250086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e76f7-6c69-4f62-8f7b-180e4582e094 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:46.250407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e76f7-6c69-4f62-8f7b-180e4582e094 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:46.250687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e76f7-6c69-4f62-8f7b-180e4582e094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:46.250907 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a59d0-3841-438c-8c00-9ffba76b01d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bb2db3ccc34719b2b2e0720c22f8ce, user_id=7860187dbe874594967f72404255b13f, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:46.253664 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a59d0-3841-438c-8c00-9ffba76b01d4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:46.267090 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1130/2233] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:46 2022] PUT /identity/v3/projects/76bb2db3ccc34719b2b2e0720c22f8ce/users/7860187dbe874594967f72404255b13f/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:46.270928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a59d0-3841-438c-8c00-9ffba76b01d4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:46.311822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e76f7-6c69-4f62-8f7b-180e4582e094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:46.313291 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e76f7-6c69-4f62-8f7b-180e4582e094 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:46.323088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1104/2234] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:35:46.335219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a59d0-3841-438c-8c00-9ffba76b01d4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:46.341121 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68990728-8564-4640-8802-3a00706f81ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:46.341787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68990728-8564-4640-8802-3a00706f81ae admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:46.342073 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68990728-8564-4640-8802-3a00706f81ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:46.342351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68990728-8564-4640-8802-3a00706f81ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:46.343057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68990728-8564-4640-8802-3a00706f81ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:46.344694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68990728-8564-4640-8802-3a00706f81ae admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:46.356821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1131/2235] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:35:46.361012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e76f7-6c69-4f62-8f7b-180e4582e094 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:46.373171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e76f7-6c69-4f62-8f7b-180e4582e094 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:46.377899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c99137-143f-4093-86df-650eaa97eb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:46.378671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c99137-143f-4093-86df-650eaa97eb69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:46.379500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c99137-143f-4093-86df-650eaa97eb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:46.380247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c99137-143f-4093-86df-650eaa97eb69 admin admin] PATH_INFO: `/v3/projects/76bb2db3ccc34719b2b2e0720c22f8ce/users/7860187dbe874594967f72404255b13f/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:46.382581 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c99137-143f-4093-86df-650eaa97eb69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bb2db3ccc34719b2b2e0720c22f8ce, user_id=7860187dbe874594967f72404255b13f, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:46.386810 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c99137-143f-4093-86df-650eaa97eb69 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:46.399578 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1105/2236] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:46 2022] PUT /identity/v3/projects/76bb2db3ccc34719b2b2e0720c22f8ce/users/7860187dbe874594967f72404255b13f/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:46.410499 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473fdd2-ed4b-4dad-874d-1f02c6c7274c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:46.410795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473fdd2-ed4b-4dad-874d-1f02c6c7274c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:46.411072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473fdd2-ed4b-4dad-874d-1f02c6c7274c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:46.439346 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c473fdd2-ed4b-4dad-874d-1f02c6c7274c None None] MFA Rules not processed for user `7860187dbe874594967f72404255b13f`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:46.440591 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c473fdd2-ed4b-4dad-874d-1f02c6c7274c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:46.481433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:46.529793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1132/2237] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:46.539919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c99137-143f-4093-86df-650eaa97eb69 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:46.542043 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-86c99137-143f-4093-86df-650eaa97eb69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:46.577650 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:46.624954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c99137-143f-4093-86df-650eaa97eb69 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:46.628794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d90bc0-6531-448b-b956-bf3bce94d3df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:46.629430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d90bc0-6531-448b-b956-bf3bce94d3df service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:46.629718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d90bc0-6531-448b-b956-bf3bce94d3df service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:46.629995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d90bc0-6531-448b-b956-bf3bce94d3df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:46.645930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d90bc0-6531-448b-b956-bf3bce94d3df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:46.647442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d90bc0-6531-448b-b956-bf3bce94d3df service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:46.663895 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1106/2238] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:46.817153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473fdd2-ed4b-4dad-874d-1f02c6c7274c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:46.888329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473fdd2-ed4b-4dad-874d-1f02c6c7274c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:46.892966 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:46.893599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:46.893878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:46.894151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] PATH_INFO: `/v3/users/23a5ca755f69455b8621aaef71ef2304` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:46.895301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a5ca755f69455b8621aaef71ef2304)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:46.897245 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:46.942192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a5ca755f69455b8621aaef71ef2304'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:46.950386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a5ca755f69455b8621aaef71ef2304'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:46.957407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a5ca755f69455b8621aaef71ef2304'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:46.958043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a5ca755f69455b8621aaef71ef2304'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:46.958658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a5ca755f69455b8621aaef71ef2304'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:46.976182 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1133/2239] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:46 2022] DELETE /identity/v3/users/23a5ca755f69455b8621aaef71ef2304 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:46.980930 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26cda3-e994-431d-a32e-dbaa9dd49383 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:46.981223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26cda3-e994-431d-a32e-dbaa9dd49383 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:46.981502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26cda3-e994-431d-a32e-dbaa9dd49383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:47.000694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2b26cda3-e994-431d-a32e-dbaa9dd49383 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:47.001882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2b26cda3-e994-431d-a32e-dbaa9dd49383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:47.061114 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1107/2240] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:47.071349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:47.072809 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:47.125572 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:47.129464 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cbc9a-a741-4a74-a900-067f7734e541 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:47.136203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9fff6-38c4-4eed-8334-3214178c339c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:47.136967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9fff6-38c4-4eed-8334-3214178c339c service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:47.137442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9fff6-38c4-4eed-8334-3214178c339c service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:47.137723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9fff6-38c4-4eed-8334-3214178c339c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:47.147544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9fff6-38c4-4eed-8334-3214178c339c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:47.149123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9fff6-38c4-4eed-8334-3214178c339c service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:47.159433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1134/2241] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:47.438111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26cda3-e994-431d-a32e-dbaa9dd49383 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:47.439613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2b26cda3-e994-431d-a32e-dbaa9dd49383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:47.454603 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26cda3-e994-431d-a32e-dbaa9dd49383 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:47.459265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe248c-6d97-44c6-a41d-21859c0b4297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:47.459966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe248c-6d97-44c6-a41d-21859c0b4297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:47.460256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe248c-6d97-44c6-a41d-21859c0b4297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:47.460535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe248c-6d97-44c6-a41d-21859c0b4297 admin admin] PATH_INFO: `/v3/projects/43bb88f109f34f24b70dd071f9b46469` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:47.461995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe248c-6d97-44c6-a41d-21859c0b4297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43bb88f109f34f24b70dd071f9b46469)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:47.463919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe248c-6d97-44c6-a41d-21859c0b4297 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:47.512003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-12fe248c-6d97-44c6-a41d-21859c0b4297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43bb88f109f34f24b70dd071f9b46469', 'request_id': 'req-12fe248c-6d97-44c6-a41d-21859c0b4297'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:47.519417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-12fe248c-6d97-44c6-a41d-21859c0b4297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43bb88f109f34f24b70dd071f9b46469', 'request_id': 'req-12fe248c-6d97-44c6-a41d-21859c0b4297'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:47.527111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-12fe248c-6d97-44c6-a41d-21859c0b4297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43bb88f109f34f24b70dd071f9b46469', 'request_id': 'req-12fe248c-6d97-44c6-a41d-21859c0b4297'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:47.538024 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-12fe248c-6d97-44c6-a41d-21859c0b4297 admin admin] The token cache is being invalidate because project 43bb88f109f34f24b70dd071f9b46469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:47.538298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-12fe248c-6d97-44c6-a41d-21859c0b4297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:47.539456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-12fe248c-6d97-44c6-a41d-21859c0b4297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:47.541406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1108/2242] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:47 2022] DELETE /identity/v3/projects/43bb88f109f34f24b70dd071f9b46469 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:47.545509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9fff6-38c4-4eed-8334-3214178c339c service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:47.556421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9fff6-38c4-4eed-8334-3214178c339c service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:47.614822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:47.615386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:47.615678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:47.615993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] PATH_INFO: `/v3/users/7860187dbe874594967f72404255b13f` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:47.617215 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7860187dbe874594967f72404255b13f)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:47.619185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:47.670410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7860187dbe874594967f72404255b13f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:47.678747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7860187dbe874594967f72404255b13f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:47.688383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7860187dbe874594967f72404255b13f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:47.689134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7860187dbe874594967f72404255b13f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:47.689757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7860187dbe874594967f72404255b13f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:47.707240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1135/2243] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:47 2022] DELETE /identity/v3/users/7860187dbe874594967f72404255b13f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:47.732731 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a62d09-f384-44a8-b258-dfeab5370159 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:47.733027 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a62d09-f384-44a8-b258-dfeab5370159 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:47.733310 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a62d09-f384-44a8-b258-dfeab5370159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:47.757444 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-99a62d09-f384-44a8-b258-dfeab5370159 None None] MFA Rules not processed for user `14f5dc7d0dfb4aec96cc90ae8fa2d496`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:47.759090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-99a62d09-f384-44a8-b258-dfeab5370159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:47.812270 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:47.834526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1109/2244] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:48.058138 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:48.059605 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:48.144666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f929b-1b5c-47b7-9ad1-59f9ad244107 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:48.149833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79065cd0-693d-4e3a-b472-bf75b177abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:48.150511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79065cd0-693d-4e3a-b472-bf75b177abb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:48.150806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79065cd0-693d-4e3a-b472-bf75b177abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:48.151088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79065cd0-693d-4e3a-b472-bf75b177abb9 admin admin] PATH_INFO: `/v3/projects/76bb2db3ccc34719b2b2e0720c22f8ce` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:48.152410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79065cd0-693d-4e3a-b472-bf75b177abb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76bb2db3ccc34719b2b2e0720c22f8ce)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:48.154368 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79065cd0-693d-4e3a-b472-bf75b177abb9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:48.168609 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:48.215327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-79065cd0-693d-4e3a-b472-bf75b177abb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76bb2db3ccc34719b2b2e0720c22f8ce', 'request_id': 'req-79065cd0-693d-4e3a-b472-bf75b177abb9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:48.224321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-79065cd0-693d-4e3a-b472-bf75b177abb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76bb2db3ccc34719b2b2e0720c22f8ce', 'request_id': 'req-79065cd0-693d-4e3a-b472-bf75b177abb9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:48.232534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-79065cd0-693d-4e3a-b472-bf75b177abb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76bb2db3ccc34719b2b2e0720c22f8ce', 'request_id': 'req-79065cd0-693d-4e3a-b472-bf75b177abb9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:48.248320 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-79065cd0-693d-4e3a-b472-bf75b177abb9 admin admin] The token cache is being invalidate because project 76bb2db3ccc34719b2b2e0720c22f8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:48.248628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-79065cd0-693d-4e3a-b472-bf75b177abb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:48.249398 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-79065cd0-693d-4e3a-b472-bf75b177abb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:48.250998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1136/2245] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:48 2022] DELETE /identity/v3/projects/76bb2db3ccc34719b2b2e0720c22f8ce => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:48.255841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699aa08-79cd-4d46-8065-585d50b6e99b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:48.256162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699aa08-79cd-4d46-8065-585d50b6e99b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:48.256447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699aa08-79cd-4d46-8065-585d50b6e99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:48.276222 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-9699aa08-79cd-4d46-8065-585d50b6e99b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:48.277433 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9699aa08-79cd-4d46-8065-585d50b6e99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:48.343598 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1110/2246] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:48.352491 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa83ef8-59fd-4192-9ded-8b8acc791313 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:48.352783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa83ef8-59fd-4192-9ded-8b8acc791313 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:48.353065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa83ef8-59fd-4192-9ded-8b8acc791313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:48.373484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-eaa83ef8-59fd-4192-9ded-8b8acc791313 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:48.374710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-eaa83ef8-59fd-4192-9ded-8b8acc791313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:48.383366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1137/2247] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:48.387746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699aa08-79cd-4d46-8065-585d50b6e99b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:48.397507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699aa08-79cd-4d46-8065-585d50b6e99b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:48.402256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed85275-7dfb-4d6c-b7d5-79920b4e7602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:48.402869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed85275-7dfb-4d6c-b7d5-79920b4e7602 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:48.403155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed85275-7dfb-4d6c-b7d5-79920b4e7602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:48.403433 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed85275-7dfb-4d6c-b7d5-79920b4e7602 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:48.404169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed85275-7dfb-4d6c-b7d5-79920b4e7602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:48.404478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed85275-7dfb-4d6c-b7d5-79920b4e7602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:48.406075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed85275-7dfb-4d6c-b7d5-79920b4e7602 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:48.418230 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1111/2248] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:48.422557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa83ef8-59fd-4192-9ded-8b8acc791313 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:48.434592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa83ef8-59fd-4192-9ded-8b8acc791313 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:48.439340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40e85c-763a-41b7-89f0-6cfe4e45e00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:48.439997 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40e85c-763a-41b7-89f0-6cfe4e45e00c admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:48.440301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40e85c-763a-41b7-89f0-6cfe4e45e00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:48.440579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40e85c-763a-41b7-89f0-6cfe4e45e00c admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:48.441256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40e85c-763a-41b7-89f0-6cfe4e45e00c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:48.443464 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40e85c-763a-41b7-89f0-6cfe4e45e00c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:48.479305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1138/2249] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:48 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:48.483582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed85275-7dfb-4d6c-b7d5-79920b4e7602 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:48.495239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed85275-7dfb-4d6c-b7d5-79920b4e7602 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:48.553595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecadc3-8830-482b-ba38-afb9d48995ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:48.554253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecadc3-8830-482b-ba38-afb9d48995ad admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:48.555560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecadc3-8830-482b-ba38-afb9d48995ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:48.555560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecadc3-8830-482b-ba38-afb9d48995ad admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:48.556069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecadc3-8830-482b-ba38-afb9d48995ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:48.558076 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecadc3-8830-482b-ba38-afb9d48995ad admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:48.583716 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1112/2250] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:48 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:48.589100 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40e85c-763a-41b7-89f0-6cfe4e45e00c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:48.601516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40e85c-763a-41b7-89f0-6cfe4e45e00c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:48.608322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f71d0-9756-42c0-b7f7-9bf9b2f560ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:48.609149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f71d0-9756-42c0-b7f7-9bf9b2f560ee admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:48.609530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f71d0-9756-42c0-b7f7-9bf9b2f560ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:48.609926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f71d0-9756-42c0-b7f7-9bf9b2f560ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:48.611001 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f71d0-9756-42c0-b7f7-9bf9b2f560ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:48.613162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f71d0-9756-42c0-b7f7-9bf9b2f560ee admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:48.625156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1139/2251] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:48.629062 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecadc3-8830-482b-ba38-afb9d48995ad admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:48.642959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecadc3-8830-482b-ba38-afb9d48995ad admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:48.647058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b870db6-f40f-4e63-a3eb-fa27f3afe88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:48.647742 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b870db6-f40f-4e63-a3eb-fa27f3afe88c admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:48.648935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b870db6-f40f-4e63-a3eb-fa27f3afe88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:48.650047 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b870db6-f40f-4e63-a3eb-fa27f3afe88c admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:48.655368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b870db6-f40f-4e63-a3eb-fa27f3afe88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:48.655368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b870db6-f40f-4e63-a3eb-fa27f3afe88c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:48.669334 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1113/2252] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:48.670859 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f71d0-9756-42c0-b7f7-9bf9b2f560ee admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:48.685352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f71d0-9756-42c0-b7f7-9bf9b2f560ee admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:48.690556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed84ae-2202-4057-a2b0-24584aa6bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:48.691299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed84ae-2202-4057-a2b0-24584aa6bd9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:48.691481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed84ae-2202-4057-a2b0-24584aa6bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:48.692096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed84ae-2202-4057-a2b0-24584aa6bd9e admin admin] PATH_INFO: `/v3/projects/072117b60f944723afcf7c807c0b14d3/users/4c8741e5e954446fb9cabbdd042e427c/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:48.718402 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed84ae-2202-4057-a2b0-24584aa6bd9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=072117b60f944723afcf7c807c0b14d3, user_id=4c8741e5e954446fb9cabbdd042e427c, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:48.721153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed84ae-2202-4057-a2b0-24584aa6bd9e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:48.738392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1140/2253] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:48 2022] PUT /identity/v3/projects/072117b60f944723afcf7c807c0b14d3/users/4c8741e5e954446fb9cabbdd042e427c/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:48.749176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397db55-72d6-452a-b04b-521335c65188 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:48.749488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397db55-72d6-452a-b04b-521335c65188 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:48.749770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397db55-72d6-452a-b04b-521335c65188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:48.781093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5397db55-72d6-452a-b04b-521335c65188 None None] MFA Rules not processed for user `4c8741e5e954446fb9cabbdd042e427c`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:48.782417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5397db55-72d6-452a-b04b-521335c65188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:48.831945 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:48.860588 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1114/2254] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:48.862646 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed84ae-2202-4057-a2b0-24584aa6bd9e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:48.939826 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed84ae-2202-4057-a2b0-24584aa6bd9e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:48.946160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877dd02-a39a-4c3f-b51f-7376368a918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:48.946945 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877dd02-a39a-4c3f-b51f-7376368a918d admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:48.947275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877dd02-a39a-4c3f-b51f-7376368a918d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:48.947680 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877dd02-a39a-4c3f-b51f-7376368a918d admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:48.948503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877dd02-a39a-4c3f-b51f-7376368a918d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:48.950582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877dd02-a39a-4c3f-b51f-7376368a918d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:48.987644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1141/2255] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:48 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:48.989433 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397db55-72d6-452a-b04b-521335c65188 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:49.000600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397db55-72d6-452a-b04b-521335c65188 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:49.064340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac892ae-ddfc-487d-a768-73c5576b2fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:49.064979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac892ae-ddfc-487d-a768-73c5576b2fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:49.065265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac892ae-ddfc-487d-a768-73c5576b2fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:49.065546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac892ae-ddfc-487d-a768-73c5576b2fcc admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:49.066238 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac892ae-ddfc-487d-a768-73c5576b2fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:49.068270 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac892ae-ddfc-487d-a768-73c5576b2fcc admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:49.092087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1115/2256] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:48 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:35:49.096119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877dd02-a39a-4c3f-b51f-7376368a918d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:49.107158 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877dd02-a39a-4c3f-b51f-7376368a918d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:49.112718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d741ab-6a26-4351-922c-03c9440838de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:49.113406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d741ab-6a26-4351-922c-03c9440838de admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:49.113626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d741ab-6a26-4351-922c-03c9440838de admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:49.113898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d741ab-6a26-4351-922c-03c9440838de admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:49.114713 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d741ab-6a26-4351-922c-03c9440838de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:49.116384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d741ab-6a26-4351-922c-03c9440838de admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:49.128111 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1142/2257] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:49.132249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac892ae-ddfc-487d-a768-73c5576b2fcc admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:49.143065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac892ae-ddfc-487d-a768-73c5576b2fcc admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:49.147760 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb01859-4d7c-4996-9684-c17315dd0b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:49.149017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb01859-4d7c-4996-9684-c17315dd0b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:49.149509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb01859-4d7c-4996-9684-c17315dd0b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:49.149747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb01859-4d7c-4996-9684-c17315dd0b92 admin admin] PATH_INFO: `/v3/projects/f081eddbb5624e3a8f595d3ad48c1f98/users/966d5874d93e4f80a656aefcbe25f913/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:49.164925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb01859-4d7c-4996-9684-c17315dd0b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f081eddbb5624e3a8f595d3ad48c1f98, user_id=966d5874d93e4f80a656aefcbe25f913, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:49.167535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb01859-4d7c-4996-9684-c17315dd0b92 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:49.181864 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1116/2258] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:49 2022] PUT /identity/v3/projects/f081eddbb5624e3a8f595d3ad48c1f98/users/966d5874d93e4f80a656aefcbe25f913/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:49.185779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d741ab-6a26-4351-922c-03c9440838de admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:49.197844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d741ab-6a26-4351-922c-03c9440838de admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:49.206374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:49.276646 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8d330-b0eb-48c1-979d-d9749f433ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:49.277339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8d330-b0eb-48c1-979d-d9749f433ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:49.277634 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8d330-b0eb-48c1-979d-d9749f433ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:49.277916 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8d330-b0eb-48c1-979d-d9749f433ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:49.278676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8d330-b0eb-48c1-979d-d9749f433ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:49.280342 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8d330-b0eb-48c1-979d-d9749f433ddc admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:49.294277 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1143/2259] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:49.295535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb01859-4d7c-4996-9684-c17315dd0b92 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:49.307317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb01859-4d7c-4996-9684-c17315dd0b92 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:49.312160 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba0e8a-12b8-4563-82a2-f80183f25737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:49.313049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba0e8a-12b8-4563-82a2-f80183f25737 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:49.313417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba0e8a-12b8-4563-82a2-f80183f25737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:49.313868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba0e8a-12b8-4563-82a2-f80183f25737 admin admin] PATH_INFO: `/v3/projects/f081eddbb5624e3a8f595d3ad48c1f98/users/966d5874d93e4f80a656aefcbe25f913/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:49.316306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba0e8a-12b8-4563-82a2-f80183f25737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f081eddbb5624e3a8f595d3ad48c1f98, user_id=966d5874d93e4f80a656aefcbe25f913, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:49.319391 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba0e8a-12b8-4563-82a2-f80183f25737 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:49.331000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1117/2260] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:49 2022] PUT /identity/v3/projects/f081eddbb5624e3a8f595d3ad48c1f98/users/966d5874d93e4f80a656aefcbe25f913/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:35:49.342475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2cdcf-a270-4c82-a924-4cb61ea32348 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:49.342779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2cdcf-a270-4c82-a924-4cb61ea32348 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:49.343065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2cdcf-a270-4c82-a924-4cb61ea32348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:49.373336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7aa2cdcf-a270-4c82-a924-4cb61ea32348 None None] MFA Rules not processed for user `966d5874d93e4f80a656aefcbe25f913`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:49.374793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7aa2cdcf-a270-4c82-a924-4cb61ea32348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:49.453876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1144/2261] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:49.465897 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba0e8a-12b8-4563-82a2-f80183f25737 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:49.467779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-04ba0e8a-12b8-4563-82a2-f80183f25737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:49.528253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba0e8a-12b8-4563-82a2-f80183f25737 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:49.531935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759d3d3-f43d-4f9d-a091-ede79812dd6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:49.532556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759d3d3-f43d-4f9d-a091-ede79812dd6f service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:49.532841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759d3d3-f43d-4f9d-a091-ede79812dd6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:49.533118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759d3d3-f43d-4f9d-a091-ede79812dd6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:49.580813 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:49.592495 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759d3d3-f43d-4f9d-a091-ede79812dd6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:49.594071 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759d3d3-f43d-4f9d-a091-ede79812dd6f service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:49.603599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1118/2262] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:35:52.666474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2cdcf-a270-4c82-a924-4cb61ea32348 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:52.668028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7aa2cdcf-a270-4c82-a924-4cb61ea32348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:52.761156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2cdcf-a270-4c82-a924-4cb61ea32348 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:52.766170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:52.766899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:52.767187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:52.767470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] PATH_INFO: `/v3/users/853055b8e13449758b18766435a5a91e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:52.768712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=853055b8e13449758b18766435a5a91e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:52.770652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:52.821120 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:52.832674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853055b8e13449758b18766435a5a91e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:52.842148 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853055b8e13449758b18766435a5a91e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:52.851019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853055b8e13449758b18766435a5a91e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:52.852381 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853055b8e13449758b18766435a5a91e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:52.853410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853055b8e13449758b18766435a5a91e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:52.880312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1145/2263] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:52 2022] DELETE /identity/v3/users/853055b8e13449758b18766435a5a91e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:52.886293 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc1953-b06c-4d65-8d88-0ac204334216 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:52.887012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc1953-b06c-4d65-8d88-0ac204334216 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:52.887012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc1953-b06c-4d65-8d88-0ac204334216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:52.911817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c1bc1953-b06c-4d65-8d88-0ac204334216 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:52.913183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c1bc1953-b06c-4d65-8d88-0ac204334216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:53.002816 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1119/2264] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:53.014786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:53.017160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:53.098710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff7d96-cc2b-446f-a386-ded78f59fce9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:53.104288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef09e1b-3ca7-434d-900b-2a0a5be56c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:53.105907 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef09e1b-3ca7-434d-900b-2a0a5be56c60 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:53.106443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef09e1b-3ca7-434d-900b-2a0a5be56c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:53.106804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef09e1b-3ca7-434d-900b-2a0a5be56c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:53.118594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef09e1b-3ca7-434d-900b-2a0a5be56c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:53.120109 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef09e1b-3ca7-434d-900b-2a0a5be56c60 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:53.132245 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1146/2265] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:53.415948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc1953-b06c-4d65-8d88-0ac204334216 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:53.417502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c1bc1953-b06c-4d65-8d88-0ac204334216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:53.432074 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc1953-b06c-4d65-8d88-0ac204334216 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:53.437082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffe80d-caa7-45f0-87b5-0109b2c3b255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:53.437875 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffe80d-caa7-45f0-87b5-0109b2c3b255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:53.438159 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffe80d-caa7-45f0-87b5-0109b2c3b255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:53.438446 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffe80d-caa7-45f0-87b5-0109b2c3b255 admin admin] PATH_INFO: `/v3/projects/f436e02bd05f49aca2394429190d77f0` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:53.439606 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffe80d-caa7-45f0-87b5-0109b2c3b255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f436e02bd05f49aca2394429190d77f0)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:53.441590 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffe80d-caa7-45f0-87b5-0109b2c3b255 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:53.493528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-58ffe80d-caa7-45f0-87b5-0109b2c3b255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f436e02bd05f49aca2394429190d77f0', 'request_id': 'req-58ffe80d-caa7-45f0-87b5-0109b2c3b255'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:53.501454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-58ffe80d-caa7-45f0-87b5-0109b2c3b255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f436e02bd05f49aca2394429190d77f0', 'request_id': 'req-58ffe80d-caa7-45f0-87b5-0109b2c3b255'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:53.508494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-58ffe80d-caa7-45f0-87b5-0109b2c3b255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f436e02bd05f49aca2394429190d77f0', 'request_id': 'req-58ffe80d-caa7-45f0-87b5-0109b2c3b255'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:53.519803 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-58ffe80d-caa7-45f0-87b5-0109b2c3b255 admin admin] The token cache is being invalidate because project f436e02bd05f49aca2394429190d77f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:53.520125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-58ffe80d-caa7-45f0-87b5-0109b2c3b255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:53.520777 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-58ffe80d-caa7-45f0-87b5-0109b2c3b255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:53.522286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1120/2266] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:53 2022] DELETE /identity/v3/projects/f436e02bd05f49aca2394429190d77f0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:53.527436 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9106efa-97dd-4672-8287-5de085979af6 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:53.528316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9106efa-97dd-4672-8287-5de085979af6 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:53.528316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9106efa-97dd-4672-8287-5de085979af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:53.548756 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d9106efa-97dd-4672-8287-5de085979af6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:53.549950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d9106efa-97dd-4672-8287-5de085979af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:53.628272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1147/2267] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:53.637403 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f247bfd-a7db-4aa1-8c2b-3fab4a865903 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:53.637725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f247bfd-a7db-4aa1-8c2b-3fab4a865903 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:53.638009 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f247bfd-a7db-4aa1-8c2b-3fab4a865903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:53.663418 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0f247bfd-a7db-4aa1-8c2b-3fab4a865903 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:53.664770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0f247bfd-a7db-4aa1-8c2b-3fab4a865903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:53.672984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1121/2268] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:53.677205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9106efa-97dd-4672-8287-5de085979af6 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:53.688153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9106efa-97dd-4672-8287-5de085979af6 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:53.692958 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6496ac-704e-4d21-a540-41145302a472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:53.693595 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6496ac-704e-4d21-a540-41145302a472 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:53.693885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6496ac-704e-4d21-a540-41145302a472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:53.694183 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6496ac-704e-4d21-a540-41145302a472 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:53.694884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6496ac-704e-4d21-a540-41145302a472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:53.695235 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6496ac-704e-4d21-a540-41145302a472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:53.701285 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6496ac-704e-4d21-a540-41145302a472 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:53.714341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1148/2269] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:53.715593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f247bfd-a7db-4aa1-8c2b-3fab4a865903 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:53.724945 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f247bfd-a7db-4aa1-8c2b-3fab4a865903 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:53.729637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99829a2-4211-4b53-bde3-7ad8c04f1bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:53.730258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99829a2-4211-4b53-bde3-7ad8c04f1bde admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:53.730537 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99829a2-4211-4b53-bde3-7ad8c04f1bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:53.730808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99829a2-4211-4b53-bde3-7ad8c04f1bde admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:53.731468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99829a2-4211-4b53-bde3-7ad8c04f1bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:53.733378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99829a2-4211-4b53-bde3-7ad8c04f1bde admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:53.768840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1122/2270] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:53 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:53.770311 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6496ac-704e-4d21-a540-41145302a472 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:53.780443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6496ac-704e-4d21-a540-41145302a472 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:53.829824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:53.852229 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3576d00-d65e-45b3-918f-86e75c7bbb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:53.853423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3576d00-d65e-45b3-918f-86e75c7bbb39 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:53.853706 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3576d00-d65e-45b3-918f-86e75c7bbb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:53.853980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3576d00-d65e-45b3-918f-86e75c7bbb39 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:53.854647 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3576d00-d65e-45b3-918f-86e75c7bbb39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:53.856863 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3576d00-d65e-45b3-918f-86e75c7bbb39 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:53.881415 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1149/2271] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:53 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:53.885720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99829a2-4211-4b53-bde3-7ad8c04f1bde admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:53.897643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99829a2-4211-4b53-bde3-7ad8c04f1bde admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:53.903415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5e163-97de-41ca-9142-dd0f7bfb92b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:53.904072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5e163-97de-41ca-9142-dd0f7bfb92b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:53.904358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5e163-97de-41ca-9142-dd0f7bfb92b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:53.904633 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5e163-97de-41ca-9142-dd0f7bfb92b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:53.905342 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5e163-97de-41ca-9142-dd0f7bfb92b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:53.907104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5e163-97de-41ca-9142-dd0f7bfb92b2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:53.924396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1123/2272] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:53.925763 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3576d00-d65e-45b3-918f-86e75c7bbb39 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:53.935884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3576d00-d65e-45b3-918f-86e75c7bbb39 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:53.940504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150db71b-5872-4f0a-935b-db83f63a4b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:53.941153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db71b-5872-4f0a-935b-db83f63a4b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:53.941430 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db71b-5872-4f0a-935b-db83f63a4b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:53.941705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150db71b-5872-4f0a-935b-db83f63a4b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:53.942401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150db71b-5872-4f0a-935b-db83f63a4b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:53.944022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150db71b-5872-4f0a-935b-db83f63a4b7e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:53.960149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1150/2273] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:53.961995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5e163-97de-41ca-9142-dd0f7bfb92b2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:53.972377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5e163-97de-41ca-9142-dd0f7bfb92b2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:53.977658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdb999-aa4a-4182-9807-f1f101a22779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:53.979147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdb999-aa4a-4182-9807-f1f101a22779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:53.979437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdb999-aa4a-4182-9807-f1f101a22779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:53.979719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdb999-aa4a-4182-9807-f1f101a22779 admin admin] PATH_INFO: `/v3/projects/ab0ea84257d64526a3af4a04479d701a/users/585680c455e3416a8cde9702a8a09fb7/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:53.996585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdb999-aa4a-4182-9807-f1f101a22779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0ea84257d64526a3af4a04479d701a, user_id=585680c455e3416a8cde9702a8a09fb7, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:54.001760 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdb999-aa4a-4182-9807-f1f101a22779 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:54.014146 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1124/2274] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:53 2022] PUT /identity/v3/projects/ab0ea84257d64526a3af4a04479d701a/users/585680c455e3416a8cde9702a8a09fb7/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:54.024812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8e2a1-dd74-4fb4-b9bb-40197e127f0b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:54.024812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8e2a1-dd74-4fb4-b9bb-40197e127f0b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:54.025015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8e2a1-dd74-4fb4-b9bb-40197e127f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:54.060042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-cbe8e2a1-dd74-4fb4-b9bb-40197e127f0b None None] MFA Rules not processed for user `585680c455e3416a8cde9702a8a09fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:54.062061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cbe8e2a1-dd74-4fb4-b9bb-40197e127f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:54.134301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1151/2275] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:54.145867 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdb999-aa4a-4182-9807-f1f101a22779 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:54.147974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4ccdb999-aa4a-4182-9807-f1f101a22779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:54.163631 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:54.233908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdb999-aa4a-4182-9807-f1f101a22779 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:54.237357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8e2a1-dd74-4fb4-b9bb-40197e127f0b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:54.238873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cbe8e2a1-dd74-4fb4-b9bb-40197e127f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:54.240171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e9175-10c2-421b-9577-8349196cf86b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:54.240881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e9175-10c2-421b-9577-8349196cf86b service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:54.241243 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e9175-10c2-421b-9577-8349196cf86b service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:54.241617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e9175-10c2-421b-9577-8349196cf86b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:54.253614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e9175-10c2-421b-9577-8349196cf86b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:54.254183 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8e2a1-dd74-4fb4-b9bb-40197e127f0b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:54.255064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e9175-10c2-421b-9577-8349196cf86b service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:54.259682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891621e0-6506-44ce-9ac6-227b5bbfdf4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:54.260345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891621e0-6506-44ce-9ac6-227b5bbfdf4e service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:54.260635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891621e0-6506-44ce-9ac6-227b5bbfdf4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:54.261269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891621e0-6506-44ce-9ac6-227b5bbfdf4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:54.262750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-891621e0-6506-44ce-9ac6-227b5bbfdf4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:54.266737 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1125/2276] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:54.298399 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e9175-10c2-421b-9577-8349196cf86b service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:54.344870 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891621e0-6506-44ce-9ac6-227b5bbfdf4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:54.346483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891621e0-6506-44ce-9ac6-227b5bbfdf4e service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:54.368162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1152/2277] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:54.383283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e9175-10c2-421b-9577-8349196cf86b service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:54.389347 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:54.390006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:54.390289 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:54.390565 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] PATH_INFO: `/v3/users/585680c455e3416a8cde9702a8a09fb7` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:54.391762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=585680c455e3416a8cde9702a8a09fb7)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:54.393697 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:54.455778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585680c455e3416a8cde9702a8a09fb7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:54.469117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585680c455e3416a8cde9702a8a09fb7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:54.479886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585680c455e3416a8cde9702a8a09fb7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:54.480631 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585680c455e3416a8cde9702a8a09fb7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:54.481624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585680c455e3416a8cde9702a8a09fb7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:54.504174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1126/2278] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:54 2022] DELETE /identity/v3/users/585680c455e3416a8cde9702a8a09fb7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:54.509764 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998f09c-4bea-4736-afa4-d224ea1cbd72 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:54.510249 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998f09c-4bea-4736-afa4-d224ea1cbd72 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:54.510632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998f09c-4bea-4736-afa4-d224ea1cbd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:54.532812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6998f09c-4bea-4736-afa4-d224ea1cbd72 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:54.533383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6998f09c-4bea-4736-afa4-d224ea1cbd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:54.581875 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:54.604019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1153/2279] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:54.614613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:54.616150 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:54.673785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:54.717143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff44c9b-c834-46f7-b670-a9f628fd3bd7 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:54.720845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74746d7d-5b4f-4e73-9b21-edc9c03dfc8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:54.721474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74746d7d-5b4f-4e73-9b21-edc9c03dfc8d service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:54.721758 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74746d7d-5b4f-4e73-9b21-edc9c03dfc8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:54.722035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74746d7d-5b4f-4e73-9b21-edc9c03dfc8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:54.732728 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74746d7d-5b4f-4e73-9b21-edc9c03dfc8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:54.734357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74746d7d-5b4f-4e73-9b21-edc9c03dfc8d service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:54.745597 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1127/2280] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:55.053791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998f09c-4bea-4736-afa4-d224ea1cbd72 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:55.056190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6998f09c-4bea-4736-afa4-d224ea1cbd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:55.071394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998f09c-4bea-4736-afa4-d224ea1cbd72 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:55.077573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a613b-a70b-42ff-8738-832733f895c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:55.078770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a613b-a70b-42ff-8738-832733f895c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:55.079043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a613b-a70b-42ff-8738-832733f895c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:55.079424 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a613b-a70b-42ff-8738-832733f895c3 admin admin] PATH_INFO: `/v3/projects/ab0ea84257d64526a3af4a04479d701a` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:55.080767 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a613b-a70b-42ff-8738-832733f895c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0ea84257d64526a3af4a04479d701a)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:55.083114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a613b-a70b-42ff-8738-832733f895c3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:55.134542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-483a613b-a70b-42ff-8738-832733f895c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0ea84257d64526a3af4a04479d701a', 'request_id': 'req-483a613b-a70b-42ff-8738-832733f895c3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:55.141007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-483a613b-a70b-42ff-8738-832733f895c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0ea84257d64526a3af4a04479d701a', 'request_id': 'req-483a613b-a70b-42ff-8738-832733f895c3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:55.147015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-483a613b-a70b-42ff-8738-832733f895c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0ea84257d64526a3af4a04479d701a', 'request_id': 'req-483a613b-a70b-42ff-8738-832733f895c3'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:55.160946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-483a613b-a70b-42ff-8738-832733f895c3 admin admin] The token cache is being invalidate because project ab0ea84257d64526a3af4a04479d701a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:35:55.161241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-483a613b-a70b-42ff-8738-832733f895c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:55.161890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-483a613b-a70b-42ff-8738-832733f895c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:55.163431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1154/2281] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:35:55 2022] DELETE /identity/v3/projects/ab0ea84257d64526a3af4a04479d701a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:55.168721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b6ac0-724d-485e-9ac5-568642f39c57 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:55.169900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b6ac0-724d-485e-9ac5-568642f39c57 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:55.170498 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b6ac0-724d-485e-9ac5-568642f39c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:55.191352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-851b6ac0-724d-485e-9ac5-568642f39c57 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:55.192616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-851b6ac0-724d-485e-9ac5-568642f39c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:55.258987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1128/2282] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:55.266826 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a28ac-8974-4f18-b87c-4b84491770ac None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:55.267146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a28ac-8974-4f18-b87c-4b84491770ac None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:55.267431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a28ac-8974-4f18-b87c-4b84491770ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:55.287666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7e6a28ac-8974-4f18-b87c-4b84491770ac None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:55.290175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7e6a28ac-8974-4f18-b87c-4b84491770ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:55.299055 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1155/2283] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:55.303320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b6ac0-724d-485e-9ac5-568642f39c57 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:55.313525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b6ac0-724d-485e-9ac5-568642f39c57 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:55.318338 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a01133-860d-4eaa-bc75-2beca8e0f47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:55.319012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a01133-860d-4eaa-bc75-2beca8e0f47e admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:55.319301 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a01133-860d-4eaa-bc75-2beca8e0f47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:55.319599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a01133-860d-4eaa-bc75-2beca8e0f47e admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:55.320450 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a01133-860d-4eaa-bc75-2beca8e0f47e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:35:55.320750 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a01133-860d-4eaa-bc75-2beca8e0f47e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:55.322544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a01133-860d-4eaa-bc75-2beca8e0f47e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:55.334009 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1129/2284] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:35:55.339145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a28ac-8974-4f18-b87c-4b84491770ac None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:55.348447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a28ac-8974-4f18-b87c-4b84491770ac None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:55.353663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efed1be-3e3c-472a-8809-b43c71cf8595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:55.354266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efed1be-3e3c-472a-8809-b43c71cf8595 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:55.354549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efed1be-3e3c-472a-8809-b43c71cf8595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:55.354825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efed1be-3e3c-472a-8809-b43c71cf8595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:55.355503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efed1be-3e3c-472a-8809-b43c71cf8595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:55.357490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efed1be-3e3c-472a-8809-b43c71cf8595 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:55.396814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1156/2285] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:35:55 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:55.398081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a01133-860d-4eaa-bc75-2beca8e0f47e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:55.409055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a01133-860d-4eaa-bc75-2beca8e0f47e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:55.478609 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85100ba1-40d2-41e7-9b0e-617b7e3c6f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:55.479236 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100ba1-40d2-41e7-9b0e-617b7e3c6f49 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:55.479594 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100ba1-40d2-41e7-9b0e-617b7e3c6f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:55.479823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85100ba1-40d2-41e7-9b0e-617b7e3c6f49 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:55.480573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85100ba1-40d2-41e7-9b0e-617b7e3c6f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:55.482515 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85100ba1-40d2-41e7-9b0e-617b7e3c6f49 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:55.507363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1130/2286] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:35:55 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:35:55.511578 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efed1be-3e3c-472a-8809-b43c71cf8595 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:55.522766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efed1be-3e3c-472a-8809-b43c71cf8595 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:55.528886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcdfdc-4bba-4945-9950-a86c7287ac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:55.529736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcdfdc-4bba-4945-9950-a86c7287ac9f admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:55.530198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcdfdc-4bba-4945-9950-a86c7287ac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:55.530540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcdfdc-4bba-4945-9950-a86c7287ac9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:55.531321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcdfdc-4bba-4945-9950-a86c7287ac9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:55.533568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcdfdc-4bba-4945-9950-a86c7287ac9f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:55.544198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1157/2287] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:55.548031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85100ba1-40d2-41e7-9b0e-617b7e3c6f49 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:55.558390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85100ba1-40d2-41e7-9b0e-617b7e3c6f49 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:55.563099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13304ad7-1052-42e5-a0d4-380e251976c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:55.563899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13304ad7-1052-42e5-a0d4-380e251976c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:55.564297 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13304ad7-1052-42e5-a0d4-380e251976c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:55.564583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13304ad7-1052-42e5-a0d4-380e251976c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:55.565270 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13304ad7-1052-42e5-a0d4-380e251976c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:55.566840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13304ad7-1052-42e5-a0d4-380e251976c8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:55.578993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1131/2288] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:35:55.583295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcdfdc-4bba-4945-9950-a86c7287ac9f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:55.594188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcdfdc-4bba-4945-9950-a86c7287ac9f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:55.598814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958e0ec-cfdc-4242-beac-daa423d4b994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:55.599474 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958e0ec-cfdc-4242-beac-daa423d4b994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:55.599761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958e0ec-cfdc-4242-beac-daa423d4b994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:55.600079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958e0ec-cfdc-4242-beac-daa423d4b994 admin admin] PATH_INFO: `/v3/projects/de676f85f3ad469da200b3d9e2173190/users/13705c0b6f9649a2ad0b475d82464298/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:55.619781 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958e0ec-cfdc-4242-beac-daa423d4b994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de676f85f3ad469da200b3d9e2173190, user_id=13705c0b6f9649a2ad0b475d82464298, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:55.622977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958e0ec-cfdc-4242-beac-daa423d4b994 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:55.640286 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1158/2289] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:35:55 2022] PUT /identity/v3/projects/de676f85f3ad469da200b3d9e2173190/users/13705c0b6f9649a2ad0b475d82464298/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:55.720538 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7d03a-a5d7-428b-a473-dbff40ff4248 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:55.720832 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7d03a-a5d7-428b-a473-dbff40ff4248 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:55.721208 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7d03a-a5d7-428b-a473-dbff40ff4248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:55.770378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1eb7d03a-a5d7-428b-a473-dbff40ff4248 None None] MFA Rules not processed for user `13705c0b6f9649a2ad0b475d82464298`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:55.771938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1eb7d03a-a5d7-428b-a473-dbff40ff4248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:55.810107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:55.849889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1132/2290] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:35:55.862568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958e0ec-cfdc-4242-beac-daa423d4b994 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:55.864305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4958e0ec-cfdc-4242-beac-daa423d4b994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:55.922796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958e0ec-cfdc-4242-beac-daa423d4b994 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:55.926463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1205a7-0db2-4fee-a44f-548a8f61a31e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:55.927084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1205a7-0db2-4fee-a44f-548a8f61a31e service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:55.927369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1205a7-0db2-4fee-a44f-548a8f61a31e service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:55.927761 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1205a7-0db2-4fee-a44f-548a8f61a31e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:55.936632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1205a7-0db2-4fee-a44f-548a8f61a31e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:55.938056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1205a7-0db2-4fee-a44f-548a8f61a31e service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:55.947037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1159/2291] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:35:59.422952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7d03a-a5d7-428b-a473-dbff40ff4248 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:59.424357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1eb7d03a-a5d7-428b-a473-dbff40ff4248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:59.490033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7d03a-a5d7-428b-a473-dbff40ff4248 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:59.495640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:59.496431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:59.496712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:59.497082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] PATH_INFO: `/v3/users/4c8741e5e954446fb9cabbdd042e427c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:59.498321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8741e5e954446fb9cabbdd042e427c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:59.500330 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:59.547308 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8741e5e954446fb9cabbdd042e427c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:59.554095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8741e5e954446fb9cabbdd042e427c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:59.562000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8741e5e954446fb9cabbdd042e427c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:59.562804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8741e5e954446fb9cabbdd042e427c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:59.563671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8741e5e954446fb9cabbdd042e427c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:35:59.582311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1133/2292] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:35:59 2022] DELETE /identity/v3/users/4c8741e5e954446fb9cabbdd042e427c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:35:59.587637 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ef7b2-73ee-4964-8455-5b2c9ea4c61e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:59.588180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ef7b2-73ee-4964-8455-5b2c9ea4c61e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:59.588321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ef7b2-73ee-4964-8455-5b2c9ea4c61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:59.601585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:59.608970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-937ef7b2-73ee-4964-8455-5b2c9ea4c61e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:35:59.611042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-937ef7b2-73ee-4964-8455-5b2c9ea4c61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:59.672396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1160/2293] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:35:59.682938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:35:59.684383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:35:59.743409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa243ac-9bef-45d5-a0fd-c7e314a28057 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:35:59.747137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd61aad-c05e-46e0-8b54-ab8634360a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:35:59.747772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61aad-c05e-46e0-8b54-ab8634360a6d service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:35:59.748094 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61aad-c05e-46e0-8b54-ab8634360a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:35:59.748375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61aad-c05e-46e0-8b54-ab8634360a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:35:59.754812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:35:59.759677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd61aad-c05e-46e0-8b54-ab8634360a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:35:59.761250 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd61aad-c05e-46e0-8b54-ab8634360a6d service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:35:59.774034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1134/2294] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:00.107130 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ef7b2-73ee-4964-8455-5b2c9ea4c61e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:00.109131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-937ef7b2-73ee-4964-8455-5b2c9ea4c61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:00.131778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ef7b2-73ee-4964-8455-5b2c9ea4c61e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:00.154223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:00.155686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:00.156590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:00.157354 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] PATH_INFO: `/v3/projects/072117b60f944723afcf7c807c0b14d3` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:00.159699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=072117b60f944723afcf7c807c0b14d3)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:00.166020 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:00.234115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072117b60f944723afcf7c807c0b14d3', 'request_id': 'req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:00.240680 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072117b60f944723afcf7c807c0b14d3', 'request_id': 'req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:00.247572 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072117b60f944723afcf7c807c0b14d3', 'request_id': 'req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:00.269347 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] The token cache is being invalidate because project 072117b60f944723afcf7c807c0b14d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:36:00.269657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:00.270360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:00.272181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1161/2295] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:36:00 2022] DELETE /identity/v3/projects/072117b60f944723afcf7c807c0b14d3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:00.276063 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd61aad-c05e-46e0-8b54-ab8634360a6d service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:00.286856 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd61aad-c05e-46e0-8b54-ab8634360a6d service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:00.370407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d17a3d-1502-4562-b851-706c0bb27c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:00.371075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d17a3d-1502-4562-b851-706c0bb27c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:00.371606 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d17a3d-1502-4562-b851-706c0bb27c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:00.371919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d17a3d-1502-4562-b851-706c0bb27c19 admin admin] PATH_INFO: `/v3/users/966d5874d93e4f80a656aefcbe25f913` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:00.373129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d17a3d-1502-4562-b851-706c0bb27c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966d5874d93e4f80a656aefcbe25f913)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:00.375446 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d17a3d-1502-4562-b851-706c0bb27c19 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:00.440408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e5d17a3d-1502-4562-b851-706c0bb27c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966d5874d93e4f80a656aefcbe25f913'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:00.452954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e5d17a3d-1502-4562-b851-706c0bb27c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966d5874d93e4f80a656aefcbe25f913'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:00.464070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e5d17a3d-1502-4562-b851-706c0bb27c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966d5874d93e4f80a656aefcbe25f913'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:00.464785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e5d17a3d-1502-4562-b851-706c0bb27c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966d5874d93e4f80a656aefcbe25f913'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:00.466223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-e5d17a3d-1502-4562-b851-706c0bb27c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966d5874d93e4f80a656aefcbe25f913'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:00.488201 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1135/2296] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:36:00 2022] DELETE /identity/v3/users/966d5874d93e4f80a656aefcbe25f913 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:00.899519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:00.905280 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:00.928788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822aea1-fb8c-4c81-a5e2-1be7d02ff685 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:01.054457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816329dd-4f78-499f-bad5-22972c410e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:01.056435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816329dd-4f78-499f-bad5-22972c410e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:01.056935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816329dd-4f78-499f-bad5-22972c410e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:01.057442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816329dd-4f78-499f-bad5-22972c410e82 admin admin] PATH_INFO: `/v3/projects/f081eddbb5624e3a8f595d3ad48c1f98` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:01.059392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816329dd-4f78-499f-bad5-22972c410e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f081eddbb5624e3a8f595d3ad48c1f98)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:01.063080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816329dd-4f78-499f-bad5-22972c410e82 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:01.122989 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:01.143525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-816329dd-4f78-499f-bad5-22972c410e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f081eddbb5624e3a8f595d3ad48c1f98', 'request_id': 'req-816329dd-4f78-499f-bad5-22972c410e82'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:01.152263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-816329dd-4f78-499f-bad5-22972c410e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f081eddbb5624e3a8f595d3ad48c1f98', 'request_id': 'req-816329dd-4f78-499f-bad5-22972c410e82'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:01.159022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-816329dd-4f78-499f-bad5-22972c410e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f081eddbb5624e3a8f595d3ad48c1f98', 'request_id': 'req-816329dd-4f78-499f-bad5-22972c410e82'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:01.172801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-816329dd-4f78-499f-bad5-22972c410e82 admin admin] The token cache is being invalidate because project f081eddbb5624e3a8f595d3ad48c1f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:36:01.173103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-816329dd-4f78-499f-bad5-22972c410e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:01.173812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-816329dd-4f78-499f-bad5-22972c410e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:01.175937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1162/2297] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:36:00 2022] DELETE /identity/v3/projects/f081eddbb5624e3a8f595d3ad48c1f98 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:36:01.182121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec2c1b-76f2-4370-9b48-19c3ce4172f5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:01.182404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec2c1b-76f2-4370-9b48-19c3ce4172f5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:01.182662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec2c1b-76f2-4370-9b48-19c3ce4172f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:01.202947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-66ec2c1b-76f2-4370-9b48-19c3ce4172f5 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:01.204126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-66ec2c1b-76f2-4370-9b48-19c3ce4172f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:01.270179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1136/2298] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:36:01.279501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e365c-b913-48b1-a5f6-1b79c1327c1b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:01.279800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e365c-b913-48b1-a5f6-1b79c1327c1b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:01.280116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e365c-b913-48b1-a5f6-1b79c1327c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:01.299799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8b7e365c-b913-48b1-a5f6-1b79c1327c1b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:01.301038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8b7e365c-b913-48b1-a5f6-1b79c1327c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:01.309673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1163/2299] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:01.314133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec2c1b-76f2-4370-9b48-19c3ce4172f5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:01.324510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec2c1b-76f2-4370-9b48-19c3ce4172f5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:01.329457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe177df-59c8-49e5-8755-2d24e7c65e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:01.330115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe177df-59c8-49e5-8755-2d24e7c65e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:01.330458 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe177df-59c8-49e5-8755-2d24e7c65e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:01.330733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe177df-59c8-49e5-8755-2d24e7c65e77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:01.331431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe177df-59c8-49e5-8755-2d24e7c65e77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:36:01.331733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe177df-59c8-49e5-8755-2d24e7c65e77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:01.333352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe177df-59c8-49e5-8755-2d24e7c65e77 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:01.342929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:01.350688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1137/2300] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:36:01.352035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e365c-b913-48b1-a5f6-1b79c1327c1b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:01.361686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e365c-b913-48b1-a5f6-1b79c1327c1b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:01.366662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe055f-687f-4af8-91ba-8af958794a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:01.367929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe055f-687f-4af8-91ba-8af958794a7c admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:01.368221 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe055f-687f-4af8-91ba-8af958794a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:01.368502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe055f-687f-4af8-91ba-8af958794a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:01.369177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe055f-687f-4af8-91ba-8af958794a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:01.372375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe055f-687f-4af8-91ba-8af958794a7c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:01.402857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1164/2301] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:36:01 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:36:01.404241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe177df-59c8-49e5-8755-2d24e7c65e77 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:01.415029 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe177df-59c8-49e5-8755-2d24e7c65e77 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:01.474793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ec91a-65e9-48e3-8845-ceca06f8112f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:01.475413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ec91a-65e9-48e3-8845-ceca06f8112f admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:01.475696 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ec91a-65e9-48e3-8845-ceca06f8112f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:01.476000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ec91a-65e9-48e3-8845-ceca06f8112f admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:01.477430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ec91a-65e9-48e3-8845-ceca06f8112f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:01.479388 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ec91a-65e9-48e3-8845-ceca06f8112f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:01.503893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1138/2302] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:36:01 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:36:01.508558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe055f-687f-4af8-91ba-8af958794a7c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:01.519152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe055f-687f-4af8-91ba-8af958794a7c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:01.524494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e802d-f417-4764-a71e-2bb4dd04c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:01.525105 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e802d-f417-4764-a71e-2bb4dd04c722 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:01.525393 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e802d-f417-4764-a71e-2bb4dd04c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:01.525674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e802d-f417-4764-a71e-2bb4dd04c722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:01.526367 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e802d-f417-4764-a71e-2bb4dd04c722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:01.528064 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e802d-f417-4764-a71e-2bb4dd04c722 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:01.538177 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1165/2303] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:36:01.542086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ec91a-65e9-48e3-8845-ceca06f8112f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:01.552623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ec91a-65e9-48e3-8845-ceca06f8112f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:01.557253 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c3496-1578-443d-b425-1f1db69bc228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:01.557872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c3496-1578-443d-b425-1f1db69bc228 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:01.558373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c3496-1578-443d-b425-1f1db69bc228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:01.558484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c3496-1578-443d-b425-1f1db69bc228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:01.559113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c3496-1578-443d-b425-1f1db69bc228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:01.560778 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c3496-1578-443d-b425-1f1db69bc228 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:01.578161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1139/2304] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:36:01.579312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e802d-f417-4764-a71e-2bb4dd04c722 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:01.590237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e802d-f417-4764-a71e-2bb4dd04c722 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:01.594932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efb37c-f127-42a6-8cfa-a3ceeceeb942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:01.595595 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb37c-f127-42a6-8cfa-a3ceeceeb942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:01.595915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb37c-f127-42a6-8cfa-a3ceeceeb942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:01.596231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb37c-f127-42a6-8cfa-a3ceeceeb942 admin admin] PATH_INFO: `/v3/projects/3ca35a99cd9f4a578dbb3ce8ca41e46f/users/24427d4aa4bd497c9b43204aa8110c08/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:01.610947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efb37c-f127-42a6-8cfa-a3ceeceeb942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca35a99cd9f4a578dbb3ce8ca41e46f, user_id=24427d4aa4bd497c9b43204aa8110c08, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:01.613908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efb37c-f127-42a6-8cfa-a3ceeceeb942 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:01.629121 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1166/2305] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:36:01 2022] PUT /identity/v3/projects/3ca35a99cd9f4a578dbb3ce8ca41e46f/users/24427d4aa4bd497c9b43204aa8110c08/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:36:01.641497 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f3897-1848-4e35-8ebf-7baec81b0aea None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:01.641809 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f3897-1848-4e35-8ebf-7baec81b0aea None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:01.642087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f3897-1848-4e35-8ebf-7baec81b0aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:01.673878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-662f3897-1848-4e35-8ebf-7baec81b0aea None None] MFA Rules not processed for user `24427d4aa4bd497c9b43204aa8110c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:01.675085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-662f3897-1848-4e35-8ebf-7baec81b0aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:01.747229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1140/2306] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:01.759407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efb37c-f127-42a6-8cfa-a3ceeceeb942 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:01.761855 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f4efb37c-f127-42a6-8cfa-a3ceeceeb942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:01.819995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efb37c-f127-42a6-8cfa-a3ceeceeb942 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:01.823896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c46db4-ee4c-4721-96cf-6e8431cb2c0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:01.824510 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46db4-ee4c-4721-96cf-6e8431cb2c0e service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:01.824805 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46db4-ee4c-4721-96cf-6e8431cb2c0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:01.825068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46db4-ee4c-4721-96cf-6e8431cb2c0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:01.833616 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c46db4-ee4c-4721-96cf-6e8431cb2c0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:01.835047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c46db4-ee4c-4721-96cf-6e8431cb2c0e service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:01.844882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1167/2307] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:01.865635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f3897-1848-4e35-8ebf-7baec81b0aea None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:01.934592 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f3897-1848-4e35-8ebf-7baec81b0aea None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:01.939095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:01.939732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:01.940079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:01.940353 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] PATH_INFO: `/v3/users/24427d4aa4bd497c9b43204aa8110c08` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:01.941634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24427d4aa4bd497c9b43204aa8110c08)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:01.943520 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:01.956309 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:01.999200 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24427d4aa4bd497c9b43204aa8110c08'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:02.007179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24427d4aa4bd497c9b43204aa8110c08'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:02.014472 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24427d4aa4bd497c9b43204aa8110c08'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:02.015142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24427d4aa4bd497c9b43204aa8110c08'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:02.015773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24427d4aa4bd497c9b43204aa8110c08'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:02.033749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1141/2308] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:36:01 2022] DELETE /identity/v3/users/24427d4aa4bd497c9b43204aa8110c08 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:02.038518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c16c71-e582-4fd2-9d0a-031e0cf9b0d5 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:02.039466 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c16c71-e582-4fd2-9d0a-031e0cf9b0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:02.039927 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c16c71-e582-4fd2-9d0a-031e0cf9b0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:02.060173 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e6c16c71-e582-4fd2-9d0a-031e0cf9b0d5 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:02.061645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e6c16c71-e582-4fd2-9d0a-031e0cf9b0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:02.130693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:02.158310 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1168/2309] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:36:02.168821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:02.170700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:02.256599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf37c7-6e21-4ae1-9db8-3ff35a50bde2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:02.260836 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a9c3b-e861-40e1-9453-f9a177efd066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:02.261604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a9c3b-e861-40e1-9453-f9a177efd066 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:02.261959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a9c3b-e861-40e1-9453-f9a177efd066 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:02.262304 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a9c3b-e861-40e1-9453-f9a177efd066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:02.288765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a9c3b-e861-40e1-9453-f9a177efd066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:02.293468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a9c3b-e861-40e1-9453-f9a177efd066 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:02.316154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1142/2310] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:02.678431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c16c71-e582-4fd2-9d0a-031e0cf9b0d5 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:02.685306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e6c16c71-e582-4fd2-9d0a-031e0cf9b0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:02.714154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c16c71-e582-4fd2-9d0a-031e0cf9b0d5 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:02.721065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5570bf4-e7bb-4c5b-a08e-98225d516147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:02.721965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5570bf4-e7bb-4c5b-a08e-98225d516147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:02.722257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5570bf4-e7bb-4c5b-a08e-98225d516147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:02.722542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5570bf4-e7bb-4c5b-a08e-98225d516147 admin admin] PATH_INFO: `/v3/projects/3ca35a99cd9f4a578dbb3ce8ca41e46f` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:02.723757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5570bf4-e7bb-4c5b-a08e-98225d516147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca35a99cd9f4a578dbb3ce8ca41e46f)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:02.725741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5570bf4-e7bb-4c5b-a08e-98225d516147 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:02.793386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a5570bf4-e7bb-4c5b-a08e-98225d516147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca35a99cd9f4a578dbb3ce8ca41e46f', 'request_id': 'req-a5570bf4-e7bb-4c5b-a08e-98225d516147'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:02.803490 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a5570bf4-e7bb-4c5b-a08e-98225d516147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca35a99cd9f4a578dbb3ce8ca41e46f', 'request_id': 'req-a5570bf4-e7bb-4c5b-a08e-98225d516147'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:02.812362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a5570bf4-e7bb-4c5b-a08e-98225d516147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca35a99cd9f4a578dbb3ce8ca41e46f', 'request_id': 'req-a5570bf4-e7bb-4c5b-a08e-98225d516147'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:02.828300 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a5570bf4-e7bb-4c5b-a08e-98225d516147 admin admin] The token cache is being invalidate because project 3ca35a99cd9f4a578dbb3ce8ca41e46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:36:02.828596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a5570bf4-e7bb-4c5b-a08e-98225d516147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:02.829243 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a5570bf4-e7bb-4c5b-a08e-98225d516147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:02.830824 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1169/2311] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:36:02 2022] DELETE /identity/v3/projects/3ca35a99cd9f4a578dbb3ce8ca41e46f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:02.837477 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b51af-da81-4b0f-ba70-c498575b4ab6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:02.838012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b51af-da81-4b0f-ba70-c498575b4ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:02.838109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b51af-da81-4b0f-ba70-c498575b4ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:02.859300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-472b51af-da81-4b0f-ba70-c498575b4ab6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:02.860572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-472b51af-da81-4b0f-ba70-c498575b4ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:02.947248 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1143/2312] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:36:02.957047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3b105-8ae8-4ea6-a577-916c75525777 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:02.957312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3b105-8ae8-4ea6-a577-916c75525777 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:02.957616 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3b105-8ae8-4ea6-a577-916c75525777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:02.991695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6af3b105-8ae8-4ea6-a577-916c75525777 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:02.993980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6af3b105-8ae8-4ea6-a577-916c75525777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:03.016541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1170/2313] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:03.018023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b51af-da81-4b0f-ba70-c498575b4ab6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:03.034804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b51af-da81-4b0f-ba70-c498575b4ab6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:03.040652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8110-6a1a-4f3e-aa3b-eaec3cddde08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:03.041890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8110-6a1a-4f3e-aa3b-eaec3cddde08 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:03.042184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8110-6a1a-4f3e-aa3b-eaec3cddde08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:03.042469 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8110-6a1a-4f3e-aa3b-eaec3cddde08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:03.044007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a8110-6a1a-4f3e-aa3b-eaec3cddde08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:36:03.044325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a8110-6a1a-4f3e-aa3b-eaec3cddde08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:03.046556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a8110-6a1a-4f3e-aa3b-eaec3cddde08 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:03.066546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1144/2314] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:36:03.070046 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3b105-8ae8-4ea6-a577-916c75525777 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:03.090357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3b105-8ae8-4ea6-a577-916c75525777 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:03.102378 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5eaf78-610b-44e0-a469-868d512dec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:03.103095 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eaf78-610b-44e0-a469-868d512dec96 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:03.103387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eaf78-610b-44e0-a469-868d512dec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:03.103918 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eaf78-610b-44e0-a469-868d512dec96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:03.104733 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5eaf78-610b-44e0-a469-868d512dec96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:03.107163 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5eaf78-610b-44e0-a469-868d512dec96 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:03.153798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1171/2315] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:36:03 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:36:03.155072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8110-6a1a-4f3e-aa3b-eaec3cddde08 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:03.179079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8110-6a1a-4f3e-aa3b-eaec3cddde08 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:03.234152 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:03.300299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecf796-dfbf-4622-859e-31d4162acab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:03.301116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecf796-dfbf-4622-859e-31d4162acab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:03.301263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecf796-dfbf-4622-859e-31d4162acab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:03.301593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecf796-dfbf-4622-859e-31d4162acab7 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:03.302217 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecf796-dfbf-4622-859e-31d4162acab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:03.305031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecf796-dfbf-4622-859e-31d4162acab7 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:03.333606 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1145/2316] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:36:03 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:36:03.337496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5eaf78-610b-44e0-a469-868d512dec96 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:03.356264 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5eaf78-610b-44e0-a469-868d512dec96 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:03.364363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dfda1-27d0-4195-86f7-ee0032cce7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:03.366707 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dfda1-27d0-4195-86f7-ee0032cce7fb admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:03.367663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dfda1-27d0-4195-86f7-ee0032cce7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:03.368525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dfda1-27d0-4195-86f7-ee0032cce7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:03.370192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dfda1-27d0-4195-86f7-ee0032cce7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:03.374238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dfda1-27d0-4195-86f7-ee0032cce7fb admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:03.396666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1172/2317] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:36:03.398948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecf796-dfbf-4622-859e-31d4162acab7 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:03.424830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecf796-dfbf-4622-859e-31d4162acab7 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:03.430504 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cc4dc-57f9-497f-a1d4-de6b20878e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:03.431336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cc4dc-57f9-497f-a1d4-de6b20878e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:03.431676 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cc4dc-57f9-497f-a1d4-de6b20878e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:03.432042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cc4dc-57f9-497f-a1d4-de6b20878e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:03.432853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cc4dc-57f9-497f-a1d4-de6b20878e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:03.434528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cc4dc-57f9-497f-a1d4-de6b20878e6c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:03.453443 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1146/2318] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:36:03.458461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dfda1-27d0-4195-86f7-ee0032cce7fb admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:03.469724 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dfda1-27d0-4195-86f7-ee0032cce7fb admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:03.474663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4606237-c7d6-4fee-8443-27fd6ce6bb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:03.475346 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4606237-c7d6-4fee-8443-27fd6ce6bb7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:03.475633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4606237-c7d6-4fee-8443-27fd6ce6bb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:03.475939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4606237-c7d6-4fee-8443-27fd6ce6bb7b admin admin] PATH_INFO: `/v3/projects/07ed9ae90e304c5ebe3263f63a0aaf88/users/1f3d69264c304af9b0eef3a072376523/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:03.500813 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4606237-c7d6-4fee-8443-27fd6ce6bb7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ed9ae90e304c5ebe3263f63a0aaf88, user_id=1f3d69264c304af9b0eef3a072376523, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:03.504044 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4606237-c7d6-4fee-8443-27fd6ce6bb7b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:03.525315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1173/2319] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:36:03 2022] PUT /identity/v3/projects/07ed9ae90e304c5ebe3263f63a0aaf88/users/1f3d69264c304af9b0eef3a072376523/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:03.535631 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcf5c9-4bf8-4c04-913d-bbb3c9bf773c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:03.535996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcf5c9-4bf8-4c04-913d-bbb3c9bf773c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:03.536218 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcf5c9-4bf8-4c04-913d-bbb3c9bf773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:03.577283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c0dcf5c9-4bf8-4c04-913d-bbb3c9bf773c None None] MFA Rules not processed for user `1f3d69264c304af9b0eef3a072376523`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:03.578596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c0dcf5c9-4bf8-4c04-913d-bbb3c9bf773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:03.694944 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1147/2320] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:03.707722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4606237-c7d6-4fee-8443-27fd6ce6bb7b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:03.722952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d4606237-c7d6-4fee-8443-27fd6ce6bb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:03.820877 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4606237-c7d6-4fee-8443-27fd6ce6bb7b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:03.824995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fefd82-1af9-40fc-8ba9-f36108dc7278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:03.825567 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fefd82-1af9-40fc-8ba9-f36108dc7278 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:03.825843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fefd82-1af9-40fc-8ba9-f36108dc7278 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:03.826136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fefd82-1af9-40fc-8ba9-f36108dc7278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:03.840223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fefd82-1af9-40fc-8ba9-f36108dc7278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:03.841683 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fefd82-1af9-40fc-8ba9-f36108dc7278 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:03.850996 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1174/2321] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:04.922211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b64489-67cd-4576-a836-907e85d44ba4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:04.922682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b64489-67cd-4576-a836-907e85d44ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:04.922931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b64489-67cd-4576-a836-907e85d44ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:04.943726 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-94b64489-67cd-4576-a836-907e85d44ba4 None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:04.945075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-94b64489-67cd-4576-a836-907e85d44ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:05.008364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1148/2322] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:36:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:05.050351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fefd82-1af9-40fc-8ba9-f36108dc7278 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:05.051792 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-63fefd82-1af9-40fc-8ba9-f36108dc7278 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:05.079386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:05.127248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fefd82-1af9-40fc-8ba9-f36108dc7278 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:05.132234 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f264c6-14c5-4242-8f6f-95faf3bfa6a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:05.133514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f264c6-14c5-4242-8f6f-95faf3bfa6a9 service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:05.133876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f264c6-14c5-4242-8f6f-95faf3bfa6a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:05.134074 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f264c6-14c5-4242-8f6f-95faf3bfa6a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:05.142134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f264c6-14c5-4242-8f6f-95faf3bfa6a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:05.143758 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f264c6-14c5-4242-8f6f-95faf3bfa6a9 service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:05.151916 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1175/2323] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:36:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 16:36:05.762353 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085458af-e9d6-4a94-bde2-d4d397b3b0af None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:05.762646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085458af-e9d6-4a94-bde2-d4d397b3b0af None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:05.762957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085458af-e9d6-4a94-bde2-d4d397b3b0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:05.781891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-085458af-e9d6-4a94-bde2-d4d397b3b0af None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:05.783095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-085458af-e9d6-4a94-bde2-d4d397b3b0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:05.790977 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1149/2324] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 27 16:36:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:05.803983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f264c6-14c5-4242-8f6f-95faf3bfa6a9 service swift] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:05.815062 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f264c6-14c5-4242-8f6f-95faf3bfa6a9 service swift] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:05.820109 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036f99c-f889-460b-85a9-a59af124bf88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:05.820903 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036f99c-f889-460b-85a9-a59af124bf88 service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:05.821199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036f99c-f889-460b-85a9-a59af124bf88 service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:05.821480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036f99c-f889-460b-85a9-a59af124bf88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:05.829496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036f99c-f889-460b-85a9-a59af124bf88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:05.831063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036f99c-f889-460b-85a9-a59af124bf88 service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:05.840811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1176/2325] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:36:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 16:36:06.073011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd950d9-aba0-4bea-9cfb-6394b35b1a1c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:06.073510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd950d9-aba0-4bea-9cfb-6394b35b1a1c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:06.073700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd950d9-aba0-4bea-9cfb-6394b35b1a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:06.093397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4fd950d9-aba0-4bea-9cfb-6394b35b1a1c None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:06.094693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4fd950d9-aba0-4bea-9cfb-6394b35b1a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:06.101933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1150/2326] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:36:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:06.113983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036f99c-f889-460b-85a9-a59af124bf88 service swift] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:06.124879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036f99c-f889-460b-85a9-a59af124bf88 service swift] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:06.130061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1e0af-e171-4145-8883-c713202533b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:06.130775 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1e0af-e171-4145-8883-c713202533b5 service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:06.131131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1e0af-e171-4145-8883-c713202533b5 service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:06.131478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1e0af-e171-4145-8883-c713202533b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:06.140614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1e0af-e171-4145-8883-c713202533b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:06.142283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1e0af-e171-4145-8883-c713202533b5 service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:06.151116 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1177/2327] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:36:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 16:36:06.511567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a185a-45b3-463b-a567-d0bc07e19c95 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:06.511876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a185a-45b3-463b-a567-d0bc07e19c95 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:06.512169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a185a-45b3-463b-a567-d0bc07e19c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:06.531520 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-450a185a-45b3-463b-a567-d0bc07e19c95 None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:06.532764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-450a185a-45b3-463b-a567-d0bc07e19c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:06.544028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1151/2328] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 27 16:36:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:06.557929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1e0af-e171-4145-8883-c713202533b5 service swift] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:06.562805 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a185a-45b3-463b-a567-d0bc07e19c95 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:06.564563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-450a185a-45b3-463b-a567-d0bc07e19c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:06.570126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1e0af-e171-4145-8883-c713202533b5 service swift] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:06.577876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6427860-e3c6-427f-a483-21e3553f9287 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:06.578581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427860-e3c6-427f-a483-21e3553f9287 service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:06.578875 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427860-e3c6-427f-a483-21e3553f9287 service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:06.579288 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427860-e3c6-427f-a483-21e3553f9287 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:06.583824 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:06.591139 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6427860-e3c6-427f-a483-21e3553f9287 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:06.592795 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6427860-e3c6-427f-a483-21e3553f9287 service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:06.602464 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1178/2329] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:36:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 16:36:06.659849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a185a-45b3-463b-a567-d0bc07e19c95 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:06.667612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:06.668426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:06.668718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:06.668995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] PATH_INFO: `/v3/users/13705c0b6f9649a2ad0b475d82464298` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:06.670282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13705c0b6f9649a2ad0b475d82464298)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:06.674215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:06.730518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13705c0b6f9649a2ad0b475d82464298'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:06.738115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13705c0b6f9649a2ad0b475d82464298'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:06.751173 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13705c0b6f9649a2ad0b475d82464298'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:06.751814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13705c0b6f9649a2ad0b475d82464298'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:06.752632 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13705c0b6f9649a2ad0b475d82464298'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:06.771161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1152/2330] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:36:06 2022] DELETE /identity/v3/users/13705c0b6f9649a2ad0b475d82464298 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:36:06.776008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835c592-da1f-4bb2-8cd1-702e636810dc None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:06.776343 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835c592-da1f-4bb2-8cd1-702e636810dc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:06.776628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835c592-da1f-4bb2-8cd1-702e636810dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:06.798851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0835c592-da1f-4bb2-8cd1-702e636810dc None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:06.800326 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0835c592-da1f-4bb2-8cd1-702e636810dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:06.868863 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1179/2331] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:06.878776 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:06.884294 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:06.957965 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193607f5-f248-464c-a56b-dd7512ff284b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:06.963095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dd403-17b2-4a3f-be20-a47d74568ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:06.963738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dd403-17b2-4a3f-be20-a47d74568ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:06.964135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dd403-17b2-4a3f-be20-a47d74568ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:06.964423 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dd403-17b2-4a3f-be20-a47d74568ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:06.974564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dd403-17b2-4a3f-be20-a47d74568ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:06.976063 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dd403-17b2-4a3f-be20-a47d74568ce9 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:06.986503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1153/2332] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:07.303453 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835c592-da1f-4bb2-8cd1-702e636810dc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:07.305272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0835c592-da1f-4bb2-8cd1-702e636810dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:07.318878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835c592-da1f-4bb2-8cd1-702e636810dc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:07.324228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:07.324968 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:07.325329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:07.325697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8 admin admin] PATH_INFO: `/v3/projects/de676f85f3ad469da200b3d9e2173190` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:07.327120 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de676f85f3ad469da200b3d9e2173190)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:07.332598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:07.388337 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de676f85f3ad469da200b3d9e2173190', 'request_id': 'req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:07.394650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de676f85f3ad469da200b3d9e2173190', 'request_id': 'req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:07.403168 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de676f85f3ad469da200b3d9e2173190', 'request_id': 'req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:07.407171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:07.422409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8 admin admin] The token cache is being invalidate because project de676f85f3ad469da200b3d9e2173190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:36:07.423220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:07.424556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d2cdb4b9-7fff-4aa1-b899-8f99a4c9d4b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:07.426904 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1180/2333] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:36:07 2022] DELETE /identity/v3/projects/de676f85f3ad469da200b3d9e2173190 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:08.952855 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dd403-17b2-4a3f-be20-a47d74568ce9 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:08.954288 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-272dd403-17b2-4a3f-be20-a47d74568ce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:08.967101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dd403-17b2-4a3f-be20-a47d74568ce9 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:08.998382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:09.027015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:09.027659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:09.027976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:09.028258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] PATH_INFO: `/v3/users/14f5dc7d0dfb4aec96cc90ae8fa2d496` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:09.029423 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f5dc7d0dfb4aec96cc90ae8fa2d496)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:09.031352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:09.079129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f5dc7d0dfb4aec96cc90ae8fa2d496'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:09.087341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f5dc7d0dfb4aec96cc90ae8fa2d496'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:09.096219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f5dc7d0dfb4aec96cc90ae8fa2d496'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:09.096858 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f5dc7d0dfb4aec96cc90ae8fa2d496'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:09.097473 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f5dc7d0dfb4aec96cc90ae8fa2d496'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:09.115133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1154/2334] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:36:08 2022] DELETE /identity/v3/users/14f5dc7d0dfb4aec96cc90ae8fa2d496 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:09.119758 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef308e-9b48-4dac-a5d8-184d90e76d71 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:09.120240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef308e-9b48-4dac-a5d8-184d90e76d71 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:09.120367 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef308e-9b48-4dac-a5d8-184d90e76d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:09.139635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-53ef308e-9b48-4dac-a5d8-184d90e76d71 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:09.140878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-53ef308e-9b48-4dac-a5d8-184d90e76d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:09.200674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1181/2335] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:09.211003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:09.212450 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:09.271407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ac82c-8572-401b-a31e-938995904fea admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:09.275666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350fbf7-cf20-4156-94f6-ef633bac5089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:09.276350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350fbf7-cf20-4156-94f6-ef633bac5089 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:09.276631 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350fbf7-cf20-4156-94f6-ef633bac5089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:09.276936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350fbf7-cf20-4156-94f6-ef633bac5089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:09.287677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350fbf7-cf20-4156-94f6-ef633bac5089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:09.289661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350fbf7-cf20-4156-94f6-ef633bac5089 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:09.299292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1155/2336] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:09.479328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef308e-9b48-4dac-a5d8-184d90e76d71 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:09.481376 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-53ef308e-9b48-4dac-a5d8-184d90e76d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:09.496971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef308e-9b48-4dac-a5d8-184d90e76d71 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:09.503253 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:09.504331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:09.504743 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:09.504990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] PATH_INFO: `/v3/projects/452dfcdbc50f49beae6ec4522f36bfea` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:09.506830 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] RBAC: Authorizing `identity:delete_project(project_id=452dfcdbc50f49beae6ec4522f36bfea)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:09.509178 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:09.565864 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '452dfcdbc50f49beae6ec4522f36bfea', 'request_id': 'req-2882f391-5e10-4d80-8f07-92db21a2b98b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:09.574398 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '452dfcdbc50f49beae6ec4522f36bfea', 'request_id': 'req-2882f391-5e10-4d80-8f07-92db21a2b98b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:09.580890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '452dfcdbc50f49beae6ec4522f36bfea', 'request_id': 'req-2882f391-5e10-4d80-8f07-92db21a2b98b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:09.596470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] The token cache is being invalidate because project 452dfcdbc50f49beae6ec4522f36bfea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:36:09.596775 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:09.597419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:09.598954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1182/2337] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:36:09 2022] DELETE /identity/v3/projects/452dfcdbc50f49beae6ec4522f36bfea => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:13.929519 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053663c-57b5-4dec-98b0-0a51469cc19f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:13.930147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053663c-57b5-4dec-98b0-0a51469cc19f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:13.930147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053663c-57b5-4dec-98b0-0a51469cc19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:13.950375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-0053663c-57b5-4dec-98b0-0a51469cc19f None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:13.951614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0053663c-57b5-4dec-98b0-0a51469cc19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:13.999832 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:14.013264 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1156/2338] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Jul 27 16:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:36:14.040601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:14.042092 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:14.139818 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882f391-5e10-4d80-8f07-92db21a2b98b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:14.145651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe028726-ba54-423e-a8e5-a253d305f160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:14.146354 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe028726-ba54-423e-a8e5-a253d305f160 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:14.146803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe028726-ba54-423e-a8e5-a253d305f160 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:14.147097 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe028726-ba54-423e-a8e5-a253d305f160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:14.156748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe028726-ba54-423e-a8e5-a253d305f160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:14.158477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe028726-ba54-423e-a8e5-a253d305f160 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:14.168749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1183/2339] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:15.410258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff59d9e-ea22-4039-9170-268bf606953e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:15.410697 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff59d9e-ea22-4039-9170-268bf606953e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:15.411144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff59d9e-ea22-4039-9170-268bf606953e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:15.433173 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-eff59d9e-ea22-4039-9170-268bf606953e None None] MFA Rules not processed for user `bc75a052c6b14904a314cf8f7bd4bad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:15.434393 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-eff59d9e-ea22-4039-9170-268bf606953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:15.493302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1157/2340] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:16.766797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe028726-ba54-423e-a8e5-a253d305f160 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:16.768312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fe028726-ba54-423e-a8e5-a253d305f160 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:16.783350 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:16.787569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe028726-ba54-423e-a8e5-a253d305f160 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:16.803477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319ea27-5ece-43ad-87ff-ac254b337486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:16.806832 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ea27-5ece-43ad-87ff-ac254b337486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:16.807880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ea27-5ece-43ad-87ff-ac254b337486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:16.808102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ea27-5ece-43ad-87ff-ac254b337486 admin admin] PATH_INFO: `/v3/users/1f3d69264c304af9b0eef3a072376523` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:16.811998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319ea27-5ece-43ad-87ff-ac254b337486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3d69264c304af9b0eef3a072376523)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:16.816068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319ea27-5ece-43ad-87ff-ac254b337486 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:16.913238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c319ea27-5ece-43ad-87ff-ac254b337486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3d69264c304af9b0eef3a072376523'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:16.923447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c319ea27-5ece-43ad-87ff-ac254b337486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3d69264c304af9b0eef3a072376523'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:16.931755 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c319ea27-5ece-43ad-87ff-ac254b337486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3d69264c304af9b0eef3a072376523'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:16.936309 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c319ea27-5ece-43ad-87ff-ac254b337486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3d69264c304af9b0eef3a072376523'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:16.937120 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c319ea27-5ece-43ad-87ff-ac254b337486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3d69264c304af9b0eef3a072376523'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:16.971646 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1184/2341] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:36:16 2022] DELETE /identity/v3/users/1f3d69264c304af9b0eef3a072376523 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:16.973834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4a1c-a7dd-4e13-8cf6-b89535fa6b77 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:16.974357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4a1c-a7dd-4e13-8cf6-b89535fa6b77 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:16.974467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4a1c-a7dd-4e13-8cf6-b89535fa6b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:17.025261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-8c9d4a1c-a7dd-4e13-8cf6-b89535fa6b77 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:17.027281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8c9d4a1c-a7dd-4e13-8cf6-b89535fa6b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:17.059484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c364b-9a0b-426c-89f3-4b179db23013 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:17.059777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c364b-9a0b-426c-89f3-4b179db23013 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:17.060077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c364b-9a0b-426c-89f3-4b179db23013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:17.090010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3b0c364b-9a0b-426c-89f3-4b179db23013 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:17.092050 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3b0c364b-9a0b-426c-89f3-4b179db23013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:17.121952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1158/2342] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:17.134409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d4a1c-a7dd-4e13-8cf6-b89535fa6b77 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:17.136189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8c9d4a1c-a7dd-4e13-8cf6-b89535fa6b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:17.177316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1185/2343] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Jul 27 16:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:36:17.204431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c364b-9a0b-426c-89f3-4b179db23013 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:17.205860 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3b0c364b-9a0b-426c-89f3-4b179db23013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:17.271631 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d4a1c-a7dd-4e13-8cf6-b89535fa6b77 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:17.276699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b2eaf-ece7-4996-a4a1-d12c1f357463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:17.277455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b2eaf-ece7-4996-a4a1-d12c1f357463 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:17.277736 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b2eaf-ece7-4996-a4a1-d12c1f357463 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:17.278043 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b2eaf-ece7-4996-a4a1-d12c1f357463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:17.291319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b2eaf-ece7-4996-a4a1-d12c1f357463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:17.292888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b2eaf-ece7-4996-a4a1-d12c1f357463 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:17.298014 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c364b-9a0b-426c-89f3-4b179db23013 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:17.305159 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1159/2344] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:36:17.307323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86821fb-2413-4338-9565-aab7c28cbbdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:17.308178 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86821fb-2413-4338-9565-aab7c28cbbdd service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:17.308462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86821fb-2413-4338-9565-aab7c28cbbdd service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:17.309368 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86821fb-2413-4338-9565-aab7c28cbbdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:17.318521 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86821fb-2413-4338-9565-aab7c28cbbdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:17.321101 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86821fb-2413-4338-9565-aab7c28cbbdd service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:17.332136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1186/2345] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:17.730506 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b2eaf-ece7-4996-a4a1-d12c1f357463 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:17.731774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-343b2eaf-ece7-4996-a4a1-d12c1f357463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:17.745766 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b2eaf-ece7-4996-a4a1-d12c1f357463 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:17.750743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aa7fa-0f80-419a-b7be-1815218b39ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:17.751392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa7fa-0f80-419a-b7be-1815218b39ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:17.751681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa7fa-0f80-419a-b7be-1815218b39ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:17.752008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa7fa-0f80-419a-b7be-1815218b39ac admin admin] PATH_INFO: `/v3/projects/07ed9ae90e304c5ebe3263f63a0aaf88` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:17.753194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19aa7fa-0f80-419a-b7be-1815218b39ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ed9ae90e304c5ebe3263f63a0aaf88)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:17.755107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19aa7fa-0f80-419a-b7be-1815218b39ac admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:17.805109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:17.813956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f19aa7fa-0f80-419a-b7be-1815218b39ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ed9ae90e304c5ebe3263f63a0aaf88', 'request_id': 'req-f19aa7fa-0f80-419a-b7be-1815218b39ac'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:17.822367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f19aa7fa-0f80-419a-b7be-1815218b39ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ed9ae90e304c5ebe3263f63a0aaf88', 'request_id': 'req-f19aa7fa-0f80-419a-b7be-1815218b39ac'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:17.828756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f19aa7fa-0f80-419a-b7be-1815218b39ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ed9ae90e304c5ebe3263f63a0aaf88', 'request_id': 'req-f19aa7fa-0f80-419a-b7be-1815218b39ac'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:17.839122 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f19aa7fa-0f80-419a-b7be-1815218b39ac admin admin] The token cache is being invalidate because project 07ed9ae90e304c5ebe3263f63a0aaf88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:36:17.839414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f19aa7fa-0f80-419a-b7be-1815218b39ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:17.840083 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-f19aa7fa-0f80-419a-b7be-1815218b39ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:17.841617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1160/2346] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:36:17 2022] DELETE /identity/v3/projects/07ed9ae90e304c5ebe3263f63a0aaf88 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:17.846579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4a904-a512-40aa-956f-936b1956c8de None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:17.847064 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4a904-a512-40aa-956f-936b1956c8de None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:17.847159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4a904-a512-40aa-956f-936b1956c8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:17.854903 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:17.868908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e7f4a904-a512-40aa-956f-936b1956c8de None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:17.870091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e7f4a904-a512-40aa-956f-936b1956c8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:17.930500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1187/2347] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:17.939034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2669ea3-9936-4134-9a7a-56287e8dc79c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:17.939323 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2669ea3-9936-4134-9a7a-56287e8dc79c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:17.939605 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2669ea3-9936-4134-9a7a-56287e8dc79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:17.960162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e2669ea3-9936-4134-9a7a-56287e8dc79c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:17.961409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e2669ea3-9936-4134-9a7a-56287e8dc79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:17.970115 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1161/2348] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:17.974452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4a904-a512-40aa-956f-936b1956c8de None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:17.984591 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4a904-a512-40aa-956f-936b1956c8de None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:17.989424 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88ed86-ab66-4d18-8b08-5f11f0e83192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:17.990033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88ed86-ab66-4d18-8b08-5f11f0e83192 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:17.990319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88ed86-ab66-4d18-8b08-5f11f0e83192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:17.990596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88ed86-ab66-4d18-8b08-5f11f0e83192 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:17.991293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88ed86-ab66-4d18-8b08-5f11f0e83192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:36:17.991650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88ed86-ab66-4d18-8b08-5f11f0e83192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:17.993889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88ed86-ab66-4d18-8b08-5f11f0e83192 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:18.005416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1188/2349] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:36:18.009866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2669ea3-9936-4134-9a7a-56287e8dc79c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:18.019179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2669ea3-9936-4134-9a7a-56287e8dc79c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:18.024479 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fb610-aed4-40ef-a27e-36dea818daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:18.025101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fb610-aed4-40ef-a27e-36dea818daf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:18.025385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fb610-aed4-40ef-a27e-36dea818daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:18.025658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fb610-aed4-40ef-a27e-36dea818daf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:18.026625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fb610-aed4-40ef-a27e-36dea818daf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:18.028549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fb610-aed4-40ef-a27e-36dea818daf8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:18.056788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1162/2350] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:36:18 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:36:18.060946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88ed86-ab66-4d18-8b08-5f11f0e83192 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:18.071369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88ed86-ab66-4d18-8b08-5f11f0e83192 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:18.126344 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154411cc-ba5d-47b8-bed5-ccb68ffa48bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:18.126962 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154411cc-ba5d-47b8-bed5-ccb68ffa48bf admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:18.127250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154411cc-ba5d-47b8-bed5-ccb68ffa48bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:18.127529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154411cc-ba5d-47b8-bed5-ccb68ffa48bf admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:18.128274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154411cc-ba5d-47b8-bed5-ccb68ffa48bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:18.130194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154411cc-ba5d-47b8-bed5-ccb68ffa48bf admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:18.152102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1189/2351] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:36:18 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:36:18.156266 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fb610-aed4-40ef-a27e-36dea818daf8 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:18.166872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fb610-aed4-40ef-a27e-36dea818daf8 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:18.171730 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82a97c-c5ac-456d-bedf-1586511a1901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:18.172397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82a97c-c5ac-456d-bedf-1586511a1901 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:18.172684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82a97c-c5ac-456d-bedf-1586511a1901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:18.172962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82a97c-c5ac-456d-bedf-1586511a1901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:18.173660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82a97c-c5ac-456d-bedf-1586511a1901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:18.175297 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82a97c-c5ac-456d-bedf-1586511a1901 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:18.186241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1163/2352] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:36:18.189992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154411cc-ba5d-47b8-bed5-ccb68ffa48bf admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:18.201211 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154411cc-ba5d-47b8-bed5-ccb68ffa48bf admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:18.207209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cf01a-4d58-4a95-8af3-db26b880fd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:18.207954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cf01a-4d58-4a95-8af3-db26b880fd81 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:18.208170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cf01a-4d58-4a95-8af3-db26b880fd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:18.208549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cf01a-4d58-4a95-8af3-db26b880fd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:18.209203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cf01a-4d58-4a95-8af3-db26b880fd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:18.210851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cf01a-4d58-4a95-8af3-db26b880fd81 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:18.227513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1190/2353] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:36:18.231997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82a97c-c5ac-456d-bedf-1586511a1901 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:18.243054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82a97c-c5ac-456d-bedf-1586511a1901 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:18.253006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf5d6a-c33c-42b7-b888-ec70d1ae0afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:18.254340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf5d6a-c33c-42b7-b888-ec70d1ae0afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:18.254873 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf5d6a-c33c-42b7-b888-ec70d1ae0afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:18.255492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf5d6a-c33c-42b7-b888-ec70d1ae0afe admin admin] PATH_INFO: `/v3/projects/26cd27f8e9d04db6906254f726d14fb7/users/ff209cbf47614ec59a23b6030a4d77fe/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:18.280445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf5d6a-c33c-42b7-b888-ec70d1ae0afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cd27f8e9d04db6906254f726d14fb7, user_id=ff209cbf47614ec59a23b6030a4d77fe, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:18.283189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf5d6a-c33c-42b7-b888-ec70d1ae0afe admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:18.298655 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1164/2354] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:36:18 2022] PUT /identity/v3/projects/26cd27f8e9d04db6906254f726d14fb7/users/ff209cbf47614ec59a23b6030a4d77fe/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:36:18.310648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908da1d7-0531-42f9-8e57-4a481bc64135 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:18.310937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908da1d7-0531-42f9-8e57-4a481bc64135 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:18.311216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908da1d7-0531-42f9-8e57-4a481bc64135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:18.341063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-908da1d7-0531-42f9-8e57-4a481bc64135 None None] MFA Rules not processed for user `ff209cbf47614ec59a23b6030a4d77fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:18.342501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-908da1d7-0531-42f9-8e57-4a481bc64135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:18.414502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:18.421366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1191/2355] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:18.425667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf5d6a-c33c-42b7-b888-ec70d1ae0afe admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:18.496508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf5d6a-c33c-42b7-b888-ec70d1ae0afe admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:18.501127 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9c634-c9f2-49ac-b6ba-8948facb4e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:18.501745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9c634-c9f2-49ac-b6ba-8948facb4e0c admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:18.502025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9c634-c9f2-49ac-b6ba-8948facb4e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:18.502299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9c634-c9f2-49ac-b6ba-8948facb4e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:18.502973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9c634-c9f2-49ac-b6ba-8948facb4e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:18.504880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9c634-c9f2-49ac-b6ba-8948facb4e0c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:18.535725 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1165/2356] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:36:18 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:36:18.539729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908da1d7-0531-42f9-8e57-4a481bc64135 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:18.550433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908da1d7-0531-42f9-8e57-4a481bc64135 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:18.626121 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65517011-4fe2-4cfe-af52-cd98d3897518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:18.626754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65517011-4fe2-4cfe-af52-cd98d3897518 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:18.627038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65517011-4fe2-4cfe-af52-cd98d3897518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:18.627316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65517011-4fe2-4cfe-af52-cd98d3897518 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:18.628180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65517011-4fe2-4cfe-af52-cd98d3897518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:18.630381 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65517011-4fe2-4cfe-af52-cd98d3897518 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:18.653854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1192/2357] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:36:18 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:36:18.659877 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9c634-c9f2-49ac-b6ba-8948facb4e0c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:18.670593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9c634-c9f2-49ac-b6ba-8948facb4e0c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:18.675199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ba38b-6343-4e23-b3ba-63a9329a5da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:18.675814 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba38b-6343-4e23-b3ba-63a9329a5da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:18.676133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba38b-6343-4e23-b3ba-63a9329a5da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:18.676410 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba38b-6343-4e23-b3ba-63a9329a5da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:18.677101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ba38b-6343-4e23-b3ba-63a9329a5da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:18.678688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ba38b-6343-4e23-b3ba-63a9329a5da3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:18.690113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1166/2358] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:36:18.694182 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65517011-4fe2-4cfe-af52-cd98d3897518 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:18.704932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65517011-4fe2-4cfe-af52-cd98d3897518 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:18.709617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ba2aa-e74b-47e4-8eca-88048ef4ea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:18.710232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba2aa-e74b-47e4-8eca-88048ef4ea6c admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:18.710522 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba2aa-e74b-47e4-8eca-88048ef4ea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:18.710802 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba2aa-e74b-47e4-8eca-88048ef4ea6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:18.712149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ba2aa-e74b-47e4-8eca-88048ef4ea6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:18.713751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ba2aa-e74b-47e4-8eca-88048ef4ea6c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:18.723762 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1193/2359] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:36:18.728081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ba38b-6343-4e23-b3ba-63a9329a5da3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:18.738301 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ba38b-6343-4e23-b3ba-63a9329a5da3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:18.743052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254475f9-1b29-447a-a8f6-aebd92ff6e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:18.743754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254475f9-1b29-447a-a8f6-aebd92ff6e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:18.744124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254475f9-1b29-447a-a8f6-aebd92ff6e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:18.744447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254475f9-1b29-447a-a8f6-aebd92ff6e27 admin admin] PATH_INFO: `/v3/projects/de8e597f8e134813a96bdf43b040b2de/users/95f02dcd6aea40c89d2284dc0e9bc3db/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:18.759634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254475f9-1b29-447a-a8f6-aebd92ff6e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8e597f8e134813a96bdf43b040b2de, user_id=95f02dcd6aea40c89d2284dc0e9bc3db, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:18.762631 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254475f9-1b29-447a-a8f6-aebd92ff6e27 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:18.776064 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1167/2360] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:36:18 2022] PUT /identity/v3/projects/de8e597f8e134813a96bdf43b040b2de/users/95f02dcd6aea40c89d2284dc0e9bc3db/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:18.786329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d72059-2a19-4fef-8199-6e1adb417e5e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:18.786647 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d72059-2a19-4fef-8199-6e1adb417e5e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:18.786931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d72059-2a19-4fef-8199-6e1adb417e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:18.814259 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-78d72059-2a19-4fef-8199-6e1adb417e5e None None] MFA Rules not processed for user `95f02dcd6aea40c89d2284dc0e9bc3db`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:18.815463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-78d72059-2a19-4fef-8199-6e1adb417e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:18.884419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1194/2361] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:18.888978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254475f9-1b29-447a-a8f6-aebd92ff6e27 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:18.902739 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:18.975411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254475f9-1b29-447a-a8f6-aebd92ff6e27 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:18.985670 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75971996-85c7-464f-829b-e4819872379e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:18.986549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971996-85c7-464f-829b-e4819872379e admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:18.986951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971996-85c7-464f-829b-e4819872379e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:18.987287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971996-85c7-464f-829b-e4819872379e admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:18.988614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75971996-85c7-464f-829b-e4819872379e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:18.990719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75971996-85c7-464f-829b-e4819872379e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:19.021414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1168/2362] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:36:18 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:36:19.023131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d72059-2a19-4fef-8199-6e1adb417e5e None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:19.035006 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d72059-2a19-4fef-8199-6e1adb417e5e None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:19.098018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d9f04-220a-4156-b2c9-c426a35e4365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:19.098954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d9f04-220a-4156-b2c9-c426a35e4365 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:19.099293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d9f04-220a-4156-b2c9-c426a35e4365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:19.099747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d9f04-220a-4156-b2c9-c426a35e4365 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:19.100383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d9f04-220a-4156-b2c9-c426a35e4365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:19.102644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d9f04-220a-4156-b2c9-c426a35e4365 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:19.117574 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:19.140052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1195/2363] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:36:19 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:36:19.141268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75971996-85c7-464f-829b-e4819872379e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:19.152718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75971996-85c7-464f-829b-e4819872379e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:19.158996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76cf9a-5422-491a-8f9c-d7692b3fd834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:19.159649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76cf9a-5422-491a-8f9c-d7692b3fd834 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:19.159977 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76cf9a-5422-491a-8f9c-d7692b3fd834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:19.160303 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76cf9a-5422-491a-8f9c-d7692b3fd834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:19.161072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76cf9a-5422-491a-8f9c-d7692b3fd834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:19.162905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76cf9a-5422-491a-8f9c-d7692b3fd834 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:19.178587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1169/2364] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:36:19.184546 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d9f04-220a-4156-b2c9-c426a35e4365 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:19.196762 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d9f04-220a-4156-b2c9-c426a35e4365 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:19.202792 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff164f5-4503-4443-9561-37fa0fd50777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:19.204140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff164f5-4503-4443-9561-37fa0fd50777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:19.204660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff164f5-4503-4443-9561-37fa0fd50777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:19.205376 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff164f5-4503-4443-9561-37fa0fd50777 admin admin] PATH_INFO: `/v3/projects/dbfa5dfdcb0a4d84860ae0ea7dbcf6c0/users/49064aa3548a49baa41b8ca222410317/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:19.226079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff164f5-4503-4443-9561-37fa0fd50777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfa5dfdcb0a4d84860ae0ea7dbcf6c0, user_id=49064aa3548a49baa41b8ca222410317, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:19.229758 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff164f5-4503-4443-9561-37fa0fd50777 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:19.250033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1196/2365] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:36:19 2022] PUT /identity/v3/projects/dbfa5dfdcb0a4d84860ae0ea7dbcf6c0/users/49064aa3548a49baa41b8ca222410317/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:19.251215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76cf9a-5422-491a-8f9c-d7692b3fd834 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:19.264776 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76cf9a-5422-491a-8f9c-d7692b3fd834 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:19.350903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70357f26-7e70-42cf-93b7-ef9c1f6b4d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:19.351587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70357f26-7e70-42cf-93b7-ef9c1f6b4d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:19.352592 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70357f26-7e70-42cf-93b7-ef9c1f6b4d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:19.352883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70357f26-7e70-42cf-93b7-ef9c1f6b4d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:19.353657 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70357f26-7e70-42cf-93b7-ef9c1f6b4d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:19.355620 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70357f26-7e70-42cf-93b7-ef9c1f6b4d46 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:19.372069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1170/2366] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:36:19.373871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff164f5-4503-4443-9561-37fa0fd50777 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:19.389260 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff164f5-4503-4443-9561-37fa0fd50777 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:19.398191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aed7e3-ccf7-4308-b4f7-f1da79356f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:19.399691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aed7e3-ccf7-4308-b4f7-f1da79356f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:19.400059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aed7e3-ccf7-4308-b4f7-f1da79356f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:19.400579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aed7e3-ccf7-4308-b4f7-f1da79356f73 admin admin] PATH_INFO: `/v3/projects/dbfa5dfdcb0a4d84860ae0ea7dbcf6c0/users/49064aa3548a49baa41b8ca222410317/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:19.402814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aed7e3-ccf7-4308-b4f7-f1da79356f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfa5dfdcb0a4d84860ae0ea7dbcf6c0, user_id=49064aa3548a49baa41b8ca222410317, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:19.405688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aed7e3-ccf7-4308-b4f7-f1da79356f73 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:19.420102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1197/2367] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:36:19 2022] PUT /identity/v3/projects/dbfa5dfdcb0a4d84860ae0ea7dbcf6c0/users/49064aa3548a49baa41b8ca222410317/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:19.493452 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389c7d1-8a34-4f7d-ac30-3d29fd6c2474 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:19.493783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389c7d1-8a34-4f7d-ac30-3d29fd6c2474 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:19.494501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389c7d1-8a34-4f7d-ac30-3d29fd6c2474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:19.525437 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c389c7d1-8a34-4f7d-ac30-3d29fd6c2474 None None] MFA Rules not processed for user `49064aa3548a49baa41b8ca222410317`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:19.526574 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c389c7d1-8a34-4f7d-ac30-3d29fd6c2474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:19.604153 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1171/2368] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:19.614953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aed7e3-ccf7-4308-b4f7-f1da79356f73 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:19.620908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-57aed7e3-ccf7-4308-b4f7-f1da79356f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:19.712267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aed7e3-ccf7-4308-b4f7-f1da79356f73 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:19.716322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494ba7c-d9b4-41d5-b1a6-80ad940b1601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:19.717140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494ba7c-d9b4-41d5-b1a6-80ad940b1601 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:19.717524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494ba7c-d9b4-41d5-b1a6-80ad940b1601 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:19.717921 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494ba7c-d9b4-41d5-b1a6-80ad940b1601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:19.815171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494ba7c-d9b4-41d5-b1a6-80ad940b1601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:19.816723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494ba7c-d9b4-41d5-b1a6-80ad940b1601 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:19.835612 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1198/2369] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:20.749227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754d5a-c16e-4d2a-a560-9086bf415fb6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:20.750153 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754d5a-c16e-4d2a-a560-9086bf415fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:20.750480 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754d5a-c16e-4d2a-a560-9086bf415fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:20.771263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ea754d5a-c16e-4d2a-a560-9086bf415fb6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:20.772510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ea754d5a-c16e-4d2a-a560-9086bf415fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:20.780851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:20.885589 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1172/2370] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Jul 27 16:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:21.057389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494ba7c-d9b4-41d5-b1a6-80ad940b1601 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:21.058932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5494ba7c-d9b4-41d5-b1a6-80ad940b1601 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:21.136208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494ba7c-d9b4-41d5-b1a6-80ad940b1601 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:21.141789 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca96a7-9a9a-450b-bb6b-8102d790e01b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:21.142409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca96a7-9a9a-450b-bb6b-8102d790e01b service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:21.142695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca96a7-9a9a-450b-bb6b-8102d790e01b service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:21.142974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca96a7-9a9a-450b-bb6b-8102d790e01b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:21.151627 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca96a7-9a9a-450b-bb6b-8102d790e01b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:21.153284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca96a7-9a9a-450b-bb6b-8102d790e01b service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:21.157225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:21.164803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1199/2371] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:21.457897 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754d5a-c16e-4d2a-a560-9086bf415fb6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:21.459457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ea754d5a-c16e-4d2a-a560-9086bf415fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:21.481047 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754d5a-c16e-4d2a-a560-9086bf415fb6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:21.485356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c90aef-f591-4633-9a0b-6464a6cb9e75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:21.486014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c90aef-f591-4633-9a0b-6464a6cb9e75 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:21.486294 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c90aef-f591-4633-9a0b-6464a6cb9e75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:21.486599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c90aef-f591-4633-9a0b-6464a6cb9e75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:21.544715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c90aef-f591-4633-9a0b-6464a6cb9e75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:21.546154 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c90aef-f591-4633-9a0b-6464a6cb9e75 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:21.555107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1173/2372] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:22.098786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca96a7-9a9a-450b-bb6b-8102d790e01b service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:22.113486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca96a7-9a9a-450b-bb6b-8102d790e01b service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:22.118078 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a05cb-cd6c-4e82-8690-218429078ba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:22.118777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a05cb-cd6c-4e82-8690-218429078ba5 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:22.119136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a05cb-cd6c-4e82-8690-218429078ba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:22.119486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a05cb-cd6c-4e82-8690-218429078ba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:22.129923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a05cb-cd6c-4e82-8690-218429078ba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:22.131624 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a05cb-cd6c-4e82-8690-218429078ba5 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:22.142459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1200/2373] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:24.493382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb000402-1ba5-4fa6-82dc-eab7baac3c1a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:24.493964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb000402-1ba5-4fa6-82dc-eab7baac3c1a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:24.493964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb000402-1ba5-4fa6-82dc-eab7baac3c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:24.514004 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-eb000402-1ba5-4fa6-82dc-eab7baac3c1a None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:24.515229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-eb000402-1ba5-4fa6-82dc-eab7baac3c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:24.523096 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1174/2374] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Jul 27 16:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:24.547104 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a05cb-cd6c-4e82-8690-218429078ba5 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:24.559301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a05cb-cd6c-4e82-8690-218429078ba5 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:24.565124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a906da-9bb0-4761-93da-541c8dcff7db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:24.565738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a906da-9bb0-4761-93da-541c8dcff7db service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:24.566026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a906da-9bb0-4761-93da-541c8dcff7db service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:24.566306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a906da-9bb0-4761-93da-541c8dcff7db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:24.575126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a906da-9bb0-4761-93da-541c8dcff7db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:24.576800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a906da-9bb0-4761-93da-541c8dcff7db service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:24.586849 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1201/2375] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:26.037006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb000402-1ba5-4fa6-82dc-eab7baac3c1a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:26.047601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb000402-1ba5-4fa6-82dc-eab7baac3c1a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:26.052419 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:26.053056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:26.053336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:26.053603 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] PATH_INFO: `/v3/users/ff209cbf47614ec59a23b6030a4d77fe` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:26.054847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff209cbf47614ec59a23b6030a4d77fe)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:26.056945 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:26.106008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff209cbf47614ec59a23b6030a4d77fe'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.113821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff209cbf47614ec59a23b6030a4d77fe'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.121511 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff209cbf47614ec59a23b6030a4d77fe'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.122165 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff209cbf47614ec59a23b6030a4d77fe'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.122784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff209cbf47614ec59a23b6030a4d77fe'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.141701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1175/2376] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:36:26 2022] DELETE /identity/v3/users/ff209cbf47614ec59a23b6030a4d77fe => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:26.146335 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6efb57-a95b-4990-9cbd-a4addf88c1e8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:26.146838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6efb57-a95b-4990-9cbd-a4addf88c1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:26.146931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6efb57-a95b-4990-9cbd-a4addf88c1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:26.167170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5d6efb57-a95b-4990-9cbd-a4addf88c1e8 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:26.168411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5d6efb57-a95b-4990-9cbd-a4addf88c1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:26.237872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1202/2377] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:26.248798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:26.250204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:26.265377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:26.313562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe363b50-dc11-4c62-b749-9d5b1f9d4f9a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:26.317168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62b4bb-57cf-4ea2-96e6-a3bd9156a9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:26.317789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62b4bb-57cf-4ea2-96e6-a3bd9156a9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:26.318068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62b4bb-57cf-4ea2-96e6-a3bd9156a9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:26.318339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62b4bb-57cf-4ea2-96e6-a3bd9156a9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:26.328826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62b4bb-57cf-4ea2-96e6-a3bd9156a9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:26.330234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62b4bb-57cf-4ea2-96e6-a3bd9156a9d2 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:26.340226 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1176/2378] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:26.712171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6efb57-a95b-4990-9cbd-a4addf88c1e8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:26.713654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5d6efb57-a95b-4990-9cbd-a4addf88c1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:26.726301 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6efb57-a95b-4990-9cbd-a4addf88c1e8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:26.731144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:26.731799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:26.732120 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:26.732402 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] PATH_INFO: `/v3/projects/26cd27f8e9d04db6906254f726d14fb7` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:26.733652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26cd27f8e9d04db6906254f726d14fb7)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:26.735604 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:26.782417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26cd27f8e9d04db6906254f726d14fb7', 'request_id': 'req-ab3f0aac-3f9d-425b-885d-6a49f4a65971'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.788437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26cd27f8e9d04db6906254f726d14fb7', 'request_id': 'req-ab3f0aac-3f9d-425b-885d-6a49f4a65971'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.794091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26cd27f8e9d04db6906254f726d14fb7', 'request_id': 'req-ab3f0aac-3f9d-425b-885d-6a49f4a65971'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.807306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] The token cache is being invalidate because project 26cd27f8e9d04db6906254f726d14fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:36:26.807602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.808261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.810037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1203/2379] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:36:26 2022] DELETE /identity/v3/projects/26cd27f8e9d04db6906254f726d14fb7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:26.813822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62b4bb-57cf-4ea2-96e6-a3bd9156a9d2 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:26.823938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62b4bb-57cf-4ea2-96e6-a3bd9156a9d2 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:26.880039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:26.880684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:26.880966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:26.881243 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] PATH_INFO: `/v3/users/95f02dcd6aea40c89d2284dc0e9bc3db` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:26.882416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95f02dcd6aea40c89d2284dc0e9bc3db)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:26.884512 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:26.930385 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95f02dcd6aea40c89d2284dc0e9bc3db'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.937325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95f02dcd6aea40c89d2284dc0e9bc3db'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.944688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95f02dcd6aea40c89d2284dc0e9bc3db'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.945948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95f02dcd6aea40c89d2284dc0e9bc3db'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.946597 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95f02dcd6aea40c89d2284dc0e9bc3db'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:26.964570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1177/2380] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:36:26 2022] DELETE /identity/v3/users/95f02dcd6aea40c89d2284dc0e9bc3db => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:27.310379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:27.312548 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:27.330957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f0aac-3f9d-425b-885d-6a49f4a65971 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:27.386085 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:27.399156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:27.400227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:27.400699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:27.400989 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] PATH_INFO: `/v3/projects/de8e597f8e134813a96bdf43b040b2de` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:27.402207 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8e597f8e134813a96bdf43b040b2de)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:27.404440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:27.455079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8e597f8e134813a96bdf43b040b2de', 'request_id': 'req-a0b171c0-2550-4d07-be88-48e5c85f7b7c'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:27.464254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8e597f8e134813a96bdf43b040b2de', 'request_id': 'req-a0b171c0-2550-4d07-be88-48e5c85f7b7c'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:27.469996 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8e597f8e134813a96bdf43b040b2de', 'request_id': 'req-a0b171c0-2550-4d07-be88-48e5c85f7b7c'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:27.482869 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] The token cache is being invalidate because project de8e597f8e134813a96bdf43b040b2de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:36:27.483166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:27.483815 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:27.485685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1204/2381] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:36:27 2022] DELETE /identity/v3/projects/de8e597f8e134813a96bdf43b040b2de => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:27.489910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:27.491346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:27.504261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4e0c9-6bf8-4902-ab94-d437ff615046 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:27.542200 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:27.571594 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e06f5a-5eab-4e7f-91bc-eba769fb7eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:27.572276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e06f5a-5eab-4e7f-91bc-eba769fb7eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:27.572557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e06f5a-5eab-4e7f-91bc-eba769fb7eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:27.572833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e06f5a-5eab-4e7f-91bc-eba769fb7eda admin admin] PATH_INFO: `/v3/users/49064aa3548a49baa41b8ca222410317` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:27.574007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e06f5a-5eab-4e7f-91bc-eba769fb7eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=49064aa3548a49baa41b8ca222410317)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:27.575972 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e06f5a-5eab-4e7f-91bc-eba769fb7eda admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:27.640113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b3e06f5a-5eab-4e7f-91bc-eba769fb7eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49064aa3548a49baa41b8ca222410317'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:27.648717 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b3e06f5a-5eab-4e7f-91bc-eba769fb7eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49064aa3548a49baa41b8ca222410317'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:27.658801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b3e06f5a-5eab-4e7f-91bc-eba769fb7eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49064aa3548a49baa41b8ca222410317'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:27.659688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b3e06f5a-5eab-4e7f-91bc-eba769fb7eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49064aa3548a49baa41b8ca222410317'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:27.660492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b3e06f5a-5eab-4e7f-91bc-eba769fb7eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49064aa3548a49baa41b8ca222410317'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:27.681298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1178/2382] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:36:27 2022] DELETE /identity/v3/users/49064aa3548a49baa41b8ca222410317 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:28.017742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:28.019334 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:28.034793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b171c0-2550-4d07-be88-48e5c85f7b7c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:28.098576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56cb55-3331-4b1a-97ac-e899fcb64698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:28.099234 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56cb55-3331-4b1a-97ac-e899fcb64698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:28.099525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56cb55-3331-4b1a-97ac-e899fcb64698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:28.099788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56cb55-3331-4b1a-97ac-e899fcb64698 admin admin] PATH_INFO: `/v3/projects/dbfa5dfdcb0a4d84860ae0ea7dbcf6c0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:28.101006 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56cb55-3331-4b1a-97ac-e899fcb64698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfa5dfdcb0a4d84860ae0ea7dbcf6c0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:28.104060 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56cb55-3331-4b1a-97ac-e899fcb64698 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:28.153478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cf56cb55-3331-4b1a-97ac-e899fcb64698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfa5dfdcb0a4d84860ae0ea7dbcf6c0', 'request_id': 'req-cf56cb55-3331-4b1a-97ac-e899fcb64698'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:28.159664 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cf56cb55-3331-4b1a-97ac-e899fcb64698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfa5dfdcb0a4d84860ae0ea7dbcf6c0', 'request_id': 'req-cf56cb55-3331-4b1a-97ac-e899fcb64698'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:28.165750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cf56cb55-3331-4b1a-97ac-e899fcb64698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfa5dfdcb0a4d84860ae0ea7dbcf6c0', 'request_id': 'req-cf56cb55-3331-4b1a-97ac-e899fcb64698'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:28.178670 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cf56cb55-3331-4b1a-97ac-e899fcb64698 admin admin] The token cache is being invalidate because project dbfa5dfdcb0a4d84860ae0ea7dbcf6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:36:28.178962 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cf56cb55-3331-4b1a-97ac-e899fcb64698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:28.179626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cf56cb55-3331-4b1a-97ac-e899fcb64698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:28.182024 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1205/2383] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:36:28 2022] DELETE /identity/v3/projects/dbfa5dfdcb0a4d84860ae0ea7dbcf6c0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:28.186751 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cb463-e663-485b-9f31-4e1c5b3e1ca8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:28.187044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cb463-e663-485b-9f31-4e1c5b3e1ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:28.187325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cb463-e663-485b-9f31-4e1c5b3e1ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:28.207300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6c4cb463-e663-485b-9f31-4e1c5b3e1ca8 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:28.208847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6c4cb463-e663-485b-9f31-4e1c5b3e1ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:28.269444 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1179/2384] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:28.277709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716086ae-f496-4232-aa20-7df04c7b975c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:28.278128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716086ae-f496-4232-aa20-7df04c7b975c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:28.278417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716086ae-f496-4232-aa20-7df04c7b975c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:28.299583 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-716086ae-f496-4232-aa20-7df04c7b975c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:28.300879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-716086ae-f496-4232-aa20-7df04c7b975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:28.308947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1206/2385] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:28.313439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cb463-e663-485b-9f31-4e1c5b3e1ca8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:28.323143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cb463-e663-485b-9f31-4e1c5b3e1ca8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:28.327727 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4cdbe-3121-4dea-b911-f2068756b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:28.328378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4cdbe-3121-4dea-b911-f2068756b350 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:28.328665 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4cdbe-3121-4dea-b911-f2068756b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:28.328948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4cdbe-3121-4dea-b911-f2068756b350 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:28.329672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4cdbe-3121-4dea-b911-f2068756b350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:36:28.329982 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4cdbe-3121-4dea-b911-f2068756b350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:28.331566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4cdbe-3121-4dea-b911-f2068756b350 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:28.343585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1180/2386] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:36:28.347702 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716086ae-f496-4232-aa20-7df04c7b975c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:28.357675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716086ae-f496-4232-aa20-7df04c7b975c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:28.362273 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d47b4-abb7-48f7-aebe-bf6f619364c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:28.362881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d47b4-abb7-48f7-aebe-bf6f619364c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:28.363164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d47b4-abb7-48f7-aebe-bf6f619364c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:28.363729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d47b4-abb7-48f7-aebe-bf6f619364c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:28.364465 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d47b4-abb7-48f7-aebe-bf6f619364c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:28.366423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d47b4-abb7-48f7-aebe-bf6f619364c3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:28.371730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:28.393886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1207/2387] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:36:28 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:36:28.398112 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4cdbe-3121-4dea-b911-f2068756b350 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:28.409513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4cdbe-3121-4dea-b911-f2068756b350 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:28.451396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:28.472121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a9ff3-9ead-4cf4-992b-60e7f3ba83c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:28.472743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a9ff3-9ead-4cf4-992b-60e7f3ba83c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:28.473028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a9ff3-9ead-4cf4-992b-60e7f3ba83c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:28.473310 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a9ff3-9ead-4cf4-992b-60e7f3ba83c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:28.473992 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a9ff3-9ead-4cf4-992b-60e7f3ba83c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:28.475915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a9ff3-9ead-4cf4-992b-60e7f3ba83c1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:28.500705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1181/2388] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:36:28 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:36:28.501906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d47b4-abb7-48f7-aebe-bf6f619364c3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:28.513092 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d47b4-abb7-48f7-aebe-bf6f619364c3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:28.517867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea114c-2c4f-4165-9e5b-d3e49e54c5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:28.518396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea114c-2c4f-4165-9e5b-d3e49e54c5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:28.518685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea114c-2c4f-4165-9e5b-d3e49e54c5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:28.518968 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea114c-2c4f-4165-9e5b-d3e49e54c5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:28.519728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea114c-2c4f-4165-9e5b-d3e49e54c5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:28.521316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea114c-2c4f-4165-9e5b-d3e49e54c5c9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:28.532246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1208/2389] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:36:28.536197 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a9ff3-9ead-4cf4-992b-60e7f3ba83c1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:28.546705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a9ff3-9ead-4cf4-992b-60e7f3ba83c1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:28.551397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef5773-616e-4aec-aa7e-5b533029e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:28.552046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef5773-616e-4aec-aa7e-5b533029e979 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:28.552335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef5773-616e-4aec-aa7e-5b533029e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:28.552612 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef5773-616e-4aec-aa7e-5b533029e979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:28.553386 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef5773-616e-4aec-aa7e-5b533029e979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:28.557475 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef5773-616e-4aec-aa7e-5b533029e979 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:28.568696 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1182/2390] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:36:28.573524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea114c-2c4f-4165-9e5b-d3e49e54c5c9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:28.589233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea114c-2c4f-4165-9e5b-d3e49e54c5c9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:28.597773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd4015-536f-4941-837a-519c74cc96f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:28.599019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd4015-536f-4941-837a-519c74cc96f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:28.599927 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd4015-536f-4941-837a-519c74cc96f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:28.600409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd4015-536f-4941-837a-519c74cc96f8 admin admin] PATH_INFO: `/v3/projects/8b5123cd4f3a48769de000b212f2a52d/users/f5fc6a95f9a84552b61562c1f60e94be/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:28.625067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd4015-536f-4941-837a-519c74cc96f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5123cd4f3a48769de000b212f2a52d, user_id=f5fc6a95f9a84552b61562c1f60e94be, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:28.628371 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd4015-536f-4941-837a-519c74cc96f8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:28.660983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1209/2391] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:36:28 2022] PUT /identity/v3/projects/8b5123cd4f3a48769de000b212f2a52d/users/f5fc6a95f9a84552b61562c1f60e94be/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:36:28.663890 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784807f-5656-4638-a263-5de5c9c989ff None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:28.667992 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784807f-5656-4638-a263-5de5c9c989ff None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:28.667992 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784807f-5656-4638-a263-5de5c9c989ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:28.694241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2784807f-5656-4638-a263-5de5c9c989ff None None] MFA Rules not processed for user `f5fc6a95f9a84552b61562c1f60e94be`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:28.696349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2784807f-5656-4638-a263-5de5c9c989ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:28.715045 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c704c-2c89-4763-88c6-5f62a5fc7463 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:28.715336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c704c-2c89-4763-88c6-5f62a5fc7463 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:28.715650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c704c-2c89-4763-88c6-5f62a5fc7463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:28.736584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-761c704c-2c89-4763-88c6-5f62a5fc7463 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:28.738052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-761c704c-2c89-4763-88c6-5f62a5fc7463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:28.776972 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1183/2392] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:36:28.788345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784807f-5656-4638-a263-5de5c9c989ff None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:28.789774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2784807f-5656-4638-a263-5de5c9c989ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:28.800061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1210/2393] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Jul 27 16:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:28.823880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c704c-2c89-4763-88c6-5f62a5fc7463 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:28.825335 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-761c704c-2c89-4763-88c6-5f62a5fc7463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:28.846178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784807f-5656-4638-a263-5de5c9c989ff None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:28.849936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a149aa8-293f-4b64-81a5-204117963e83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:28.850560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149aa8-293f-4b64-81a5-204117963e83 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:28.850850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149aa8-293f-4b64-81a5-204117963e83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:28.851129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149aa8-293f-4b64-81a5-204117963e83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:28.860811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a149aa8-293f-4b64-81a5-204117963e83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:28.862299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a149aa8-293f-4b64-81a5-204117963e83 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:28.873365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1184/2394] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:36:28.901909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c704c-2c89-4763-88c6-5f62a5fc7463 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:28.908379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0eac5-9e19-451a-a884-6fc65ae5d501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:28.909044 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0eac5-9e19-451a-a884-6fc65ae5d501 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:28.909313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0eac5-9e19-451a-a884-6fc65ae5d501 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:28.909593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0eac5-9e19-451a-a884-6fc65ae5d501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:28.920285 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0eac5-9e19-451a-a884-6fc65ae5d501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:28.921921 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0eac5-9e19-451a-a884-6fc65ae5d501 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:28.933940 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1211/2395] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:36:33.960803 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa8fcc-1623-413a-9ab6-67242cff935d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:33.961983 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa8fcc-1623-413a-9ab6-67242cff935d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:33.962138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa8fcc-1623-413a-9ab6-67242cff935d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:33.982891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e4fa8fcc-1623-413a-9ab6-67242cff935d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:33.984171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e4fa8fcc-1623-413a-9ab6-67242cff935d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:33.992770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1185/2396] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Jul 27 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:34.022246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0eac5-9e19-451a-a884-6fc65ae5d501 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:34.025840 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfd789-0d10-45ef-aa53-cd9c0480a1ba None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:34.026132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfd789-0d10-45ef-aa53-cd9c0480a1ba None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:34.026407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfd789-0d10-45ef-aa53-cd9c0480a1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:34.035926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0eac5-9e19-451a-a884-6fc65ae5d501 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:34.045618 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6edfd789-0d10-45ef-aa53-cd9c0480a1ba None None] MFA Rules not processed for user `32a5063a78064508ad01165199bd60fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:34.046868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6edfd789-0d10-45ef-aa53-cd9c0480a1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:34.047188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c84f85-9ae2-444d-b424-680b7c318c02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:34.047820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c84f85-9ae2-444d-b424-680b7c318c02 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:34.048153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c84f85-9ae2-444d-b424-680b7c318c02 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:34.048431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c84f85-9ae2-444d-b424-680b7c318c02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:34.062406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c84f85-9ae2-444d-b424-680b7c318c02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:34.064139 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c84f85-9ae2-444d-b424-680b7c318c02 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:34.075305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1212/2397] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:34.076163 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c84f85-9ae2-444d-b424-680b7c318c02 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:34.085401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c84f85-9ae2-444d-b424-680b7c318c02 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:34.090569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:34.091211 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:34.091495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:34.091780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] PATH_INFO: `/v3/users/f5fc6a95f9a84552b61562c1f60e94be` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:34.093012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5fc6a95f9a84552b61562c1f60e94be)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:34.094937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:34.101605 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:34.121714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1186/2398] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:34.125452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:34.168526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5fc6a95f9a84552b61562c1f60e94be'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:34.178448 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5fc6a95f9a84552b61562c1f60e94be'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:34.188641 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5fc6a95f9a84552b61562c1f60e94be'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:34.189280 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5fc6a95f9a84552b61562c1f60e94be'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:34.189913 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5fc6a95f9a84552b61562c1f60e94be'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:34.211971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1213/2399] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:36:34 2022] DELETE /identity/v3/users/f5fc6a95f9a84552b61562c1f60e94be => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:34.216751 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eeb10-899b-46f9-845a-6e51ee6181fe None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:34.217050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eeb10-899b-46f9-845a-6e51ee6181fe None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:34.217329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eeb10-899b-46f9-845a-6e51ee6181fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:34.237531 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1c6eeb10-899b-46f9-845a-6e51ee6181fe None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:34.239007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1c6eeb10-899b-46f9-845a-6e51ee6181fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:34.303919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1187/2400] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:36:34.314005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:34.315413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:34.376698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac21ad7-60b6-4ece-ae42-c09644d55cfd admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:34.380548 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28260ae8-0739-49ef-94c7-09dbb26038bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:34.381251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28260ae8-0739-49ef-94c7-09dbb26038bc service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:34.381809 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28260ae8-0739-49ef-94c7-09dbb26038bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:34.382154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28260ae8-0739-49ef-94c7-09dbb26038bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:34.393250 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28260ae8-0739-49ef-94c7-09dbb26038bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:34.394890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28260ae8-0739-49ef-94c7-09dbb26038bc service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:34.406683 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1214/2401] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:36:34.904947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eeb10-899b-46f9-845a-6e51ee6181fe None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:34.906753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1c6eeb10-899b-46f9-845a-6e51ee6181fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:34.936089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eeb10-899b-46f9-845a-6e51ee6181fe None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:34.940823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:34.941480 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:34.941762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:34.942038 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] PATH_INFO: `/v3/projects/8b5123cd4f3a48769de000b212f2a52d` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:34.943276 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5123cd4f3a48769de000b212f2a52d)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:34.945362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:35.015100 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5123cd4f3a48769de000b212f2a52d', 'request_id': 'req-571044a0-8903-407b-8476-1f2903f34e51'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:35.027018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5123cd4f3a48769de000b212f2a52d', 'request_id': 'req-571044a0-8903-407b-8476-1f2903f34e51'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:35.034346 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5123cd4f3a48769de000b212f2a52d', 'request_id': 'req-571044a0-8903-407b-8476-1f2903f34e51'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:35.051449 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] The token cache is being invalidate because project 8b5123cd4f3a48769de000b212f2a52d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:36:35.051743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:35.053261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:36:35.055129 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1188/2402] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:36:34 2022] DELETE /identity/v3/projects/8b5123cd4f3a48769de000b212f2a52d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:36:44.402370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=8,keystone:SELECT=46,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:45.047031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:36:45.790327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56c072-00d3-48c0-835a-4bf33c2c92e0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:45.790856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56c072-00d3-48c0-835a-4bf33c2c92e0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:45.791001 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56c072-00d3-48c0-835a-4bf33c2c92e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:45.813477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2f56c072-00d3-48c0-835a-4bf33c2c92e0 None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:45.814991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2f56c072-00d3-48c0-835a-4bf33c2c92e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:45.890370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1215/2403] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:36:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:45.903314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:36:45.904779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:45.978829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571044a0-8903-407b-8476-1f2903f34e51 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:36:45.983899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f294050-4933-461f-98b2-a4a61f54be66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:36:45.984819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f294050-4933-461f-98b2-a4a61f54be66 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:45.984819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f294050-4933-461f-98b2-a4a61f54be66 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:45.985121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f294050-4933-461f-98b2-a4a61f54be66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:45.994753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f294050-4933-461f-98b2-a4a61f54be66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:36:45.996363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f294050-4933-461f-98b2-a4a61f54be66 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:36:46.004546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1189/2404] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:36:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 16:36:50.974780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56118a9e-9e73-4794-8245-34e8d9214666 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:36:50.975304 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56118a9e-9e73-4794-8245-34e8d9214666 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:36:50.975975 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56118a9e-9e73-4794-8245-34e8d9214666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:36:51.004633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-56118a9e-9e73-4794-8245-34e8d9214666 None None] MFA Rules not processed for user `b2c654edcab3432a8e7e6a0d84607b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:36:51.007372 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-56118a9e-9e73-4794-8245-34e8d9214666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:36:51.077445 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1216/2405] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:36:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:36:56.001151 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=32 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:01.065901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=50 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:01.737970 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39eff3-4a40-4043-97ee-13b6d5dfd287 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:01.738474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39eff3-4a40-4043-97ee-13b6d5dfd287 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:01.738585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39eff3-4a40-4043-97ee-13b6d5dfd287 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:01.740281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1190/2406] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:37:01.748337 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7280e-b0b8-4f15-ac38-cca20aa57344 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:01.748808 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7280e-b0b8-4f15-ac38-cca20aa57344 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:01.749198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7280e-b0b8-4f15-ac38-cca20aa57344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:01.776240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3bf7280e-b0b8-4f15-ac38-cca20aa57344 None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:37:01.778361 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3bf7280e-b0b8-4f15-ac38-cca20aa57344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:01.846527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1217/2407] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:37:01.863037 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39eff3-4a40-4043-97ee-13b6d5dfd287 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:37:01.865099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3f39eff3-4a40-4043-97ee-13b6d5dfd287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:01.923222 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39eff3-4a40-4043-97ee-13b6d5dfd287 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:37:01.926741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a070f35-06d3-4cad-9aac-e55fe63a2587 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1832d9988604b81bcb075ae77db6d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:37:01.927352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a070f35-06d3-4cad-9aac-e55fe63a2587 service glance] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:01.927637 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a070f35-06d3-4cad-9aac-e55fe63a2587 service glance] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:01.927942 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a070f35-06d3-4cad-9aac-e55fe63a2587 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:01.938194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a070f35-06d3-4cad-9aac-e55fe63a2587 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:37:01.939563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a070f35-06d3-4cad-9aac-e55fe63a2587 service glance] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:37:01.950199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1191/2408] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:37:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:37:02.022107 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cba754-b56c-4555-b230-2d082c7270cc None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:02.022401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cba754-b56c-4555-b230-2d082c7270cc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:02.022687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cba754-b56c-4555-b230-2d082c7270cc None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:02.024804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1218/2409] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:37:02.029476 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ba8e1-3151-41d1-873e-c8780699a240 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:02.029857 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ba8e1-3151-41d1-873e-c8780699a240 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:02.030244 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ba8e1-3151-41d1-873e-c8780699a240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:02.050082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-799ba8e1-3151-41d1-873e-c8780699a240 None None] MFA Rules not processed for user `73325bdd109749ad92a66e600fd61a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:37:02.051302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-799ba8e1-3151-41d1-873e-c8780699a240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:02.103735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1192/2410] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:37:02.115924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cba754-b56c-4555-b230-2d082c7270cc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:37:02.117706 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-91cba754-b56c-4555-b230-2d082c7270cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:02.132987 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cba754-b56c-4555-b230-2d082c7270cc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:37:02.136576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61397449-342b-4d18-874e-c940933dd19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:37:02.137190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61397449-342b-4d18-874e-c940933dd19e service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:02.137472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61397449-342b-4d18-874e-c940933dd19e service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:02.137744 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61397449-342b-4d18-874e-c940933dd19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:02.144940 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61397449-342b-4d18-874e-c940933dd19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:37:02.146376 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61397449-342b-4d18-874e-c940933dd19e service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:37:02.154782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1219/2411] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:37:02.271997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad373b6d-fc73-4386-8b8e-b178c6ba0f51 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:02.272290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad373b6d-fc73-4386-8b8e-b178c6ba0f51 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:02.272568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad373b6d-fc73-4386-8b8e-b178c6ba0f51 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:02.274591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1193/2412] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:37:02.279694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bdd1c-1ded-47d9-9b84-27814a1a8658 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:02.280032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bdd1c-1ded-47d9-9b84-27814a1a8658 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:02.280341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bdd1c-1ded-47d9-9b84-27814a1a8658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:02.300052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-456bdd1c-1ded-47d9-9b84-27814a1a8658 None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:37:02.301268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-456bdd1c-1ded-47d9-9b84-27814a1a8658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:02.311840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1220/2413] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:37:02.325446 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad373b6d-fc73-4386-8b8e-b178c6ba0f51 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:37:02.338467 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad373b6d-fc73-4386-8b8e-b178c6ba0f51 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:37:02.342051 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c2188-e147-40ac-bbeb-6d77e0aea020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:37:02.342664 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c2188-e147-40ac-bbeb-6d77e0aea020 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:02.342952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c2188-e147-40ac-bbeb-6d77e0aea020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:02.343230 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c2188-e147-40ac-bbeb-6d77e0aea020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:02.353316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c2188-e147-40ac-bbeb-6d77e0aea020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:37:02.354742 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c2188-e147-40ac-bbeb-6d77e0aea020 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:37:02.366340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1194/2414] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:37:06.358259 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c9e70-a651-4f1d-8456-f66991070ef7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:06.358798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c9e70-a651-4f1d-8456-f66991070ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:06.358798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c9e70-a651-4f1d-8456-f66991070ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:06.378208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-557c9e70-a651-4f1d-8456-f66991070ef7 None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:37:06.379413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-557c9e70-a651-4f1d-8456-f66991070ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:06.386737 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1221/2415] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:37:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:37:06.409548 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c2188-e147-40ac-bbeb-6d77e0aea020 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:37:06.422721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c2188-e147-40ac-bbeb-6d77e0aea020 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:37:06.428834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2993f-00dd-4e97-a832-e567ea5d92bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:37:06.429545 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2993f-00dd-4e97-a832-e567ea5d92bf service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:06.430138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2993f-00dd-4e97-a832-e567ea5d92bf service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:06.430582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2993f-00dd-4e97-a832-e567ea5d92bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:06.440311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2993f-00dd-4e97-a832-e567ea5d92bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:37:06.441898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2993f-00dd-4e97-a832-e567ea5d92bf service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:37:06.451615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1195/2416] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:37:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 16:37:07.448770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e1c30-09b1-4fec-87fa-e68e26982dd7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:07.449425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e1c30-09b1-4fec-87fa-e68e26982dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:07.449425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e1c30-09b1-4fec-87fa-e68e26982dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:07.471749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-3d2e1c30-09b1-4fec-87fa-e68e26982dd7 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:37:07.473066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3d2e1c30-09b1-4fec-87fa-e68e26982dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:07.537344 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1222/2417] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Jul 27 16:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:37:07.566794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2993f-00dd-4e97-a832-e567ea5d92bf service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:37:07.568292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-67b2993f-00dd-4e97-a832-e567ea5d92bf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:07.584974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2993f-00dd-4e97-a832-e567ea5d92bf service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:37:07.596536 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b31f9-cd88-45b9-b6eb-ad34ea495f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:37:07.597183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b31f9-cd88-45b9-b6eb-ad34ea495f45 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:07.597470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b31f9-cd88-45b9-b6eb-ad34ea495f45 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:07.597749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b31f9-cd88-45b9-b6eb-ad34ea495f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:07.607672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b31f9-cd88-45b9-b6eb-ad34ea495f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:37:07.609288 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b31f9-cd88-45b9-b6eb-ad34ea495f45 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:37:07.620006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1196/2418] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:37:17.529383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=70 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:17.614783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=67 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:22.038459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae9e43-5392-4949-ad2f-8435ddc08427 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:22.039816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae9e43-5392-4949-ad2f-8435ddc08427 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:22.040518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae9e43-5392-4949-ad2f-8435ddc08427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:22.065203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-5aae9e43-5392-4949-ad2f-8435ddc08427 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:37:22.066558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5aae9e43-5392-4949-ad2f-8435ddc08427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:22.083789 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1223/2419] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Jul 27 16:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:37:22.105593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b31f9-cd88-45b9-b6eb-ad34ea495f45 service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:37:22.107449 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f61b31f9-cd88-45b9-b6eb-ad34ea495f45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:22.122647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b31f9-cd88-45b9-b6eb-ad34ea495f45 service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:37:22.128050 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402edbc-4a53-41dd-beed-0518d4249876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:37:22.128681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402edbc-4a53-41dd-beed-0518d4249876 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:22.128942 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402edbc-4a53-41dd-beed-0518d4249876 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:22.129215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402edbc-4a53-41dd-beed-0518d4249876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:22.137941 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402edbc-4a53-41dd-beed-0518d4249876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:37:22.139484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402edbc-4a53-41dd-beed-0518d4249876 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:37:22.148784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1197/2420] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:37:26.971523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea4d7c-93c7-4d75-baa8-0ef374c8aec0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:26.972493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea4d7c-93c7-4d75-baa8-0ef374c8aec0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:26.973013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea4d7c-93c7-4d75-baa8-0ef374c8aec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:26.994452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2bea4d7c-93c7-4d75-baa8-0ef374c8aec0 None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:37:26.996178 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2bea4d7c-93c7-4d75-baa8-0ef374c8aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:27.007804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1224/2421] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 27 16:37:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:37:27.025161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402edbc-4a53-41dd-beed-0518d4249876 service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:37:27.043249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402edbc-4a53-41dd-beed-0518d4249876 service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:37:27.052005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b7621-4573-4a8d-9c75-3b3aa8551849 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:37:27.052686 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b7621-4573-4a8d-9c75-3b3aa8551849 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:27.052975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b7621-4573-4a8d-9c75-3b3aa8551849 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:27.053255 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b7621-4573-4a8d-9c75-3b3aa8551849 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:27.063257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b7621-4573-4a8d-9c75-3b3aa8551849 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:37:27.064855 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b7621-4573-4a8d-9c75-3b3aa8551849 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:37:27.073908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1198/2422] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:37:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 16:37:27.236578 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd333f5-ee93-430e-9fc7-9d37d26b8be3 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:27.236867 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd333f5-ee93-430e-9fc7-9d37d26b8be3 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:27.237144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd333f5-ee93-430e-9fc7-9d37d26b8be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:27.263048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7dd333f5-ee93-430e-9fc7-9d37d26b8be3 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:37:27.265142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7dd333f5-ee93-430e-9fc7-9d37d26b8be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:27.275545 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1225/2423] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Jul 27 16:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:37:27.313221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b7621-4573-4a8d-9c75-3b3aa8551849 service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:37:27.341535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b7621-4573-4a8d-9c75-3b3aa8551849 service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:37:27.378090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a9313-ee79-4858-9b28-3fbe060b5be9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:37:27.379194 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a9313-ee79-4858-9b28-3fbe060b5be9 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:27.379675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a9313-ee79-4858-9b28-3fbe060b5be9 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:27.380562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a9313-ee79-4858-9b28-3fbe060b5be9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:27.392503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a9313-ee79-4858-9b28-3fbe060b5be9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:37:27.396114 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a9313-ee79-4858-9b28-3fbe060b5be9 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:37:27.408455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1199/2424] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:37:27.419980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd333f5-ee93-430e-9fc7-9d37d26b8be3 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:37:27.422599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7dd333f5-ee93-430e-9fc7-9d37d26b8be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:27.547771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd333f5-ee93-430e-9fc7-9d37d26b8be3 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:37:27.557052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a0586-eec3-46f0-9727-3d6560878121 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f602decb26be477b867493429352bd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:37:27.559373 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a0586-eec3-46f0-9727-3d6560878121 service placement] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:27.559778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a0586-eec3-46f0-9727-3d6560878121 service placement] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:27.560082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a0586-eec3-46f0-9727-3d6560878121 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:27.562833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3e0a0586-eec3-46f0-9727-3d6560878121 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:27.584924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a0586-eec3-46f0-9727-3d6560878121 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:37:27.586714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a0586-eec3-46f0-9727-3d6560878121 service placement] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:37:27.607976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1226/2425] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:37:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:37:30.415700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb382a-f589-4102-9e32-4d6a0755dae8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:30.416320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb382a-f589-4102-9e32-4d6a0755dae8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:30.416320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb382a-f589-4102-9e32-4d6a0755dae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:30.437396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-dfeb382a-f589-4102-9e32-4d6a0755dae8 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:37:30.438545 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-dfeb382a-f589-4102-9e32-4d6a0755dae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:30.446556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1200/2426] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Jul 27 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:37:30.470805 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a0586-eec3-46f0-9727-3d6560878121 service placement] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:37:30.484313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a0586-eec3-46f0-9727-3d6560878121 service placement] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:37:30.489892 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334785b4-b540-4be3-9bf3-64a943afd649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:37:30.490517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334785b4-b540-4be3-9bf3-64a943afd649 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:30.490808 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334785b4-b540-4be3-9bf3-64a943afd649 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:30.491089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334785b4-b540-4be3-9bf3-64a943afd649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:30.501199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334785b4-b540-4be3-9bf3-64a943afd649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:37:30.502809 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334785b4-b540-4be3-9bf3-64a943afd649 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:37:30.513820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1227/2427] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:37:33.595792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42737e93-579b-45b7-9074-70c2c878eb6a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:33.596361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42737e93-579b-45b7-9074-70c2c878eb6a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:33.596361 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42737e93-579b-45b7-9074-70c2c878eb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:33.616948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-42737e93-579b-45b7-9074-70c2c878eb6a None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:37:33.618145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-42737e93-579b-45b7-9074-70c2c878eb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:33.625938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1201/2428] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Jul 27 16:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:37:33.659924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334785b4-b540-4be3-9bf3-64a943afd649 service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:37:33.673368 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334785b4-b540-4be3-9bf3-64a943afd649 service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:37:33.682691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6bb58-d7a8-4fa6-b17c-854395a72a9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:37:33.683322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6bb58-d7a8-4fa6-b17c-854395a72a9b service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:33.683608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6bb58-d7a8-4fa6-b17c-854395a72a9b service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:33.683914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6bb58-d7a8-4fa6-b17c-854395a72a9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:33.695022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6bb58-d7a8-4fa6-b17c-854395a72a9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:37:33.697221 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6bb58-d7a8-4fa6-b17c-854395a72a9b service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:37:33.707426 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1228/2429] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:37:41.184596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944df9b3-7258-4201-95d0-13e968349066 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:37:41.185132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944df9b3-7258-4201-95d0-13e968349066 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:37:41.185235 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944df9b3-7258-4201-95d0-13e968349066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:37:41.205729 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-944df9b3-7258-4201-95d0-13e968349066 None None] MFA Rules not processed for user `bc75a052c6b14904a314cf8f7bd4bad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:37:41.207000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-944df9b3-7258-4201-95d0-13e968349066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:37:41.261516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1202/2430] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:37:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:37:43.703067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=53 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:37:51.254781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=49 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:04.844018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6bb58-d7a8-4fa6-b17c-854395a72a9b service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:04.845593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e9f6bb58-d7a8-4fa6-b17c-854395a72a9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:38:04.862797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6bb58-d7a8-4fa6-b17c-854395a72a9b service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:04.868081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15decfc-387c-4a90-9662-e3fb02c3fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:04.869448 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15decfc-387c-4a90-9662-e3fb02c3fe08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:04.870409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15decfc-387c-4a90-9662-e3fb02c3fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:04.870703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15decfc-387c-4a90-9662-e3fb02c3fe08 admin admin] PATH_INFO: `/v3/users/b2c654edcab3432a8e7e6a0d84607b63` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:04.872051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15decfc-387c-4a90-9662-e3fb02c3fe08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c654edcab3432a8e7e6a0d84607b63)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:04.874007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15decfc-387c-4a90-9662-e3fb02c3fe08 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:04.945748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d15decfc-387c-4a90-9662-e3fb02c3fe08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c654edcab3432a8e7e6a0d84607b63'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:38:04.954948 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d15decfc-387c-4a90-9662-e3fb02c3fe08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c654edcab3432a8e7e6a0d84607b63'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:38:04.962303 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d15decfc-387c-4a90-9662-e3fb02c3fe08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c654edcab3432a8e7e6a0d84607b63'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:38:04.963034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d15decfc-387c-4a90-9662-e3fb02c3fe08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c654edcab3432a8e7e6a0d84607b63'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:38:04.963641 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-d15decfc-387c-4a90-9662-e3fb02c3fe08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c654edcab3432a8e7e6a0d84607b63'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:38:04.981005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1229/2431] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:38:04 2022] DELETE /identity/v3/users/b2c654edcab3432a8e7e6a0d84607b63 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:38:05.218909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944df9b3-7258-4201-95d0-13e968349066 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:05.257954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944df9b3-7258-4201-95d0-13e968349066 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:05.341411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df135b4-ebf0-4618-b44a-b414f273988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:05.342111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df135b4-ebf0-4618-b44a-b414f273988b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:05.342401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df135b4-ebf0-4618-b44a-b414f273988b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:05.342678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df135b4-ebf0-4618-b44a-b414f273988b admin admin] PATH_INFO: `/v3/projects/0941bf3ed76742b9bcee4ffeea249699` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:05.343974 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df135b4-ebf0-4618-b44a-b414f273988b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0941bf3ed76742b9bcee4ffeea249699)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:05.345893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df135b4-ebf0-4618-b44a-b414f273988b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:05.399872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0df135b4-ebf0-4618-b44a-b414f273988b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0941bf3ed76742b9bcee4ffeea249699', 'request_id': 'req-0df135b4-ebf0-4618-b44a-b414f273988b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:38:05.409621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0df135b4-ebf0-4618-b44a-b414f273988b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0941bf3ed76742b9bcee4ffeea249699', 'request_id': 'req-0df135b4-ebf0-4618-b44a-b414f273988b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:38:05.417655 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0df135b4-ebf0-4618-b44a-b414f273988b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0941bf3ed76742b9bcee4ffeea249699', 'request_id': 'req-0df135b4-ebf0-4618-b44a-b414f273988b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:38:05.430625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0df135b4-ebf0-4618-b44a-b414f273988b admin admin] The token cache is being invalidate because project 0941bf3ed76742b9bcee4ffeea249699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:38:05.430929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0df135b4-ebf0-4618-b44a-b414f273988b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:38:05.432273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0df135b4-ebf0-4618-b44a-b414f273988b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:38:05.433859 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1203/2432] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:38:05 2022] DELETE /identity/v3/projects/0941bf3ed76742b9bcee4ffeea249699 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:38:05.439075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8f6dc-7288-4fe2-8faf-b183bdf551df None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:05.439516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8f6dc-7288-4fe2-8faf-b183bdf551df None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:05.439984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8f6dc-7288-4fe2-8faf-b183bdf551df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:05.460318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2ca8f6dc-7288-4fe2-8faf-b183bdf551df None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:38:05.461665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2ca8f6dc-7288-4fe2-8faf-b183bdf551df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:38:05.530305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1230/2433] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:38:05.538468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f04f4-eb30-4091-989d-691dcdf370ca None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:05.538875 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f04f4-eb30-4091-989d-691dcdf370ca None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:05.539075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f04f4-eb30-4091-989d-691dcdf370ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:05.562267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-606f04f4-eb30-4091-989d-691dcdf370ca None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:38:05.563430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-606f04f4-eb30-4091-989d-691dcdf370ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:38:05.573161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1204/2434] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:38:05.578372 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8f6dc-7288-4fe2-8faf-b183bdf551df None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:05.590639 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8f6dc-7288-4fe2-8faf-b183bdf551df None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:05.596095 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765b78c-2ad6-442e-8a1a-b0d71f3b3e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:05.596750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765b78c-2ad6-442e-8a1a-b0d71f3b3e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:05.597052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765b78c-2ad6-442e-8a1a-b0d71f3b3e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:05.597309 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765b78c-2ad6-442e-8a1a-b0d71f3b3e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:05.598026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765b78c-2ad6-442e-8a1a-b0d71f3b3e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:38:05.598372 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765b78c-2ad6-442e-8a1a-b0d71f3b3e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:05.600076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765b78c-2ad6-442e-8a1a-b0d71f3b3e03 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:05.612943 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1231/2435] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:38:05.617489 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f04f4-eb30-4091-989d-691dcdf370ca None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:05.627574 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f04f4-eb30-4091-989d-691dcdf370ca None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:05.632977 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e34afd-a9e9-4375-b98a-c7e2bcda81c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:05.633578 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e34afd-a9e9-4375-b98a-c7e2bcda81c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:05.633866 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e34afd-a9e9-4375-b98a-c7e2bcda81c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:05.634143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e34afd-a9e9-4375-b98a-c7e2bcda81c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:05.635053 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e34afd-a9e9-4375-b98a-c7e2bcda81c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:05.637140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e34afd-a9e9-4375-b98a-c7e2bcda81c0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:05.668258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1205/2436] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:38:05 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:38:05.672491 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765b78c-2ad6-442e-8a1a-b0d71f3b3e03 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:05.683169 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765b78c-2ad6-442e-8a1a-b0d71f3b3e03 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:05.743844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebde19-e5e8-43c0-8dba-59d905a95eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:05.744527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebde19-e5e8-43c0-8dba-59d905a95eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:05.744909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebde19-e5e8-43c0-8dba-59d905a95eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:05.745195 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebde19-e5e8-43c0-8dba-59d905a95eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:05.745869 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebde19-e5e8-43c0-8dba-59d905a95eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:05.747837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebde19-e5e8-43c0-8dba-59d905a95eb2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:05.756014 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:05.773397 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1232/2437] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:38:05 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:38:05.777401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e34afd-a9e9-4375-b98a-c7e2bcda81c0 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:05.788042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e34afd-a9e9-4375-b98a-c7e2bcda81c0 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:05.793403 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff773f6-1329-4b2f-ac8b-e625b0f1bf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:05.794029 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff773f6-1329-4b2f-ac8b-e625b0f1bf3a admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:05.794313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff773f6-1329-4b2f-ac8b-e625b0f1bf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:05.794584 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff773f6-1329-4b2f-ac8b-e625b0f1bf3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:05.795281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff773f6-1329-4b2f-ac8b-e625b0f1bf3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:05.796922 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff773f6-1329-4b2f-ac8b-e625b0f1bf3a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:05.808095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1206/2438] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:38:05.812081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebde19-e5e8-43c0-8dba-59d905a95eb2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:05.823289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebde19-e5e8-43c0-8dba-59d905a95eb2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:05.828117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8d222-3422-49a9-b1ef-c22cf5260b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:05.828750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8d222-3422-49a9-b1ef-c22cf5260b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:05.829038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8d222-3422-49a9-b1ef-c22cf5260b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:05.829321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8d222-3422-49a9-b1ef-c22cf5260b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:05.830028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8d222-3422-49a9-b1ef-c22cf5260b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:05.831633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8d222-3422-49a9-b1ef-c22cf5260b12 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:05.842965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1233/2439] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:38:05.847097 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff773f6-1329-4b2f-ac8b-e625b0f1bf3a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:05.857546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff773f6-1329-4b2f-ac8b-e625b0f1bf3a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:05.862833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90673267-f407-4251-bcdd-aa4e08afe916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:05.863514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90673267-f407-4251-bcdd-aa4e08afe916 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:05.863804 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90673267-f407-4251-bcdd-aa4e08afe916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:05.864123 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90673267-f407-4251-bcdd-aa4e08afe916 admin admin] PATH_INFO: `/v3/projects/86f2c5c726ed49488b851117f96336bf/users/86648523ab484efa8d00c2ab13a8d984/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:05.880664 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90673267-f407-4251-bcdd-aa4e08afe916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f2c5c726ed49488b851117f96336bf, user_id=86648523ab484efa8d00c2ab13a8d984, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:05.883452 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90673267-f407-4251-bcdd-aa4e08afe916 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:05.897557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1207/2440] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:38:05 2022] PUT /identity/v3/projects/86f2c5c726ed49488b851117f96336bf/users/86648523ab484efa8d00c2ab13a8d984/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:38:05.902881 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d09e4-09b2-42f5-9a23-0b3de8b94580 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:05.903390 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d09e4-09b2-42f5-9a23-0b3de8b94580 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:05.903495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d09e4-09b2-42f5-9a23-0b3de8b94580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:05.923430 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-567d09e4-09b2-42f5-9a23-0b3de8b94580 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:38:05.924694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-567d09e4-09b2-42f5-9a23-0b3de8b94580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:38:05.984899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1234/2441] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:38:05.995486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90673267-f407-4251-bcdd-aa4e08afe916 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:05.997213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-90673267-f407-4251-bcdd-aa4e08afe916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:38:06.028664 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:06.060078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90673267-f407-4251-bcdd-aa4e08afe916 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:06.064673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d364b6b-0349-455b-9995-b7015dc92ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:06.065336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d364b6b-0349-455b-9995-b7015dc92ffd service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:06.065625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d364b6b-0349-455b-9995-b7015dc92ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:06.065907 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d364b6b-0349-455b-9995-b7015dc92ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:06.075545 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d364b6b-0349-455b-9995-b7015dc92ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:06.076933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d364b6b-0349-455b-9995-b7015dc92ffd service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:06.086718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1208/2442] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:38:06.550470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba18c5e-08f8-4442-ad49-fd9bac16b3f7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:06.550768 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba18c5e-08f8-4442-ad49-fd9bac16b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:06.551081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba18c5e-08f8-4442-ad49-fd9bac16b3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:06.573656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-aba18c5e-08f8-4442-ad49-fd9bac16b3f7 None None] MFA Rules not processed for user `32a5063a78064508ad01165199bd60fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:38:06.574945 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-aba18c5e-08f8-4442-ad49-fd9bac16b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:38:06.639284 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1235/2443] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:38:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:38:10.586171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccde0fc-686b-4b4d-8fbb-5b65377fab0a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:10.587114 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccde0fc-686b-4b4d-8fbb-5b65377fab0a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:10.588220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccde0fc-686b-4b4d-8fbb-5b65377fab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:10.623121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-bccde0fc-686b-4b4d-8fbb-5b65377fab0a None None] MFA Rules not processed for user `86648523ab484efa8d00c2ab13a8d984`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:38:10.624898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bccde0fc-686b-4b4d-8fbb-5b65377fab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:38:10.722969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1209/2444] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:38:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:38:10.727379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba18c5e-08f8-4442-ad49-fd9bac16b3f7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:10.743508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba18c5e-08f8-4442-ad49-fd9bac16b3f7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:10.750572 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8eee2-8bd4-461d-aa4d-d13cecfbe6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:10.751806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8eee2-8bd4-461d-aa4d-d13cecfbe6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:10.752464 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8eee2-8bd4-461d-aa4d-d13cecfbe6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:10.752464 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8eee2-8bd4-461d-aa4d-d13cecfbe6c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:10.753337 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8eee2-8bd4-461d-aa4d-d13cecfbe6c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:10.755727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8eee2-8bd4-461d-aa4d-d13cecfbe6c3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:10.844815 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1236/2445] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:38:10 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:38:10.848900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccde0fc-686b-4b4d-8fbb-5b65377fab0a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:10.878423 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccde0fc-686b-4b4d-8fbb-5b65377fab0a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:10.984384 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924eb56f-fe54-44df-b00e-a2a417db62d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:10.985025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eb56f-fe54-44df-b00e-a2a417db62d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:10.985311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eb56f-fe54-44df-b00e-a2a417db62d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:10.985604 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eb56f-fe54-44df-b00e-a2a417db62d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:10.986278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924eb56f-fe54-44df-b00e-a2a417db62d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:10.989165 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924eb56f-fe54-44df-b00e-a2a417db62d0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:11.016202 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1210/2446] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:38:10 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:38:11.019730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8eee2-8bd4-461d-aa4d-d13cecfbe6c3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:11.031299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8eee2-8bd4-461d-aa4d-d13cecfbe6c3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:11.037837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53040d88-7bad-4717-b6f4-bf419ceabd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:11.038485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040d88-7bad-4717-b6f4-bf419ceabd45 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:11.038769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040d88-7bad-4717-b6f4-bf419ceabd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:11.039050 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040d88-7bad-4717-b6f4-bf419ceabd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:11.039760 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53040d88-7bad-4717-b6f4-bf419ceabd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:11.041876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53040d88-7bad-4717-b6f4-bf419ceabd45 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:11.055655 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1237/2447] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:38:11.060705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924eb56f-fe54-44df-b00e-a2a417db62d0 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:11.071375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924eb56f-fe54-44df-b00e-a2a417db62d0 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:11.077037 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95785c0-66b3-43c6-8cec-4811300ea73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:11.077738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95785c0-66b3-43c6-8cec-4811300ea73f admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:11.078021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95785c0-66b3-43c6-8cec-4811300ea73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:11.078299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95785c0-66b3-43c6-8cec-4811300ea73f admin admin] PATH_INFO: `/v3/projects/f3eb08ab9a8d483e9f29ec6ffb55c34c/users/a47757d2eecf4366a6a2daecfad83be3/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:11.096920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95785c0-66b3-43c6-8cec-4811300ea73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3eb08ab9a8d483e9f29ec6ffb55c34c, user_id=a47757d2eecf4366a6a2daecfad83be3, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:11.099794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95785c0-66b3-43c6-8cec-4811300ea73f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:11.115292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1211/2448] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:38:11 2022] PUT /identity/v3/projects/f3eb08ab9a8d483e9f29ec6ffb55c34c/users/a47757d2eecf4366a6a2daecfad83be3/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:38:11.120117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53040d88-7bad-4717-b6f4-bf419ceabd45 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:11.130826 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53040d88-7bad-4717-b6f4-bf419ceabd45 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:11.191940 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:11.203461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff24c59-29d6-42a7-9375-9bae4430167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:11.204480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff24c59-29d6-42a7-9375-9bae4430167a admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:11.204916 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff24c59-29d6-42a7-9375-9bae4430167a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:11.205350 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff24c59-29d6-42a7-9375-9bae4430167a admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:11.206068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff24c59-29d6-42a7-9375-9bae4430167a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:11.207741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff24c59-29d6-42a7-9375-9bae4430167a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:11.221273 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1238/2449] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:38:11.224780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95785c0-66b3-43c6-8cec-4811300ea73f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:11.236335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95785c0-66b3-43c6-8cec-4811300ea73f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:11.241642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb7692-24d7-4509-b009-a5ad81cc207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:11.242474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb7692-24d7-4509-b009-a5ad81cc207b admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:11.242845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb7692-24d7-4509-b009-a5ad81cc207b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:11.244302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb7692-24d7-4509-b009-a5ad81cc207b admin admin] PATH_INFO: `/v3/projects/f3eb08ab9a8d483e9f29ec6ffb55c34c/users/a47757d2eecf4366a6a2daecfad83be3/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:11.246650 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb7692-24d7-4509-b009-a5ad81cc207b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3eb08ab9a8d483e9f29ec6ffb55c34c, user_id=a47757d2eecf4366a6a2daecfad83be3, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:11.249672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb7692-24d7-4509-b009-a5ad81cc207b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:11.262929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1212/2450] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:38:11 2022] PUT /identity/v3/projects/f3eb08ab9a8d483e9f29ec6ffb55c34c/users/a47757d2eecf4366a6a2daecfad83be3/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:38:17.848970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf905d6-d23a-4407-a1c0-c85a21c98401 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:17.849509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf905d6-d23a-4407-a1c0-c85a21c98401 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:17.849601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf905d6-d23a-4407-a1c0-c85a21c98401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:17.917748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6bf905d6-d23a-4407-a1c0-c85a21c98401 None None] MFA Rules not processed for user `a47757d2eecf4366a6a2daecfad83be3`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:38:17.919084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6bf905d6-d23a-4407-a1c0-c85a21c98401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:38:18.061012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1239/2451] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:38:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:38:18.075578 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb7692-24d7-4509-b009-a5ad81cc207b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:18.077625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a2cb7692-24d7-4509-b009-a5ad81cc207b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:38:18.099208 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:18.258017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb7692-24d7-4509-b009-a5ad81cc207b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:18.268822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0d8fe-d5e1-4c12-a740-3caf89693ded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:18.269802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0d8fe-d5e1-4c12-a740-3caf89693ded service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:18.270060 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0d8fe-d5e1-4c12-a740-3caf89693ded service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:18.270686 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0d8fe-d5e1-4c12-a740-3caf89693ded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:18.388377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0d8fe-d5e1-4c12-a740-3caf89693ded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:18.389996 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0d8fe-d5e1-4c12-a740-3caf89693ded service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:18.412511 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1213/2452] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:38:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:38:20.082200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7a5b-fc1c-4eec-882d-809bb24b2652 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:20.083295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7a5b-fc1c-4eec-882d-809bb24b2652 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:20.083892 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7a5b-fc1c-4eec-882d-809bb24b2652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:20.109740 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-297e7a5b-fc1c-4eec-882d-809bb24b2652 None None] MFA Rules not processed for user `86648523ab484efa8d00c2ab13a8d984`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:38:20.111441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-297e7a5b-fc1c-4eec-882d-809bb24b2652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:38:20.128078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827626e-f8f3-40ea-9050-e50b0783934e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:20.128982 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827626e-f8f3-40ea-9050-e50b0783934e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:20.129514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827626e-f8f3-40ea-9050-e50b0783934e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:20.130725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1240/2453] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:38:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:38:20.168759 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a827626e-f8f3-40ea-9050-e50b0783934e None None] MFA Rules not processed for user `17804273371846b7abdcbd663a06c227`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:38:20.170280 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a827626e-f8f3-40ea-9050-e50b0783934e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:38:20.252408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1214/2454] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:38:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:38:30.102665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=43 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:30.243751 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=76 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:38:48.840326 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e7a5b-fc1c-4eec-882d-809bb24b2652 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:38:48.841910 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-297e7a5b-fc1c-4eec-882d-809bb24b2652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:38:48.921765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e7a5b-fc1c-4eec-882d-809bb24b2652 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:38:48.925747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e482b3-a2e1-4049-9867-2a81f512e170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:38:48.926549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e482b3-a2e1-4049-9867-2a81f512e170 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:48.926845 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e482b3-a2e1-4049-9867-2a81f512e170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:48.927246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e482b3-a2e1-4049-9867-2a81f512e170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:48.938246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e482b3-a2e1-4049-9867-2a81f512e170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:38:48.939791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e482b3-a2e1-4049-9867-2a81f512e170 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:38:48.951413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1241/2455] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:38:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:38:52.074977 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1d0dc-83f5-4db8-b193-7f055b5bce18 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:38:52.075448 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1d0dc-83f5-4db8-b193-7f055b5bce18 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:38:52.075630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1d0dc-83f5-4db8-b193-7f055b5bce18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:38:52.099356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-34b1d0dc-83f5-4db8-b193-7f055b5bce18 None None] MFA Rules not processed for user `bc75a052c6b14904a314cf8f7bd4bad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:38:52.100747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-34b1d0dc-83f5-4db8-b193-7f055b5bce18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:38:52.167591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1215/2456] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:38:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:38:58.946936 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=26 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:02.159607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=25 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:16.722364 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e482b3-a2e1-4049-9867-2a81f512e170 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:16.732057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e482b3-a2e1-4049-9867-2a81f512e170 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:16.735842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b3097-954a-44c4-ad55-ba3bffaf00ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:16.736858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b3097-954a-44c4-ad55-ba3bffaf00ca service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:16.737275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b3097-954a-44c4-ad55-ba3bffaf00ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:16.737640 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b3097-954a-44c4-ad55-ba3bffaf00ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:16.739526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-741b3097-954a-44c4-ad55-ba3bffaf00ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:16.809140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b3097-954a-44c4-ad55-ba3bffaf00ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:16.811047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b3097-954a-44c4-ad55-ba3bffaf00ca service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:16.822032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1242/2457] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:18.794317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d294-a861-482f-ae91-c5a2a4e9ae7e None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:18.794889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d294-a861-482f-ae91-c5a2a4e9ae7e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:18.795006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d294-a861-482f-ae91-c5a2a4e9ae7e None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:18.796863 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1216/2458] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:39:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:39:18.831562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704f91f-534a-440e-8a57-56e9a04a6f14 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:18.832184 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704f91f-534a-440e-8a57-56e9a04a6f14 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:18.832184 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704f91f-534a-440e-8a57-56e9a04a6f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:18.852496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-d704f91f-534a-440e-8a57-56e9a04a6f14 None None] MFA Rules not processed for user `f602decb26be477b867493429352bd03`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:18.853708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d704f91f-534a-440e-8a57-56e9a04a6f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:18.908366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6d294-a861-482f-ae91-c5a2a4e9ae7e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:18.910619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e4c6d294-a861-482f-ae91-c5a2a4e9ae7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:18.929792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6d294-a861-482f-ae91-c5a2a4e9ae7e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:18.937518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a62d5-641a-4135-9df7-174232498ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:18.938457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1243/2459] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:39:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:18.938608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a62d5-641a-4135-9df7-174232498ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:18.938775 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a62d5-641a-4135-9df7-174232498ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:18.939176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a62d5-641a-4135-9df7-174232498ddb admin admin] PATH_INFO: `/v3/users/32a5063a78064508ad01165199bd60fc` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:18.940607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a62d5-641a-4135-9df7-174232498ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a5063a78064508ad01165199bd60fc)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:18.942988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a62d5-641a-4135-9df7-174232498ddb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:18.951972 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704f91f-534a-440e-8a57-56e9a04a6f14 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:18.953299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d704f91f-534a-440e-8a57-56e9a04a6f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:18.967715 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704f91f-534a-440e-8a57-56e9a04a6f14 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:18.973803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12730afb-04a6-46fc-b652-f21164a831bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f602decb26be477b867493429352bd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:18.974684 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12730afb-04a6-46fc-b652-f21164a831bd service placement] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:18.975046 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12730afb-04a6-46fc-b652-f21164a831bd service placement] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:18.975408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12730afb-04a6-46fc-b652-f21164a831bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:18.986289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12730afb-04a6-46fc-b652-f21164a831bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:18.988777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12730afb-04a6-46fc-b652-f21164a831bd service placement] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:19.001563 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1244/2460] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:39:19.002782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-522a62d5-641a-4135-9df7-174232498ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a5063a78064508ad01165199bd60fc'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:19.011119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-522a62d5-641a-4135-9df7-174232498ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a5063a78064508ad01165199bd60fc'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:19.021386 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-522a62d5-641a-4135-9df7-174232498ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a5063a78064508ad01165199bd60fc'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:19.021971 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-522a62d5-641a-4135-9df7-174232498ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a5063a78064508ad01165199bd60fc'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:19.022596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-522a62d5-641a-4135-9df7-174232498ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a5063a78064508ad01165199bd60fc'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:19.043031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1217/2461] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:39:18 2022] DELETE /identity/v3/users/32a5063a78064508ad01165199bd60fc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:19.237271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12730afb-04a6-46fc-b652-f21164a831bd service placement] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:19.250297 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12730afb-04a6-46fc-b652-f21164a831bd service placement] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:19.327261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:19.327960 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:19.328248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:19.328523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] PATH_INFO: `/v3/projects/bd8e9861207c453baf72ac45d1eadb04` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:19.329735 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8e9861207c453baf72ac45d1eadb04)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:19.331705 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:19.358117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:19.386327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8e9861207c453baf72ac45d1eadb04', 'request_id': 'req-131d8f09-f20c-4faa-b70d-44801f317ff8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:19.393590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8e9861207c453baf72ac45d1eadb04', 'request_id': 'req-131d8f09-f20c-4faa-b70d-44801f317ff8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:19.399293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8e9861207c453baf72ac45d1eadb04', 'request_id': 'req-131d8f09-f20c-4faa-b70d-44801f317ff8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:19.414906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] The token cache is being invalidate because project bd8e9861207c453baf72ac45d1eadb04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:39:19.415336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:19.416038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:19.417583 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1245/2462] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:39:19 2022] DELETE /identity/v3/projects/bd8e9861207c453baf72ac45d1eadb04 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:19.424663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f890c-3089-44fc-a065-f978757c1d13 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:19.425135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f890c-3089-44fc-a065-f978757c1d13 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:19.425609 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f890c-3089-44fc-a065-f978757c1d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:19.455577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-512f890c-3089-44fc-a065-f978757c1d13 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:19.457035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-512f890c-3089-44fc-a065-f978757c1d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:19.485600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:19.487008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:19.519985 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1218/2463] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:19.527527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece43b62-17ed-447b-9d84-11dd6260f207 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:19.527743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece43b62-17ed-447b-9d84-11dd6260f207 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:19.528621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece43b62-17ed-447b-9d84-11dd6260f207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:19.547950 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ece43b62-17ed-447b-9d84-11dd6260f207 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:19.549144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ece43b62-17ed-447b-9d84-11dd6260f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:19.551686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d8f09-f20c-4faa-b70d-44801f317ff8 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:19.555295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7b07d-8a3e-498e-b5f2-e6781fb82180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:19.555974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7b07d-8a3e-498e-b5f2-e6781fb82180 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:19.556263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7b07d-8a3e-498e-b5f2-e6781fb82180 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:19.556541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7b07d-8a3e-498e-b5f2-e6781fb82180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:19.556892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1219/2464] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:39:19.558316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7da7b07d-8a3e-498e-b5f2-e6781fb82180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:19.561277 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece43b62-17ed-447b-9d84-11dd6260f207 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:19.572768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece43b62-17ed-447b-9d84-11dd6260f207 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:19.579829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536103d4-288c-4bbe-8203-52ed54c7b99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:19.580672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536103d4-288c-4bbe-8203-52ed54c7b99b admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:19.581030 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536103d4-288c-4bbe-8203-52ed54c7b99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:19.581317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536103d4-288c-4bbe-8203-52ed54c7b99b admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:19.582165 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536103d4-288c-4bbe-8203-52ed54c7b99b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:39:19.582518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536103d4-288c-4bbe-8203-52ed54c7b99b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:19.584403 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536103d4-288c-4bbe-8203-52ed54c7b99b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:19.598373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1220/2465] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:39:19.602811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536103d4-288c-4bbe-8203-52ed54c7b99b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:19.614081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536103d4-288c-4bbe-8203-52ed54c7b99b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:19.618770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadf9e3-784a-4a60-8233-6330526d96df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:19.619390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf9e3-784a-4a60-8233-6330526d96df admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:19.619675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf9e3-784a-4a60-8233-6330526d96df admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:19.620000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf9e3-784a-4a60-8233-6330526d96df admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:19.620698 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadf9e3-784a-4a60-8233-6330526d96df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:19.623478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadf9e3-784a-4a60-8233-6330526d96df admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:19.648587 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7b07d-8a3e-498e-b5f2-e6781fb82180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:19.650248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7b07d-8a3e-498e-b5f2-e6781fb82180 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:19.651815 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1221/2466] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:39:19 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:19.656243 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadf9e3-784a-4a60-8233-6330526d96df admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:19.664764 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1246/2467] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:39:19.699285 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:19.736089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadf9e3-784a-4a60-8233-6330526d96df admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:19.741413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d753efa-43f6-44fd-b4f5-3fff9bab432d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:19.742054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d753efa-43f6-44fd-b4f5-3fff9bab432d admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:19.742343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d753efa-43f6-44fd-b4f5-3fff9bab432d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:19.742641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d753efa-43f6-44fd-b4f5-3fff9bab432d admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:19.743307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d753efa-43f6-44fd-b4f5-3fff9bab432d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:19.745290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d753efa-43f6-44fd-b4f5-3fff9bab432d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:19.772878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1222/2468] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:39:19 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:19.776586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7b07d-8a3e-498e-b5f2-e6781fb82180 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:19.788421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7b07d-8a3e-498e-b5f2-e6781fb82180 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:19.793230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ec346-6c34-4e3e-83e4-d309ca304afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:19.794532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ec346-6c34-4e3e-83e4-d309ca304afb admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:19.794698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ec346-6c34-4e3e-83e4-d309ca304afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:19.794971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ec346-6c34-4e3e-83e4-d309ca304afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:19.795676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ec346-6c34-4e3e-83e4-d309ca304afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:19.797401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ec346-6c34-4e3e-83e4-d309ca304afb admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:19.814340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1247/2469] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:39:19.815853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d753efa-43f6-44fd-b4f5-3fff9bab432d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:19.832254 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d753efa-43f6-44fd-b4f5-3fff9bab432d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:19.837493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b389af-6ba9-4839-b75e-43b9c1b71879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:19.838128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b389af-6ba9-4839-b75e-43b9c1b71879 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:19.838417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b389af-6ba9-4839-b75e-43b9c1b71879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:19.838697 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b389af-6ba9-4839-b75e-43b9c1b71879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:19.839411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b389af-6ba9-4839-b75e-43b9c1b71879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:19.841182 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b389af-6ba9-4839-b75e-43b9c1b71879 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:19.855336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1223/2470] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:39:19.856651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ec346-6c34-4e3e-83e4-d309ca304afb admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:19.872379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ec346-6c34-4e3e-83e4-d309ca304afb admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:19.877445 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2557d7-aa67-4222-a614-8796260ec3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:19.878131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2557d7-aa67-4222-a614-8796260ec3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:19.878437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2557d7-aa67-4222-a614-8796260ec3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:19.878704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2557d7-aa67-4222-a614-8796260ec3b3 admin admin] PATH_INFO: `/v3/projects/4a80535e0abf467a8b7eba0a5ac9bca2/users/90075abce06a42e4972ea4f71d891d21/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:19.896075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2557d7-aa67-4222-a614-8796260ec3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a80535e0abf467a8b7eba0a5ac9bca2, user_id=90075abce06a42e4972ea4f71d891d21, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:19.898777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2557d7-aa67-4222-a614-8796260ec3b3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:19.912469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1248/2471] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:39:19 2022] PUT /identity/v3/projects/4a80535e0abf467a8b7eba0a5ac9bca2/users/90075abce06a42e4972ea4f71d891d21/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:19.927478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232200c-31a2-4ef3-97e7-70ab35ff691d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:19.927478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232200c-31a2-4ef3-97e7-70ab35ff691d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:19.927478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232200c-31a2-4ef3-97e7-70ab35ff691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:19.958741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-7232200c-31a2-4ef3-97e7-70ab35ff691d None None] MFA Rules not processed for user `90075abce06a42e4972ea4f71d891d21`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:19.961270 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7232200c-31a2-4ef3-97e7-70ab35ff691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:20.039319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1224/2472] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:20.050626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2557d7-aa67-4222-a614-8796260ec3b3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:20.052520 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1e2557d7-aa67-4222-a614-8796260ec3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:20.067878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:20.114682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2557d7-aa67-4222-a614-8796260ec3b3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:20.118510 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d5dfc-3191-41aa-8cf3-a1654d418492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:20.119134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d5dfc-3191-41aa-8cf3-a1654d418492 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:20.119425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d5dfc-3191-41aa-8cf3-a1654d418492 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:20.119704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d5dfc-3191-41aa-8cf3-a1654d418492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:20.130447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d5dfc-3191-41aa-8cf3-a1654d418492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:20.131913 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d5dfc-3191-41aa-8cf3-a1654d418492 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:20.141127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1249/2473] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:20.870832 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232200c-31a2-4ef3-97e7-70ab35ff691d None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:20.932710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232200c-31a2-4ef3-97e7-70ab35ff691d None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:20.938947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019e79e-64bc-4a41-87bf-3bc01a89a8eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:20.939693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e79e-64bc-4a41-87bf-3bc01a89a8eb service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:20.940104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e79e-64bc-4a41-87bf-3bc01a89a8eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:20.940488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e79e-64bc-4a41-87bf-3bc01a89a8eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:20.942440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7019e79e-64bc-4a41-87bf-3bc01a89a8eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:21.007669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:21.030258 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019e79e-64bc-4a41-87bf-3bc01a89a8eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:21.031691 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019e79e-64bc-4a41-87bf-3bc01a89a8eb service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:21.042803 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1225/2474] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:28.763786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d5dfc-3191-41aa-8cf3-a1654d418492 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:28.831268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d5dfc-3191-41aa-8cf3-a1654d418492 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:28.836036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:28.836687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:28.836974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:28.837244 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] PATH_INFO: `/v3/users/90075abce06a42e4972ea4f71d891d21` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:28.838420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90075abce06a42e4972ea4f71d891d21)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:28.840379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:28.892321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90075abce06a42e4972ea4f71d891d21'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:28.900891 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90075abce06a42e4972ea4f71d891d21'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:28.910785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90075abce06a42e4972ea4f71d891d21'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:28.910785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90075abce06a42e4972ea4f71d891d21'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:28.912356 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90075abce06a42e4972ea4f71d891d21'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:28.931066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1250/2475] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:39:28 2022] DELETE /identity/v3/users/90075abce06a42e4972ea4f71d891d21 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:28.935853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509c49a-30be-4d92-a604-186491af013d None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:28.936577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509c49a-30be-4d92-a604-186491af013d None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:28.936577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509c49a-30be-4d92-a604-186491af013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:28.962963 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1509c49a-30be-4d92-a604-186491af013d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:28.964221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1509c49a-30be-4d92-a604-186491af013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:29.026709 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1226/2476] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:29.043345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:29.045129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:29.093700 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:29.117998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2225c8-fb40-4ba3-a5b2-80eb3ca52e36 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:29.122432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f39b8d-dd8f-41f1-a125-a3e2d0feed6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:29.123062 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f39b8d-dd8f-41f1-a125-a3e2d0feed6a service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:29.123350 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f39b8d-dd8f-41f1-a125-a3e2d0feed6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:29.123620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f39b8d-dd8f-41f1-a125-a3e2d0feed6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:29.145379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f39b8d-dd8f-41f1-a125-a3e2d0feed6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:29.146851 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f39b8d-dd8f-41f1-a125-a3e2d0feed6a service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:29.158201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1251/2477] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:39:29.353159 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579d91f-ee9e-4467-842f-b73375739c7a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:29.353460 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579d91f-ee9e-4467-842f-b73375739c7a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:29.353740 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579d91f-ee9e-4467-842f-b73375739c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:29.382188 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3579d91f-ee9e-4467-842f-b73375739c7a None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:29.383672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3579d91f-ee9e-4467-842f-b73375739c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:29.458663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1227/2478] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:39:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:29.499728 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f39b8d-dd8f-41f1-a125-a3e2d0feed6a service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:29.504439 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-00f39b8d-dd8f-41f1-a125-a3e2d0feed6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:29.522818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579d91f-ee9e-4467-842f-b73375739c7a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:29.523084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f39b8d-dd8f-41f1-a125-a3e2d0feed6a service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:29.524543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3579d91f-ee9e-4467-842f-b73375739c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:29.527901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55edf6e-2f20-4d85-8e34-036c09d5230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:29.528697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55edf6e-2f20-4d85-8e34-036c09d5230b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:29.528984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55edf6e-2f20-4d85-8e34-036c09d5230b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:29.529264 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55edf6e-2f20-4d85-8e34-036c09d5230b admin admin] PATH_INFO: `/v3/projects/4a80535e0abf467a8b7eba0a5ac9bca2` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:29.530561 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55edf6e-2f20-4d85-8e34-036c09d5230b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a80535e0abf467a8b7eba0a5ac9bca2)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:29.536754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55edf6e-2f20-4d85-8e34-036c09d5230b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:29.597484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f55edf6e-2f20-4d85-8e34-036c09d5230b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a80535e0abf467a8b7eba0a5ac9bca2', 'request_id': 'req-f55edf6e-2f20-4d85-8e34-036c09d5230b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:29.604377 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f55edf6e-2f20-4d85-8e34-036c09d5230b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a80535e0abf467a8b7eba0a5ac9bca2', 'request_id': 'req-f55edf6e-2f20-4d85-8e34-036c09d5230b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:29.610704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f55edf6e-2f20-4d85-8e34-036c09d5230b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a80535e0abf467a8b7eba0a5ac9bca2', 'request_id': 'req-f55edf6e-2f20-4d85-8e34-036c09d5230b'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:29.624133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579d91f-ee9e-4467-842f-b73375739c7a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:29.626366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f55edf6e-2f20-4d85-8e34-036c09d5230b admin admin] The token cache is being invalidate because project 4a80535e0abf467a8b7eba0a5ac9bca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:39:29.626661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f55edf6e-2f20-4d85-8e34-036c09d5230b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:29.627346 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-f55edf6e-2f20-4d85-8e34-036c09d5230b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:29.629030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1252/2479] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:39:29 2022] DELETE /identity/v3/projects/4a80535e0abf467a8b7eba0a5ac9bca2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:29.634398 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ddaab-4511-4c53-a506-8e84cd45303e None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:29.634816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ddaab-4511-4c53-a506-8e84cd45303e None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:29.635282 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ddaab-4511-4c53-a506-8e84cd45303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:29.658320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:29.661379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-493ddaab-4511-4c53-a506-8e84cd45303e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:29.662634 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-493ddaab-4511-4c53-a506-8e84cd45303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:29.695998 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97516c0f-6c45-4afd-93ac-e30b241ce281 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:29.696616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516c0f-6c45-4afd-93ac-e30b241ce281 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:29.696900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516c0f-6c45-4afd-93ac-e30b241ce281 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:29.697180 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516c0f-6c45-4afd-93ac-e30b241ce281 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:29.699054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-97516c0f-6c45-4afd-93ac-e30b241ce281 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:29.735053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1253/2480] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:39:29.745441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b91185-5981-4531-a283-026adbaca65a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:29.745730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b91185-5981-4531-a283-026adbaca65a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:29.746014 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b91185-5981-4531-a283-026adbaca65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:29.766472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a5b91185-5981-4531-a283-026adbaca65a None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:29.767753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a5b91185-5981-4531-a283-026adbaca65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:29.768462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97516c0f-6c45-4afd-93ac-e30b241ce281 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:29.770110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97516c0f-6c45-4afd-93ac-e30b241ce281 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:29.776484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1254/2481] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:39:29.778556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1228/2482] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:39:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 16:39:29.780701 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b91185-5981-4531-a283-026adbaca65a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:29.790998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b91185-5981-4531-a283-026adbaca65a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:29.795663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42400dae-13ea-487a-97ba-e3c7f5c1ca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:29.796310 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400dae-13ea-487a-97ba-e3c7f5c1ca3d admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:29.796589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400dae-13ea-487a-97ba-e3c7f5c1ca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:29.796868 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42400dae-13ea-487a-97ba-e3c7f5c1ca3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:29.797919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42400dae-13ea-487a-97ba-e3c7f5c1ca3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:39:29.798228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42400dae-13ea-487a-97ba-e3c7f5c1ca3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:29.806568 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42400dae-13ea-487a-97ba-e3c7f5c1ca3d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:29.832488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1255/2483] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:39:29.837037 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97516c0f-6c45-4afd-93ac-e30b241ce281 service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:29.852815 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97516c0f-6c45-4afd-93ac-e30b241ce281 service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:29.857679 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a324b-7b91-41a0-87b9-0feac93f92cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:29.858299 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a324b-7b91-41a0-87b9-0feac93f92cb admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:29.858579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a324b-7b91-41a0-87b9-0feac93f92cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:29.858856 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a324b-7b91-41a0-87b9-0feac93f92cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:29.861049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a324b-7b91-41a0-87b9-0feac93f92cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:29.864647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a324b-7b91-41a0-87b9-0feac93f92cb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:29.908204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1229/2484] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:39:29 2022] POST /identity/v3/projects => generated 403 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:29.913367 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42400dae-13ea-487a-97ba-e3c7f5c1ca3d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:29.928790 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42400dae-13ea-487a-97ba-e3c7f5c1ca3d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:29.994174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:30.017003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f903be7-b734-4c23-b057-8e66ef8278c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:30.018157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903be7-b734-4c23-b057-8e66ef8278c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:30.018781 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903be7-b734-4c23-b057-8e66ef8278c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:30.019181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903be7-b734-4c23-b057-8e66ef8278c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:30.020282 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f903be7-b734-4c23-b057-8e66ef8278c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:30.022249 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f903be7-b734-4c23-b057-8e66ef8278c6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:30.079125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1256/2485] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:39:29 2022] POST /identity/v3/users => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:30.083654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a324b-7b91-41a0-87b9-0feac93f92cb admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:30.101703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a324b-7b91-41a0-87b9-0feac93f92cb admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:30.109658 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada9f53-ec50-430f-8d1b-cf43615881ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:30.110491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada9f53-ec50-430f-8d1b-cf43615881ff admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:30.110781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada9f53-ec50-430f-8d1b-cf43615881ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:30.111065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada9f53-ec50-430f-8d1b-cf43615881ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:30.111809 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada9f53-ec50-430f-8d1b-cf43615881ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:30.114863 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada9f53-ec50-430f-8d1b-cf43615881ff admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:30.131208 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1230/2486] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:39:30.132547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f903be7-b734-4c23-b057-8e66ef8278c6 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:30.147092 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f903be7-b734-4c23-b057-8e66ef8278c6 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:30.155633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3ea69-7ed3-40ae-9deb-207be9e16ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:30.156310 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3ea69-7ed3-40ae-9deb-207be9e16ace admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:30.157133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3ea69-7ed3-40ae-9deb-207be9e16ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:30.157410 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3ea69-7ed3-40ae-9deb-207be9e16ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:30.158123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3ea69-7ed3-40ae-9deb-207be9e16ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:30.160322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3ea69-7ed3-40ae-9deb-207be9e16ace admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:30.175796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1257/2487] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:39:30.181977 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada9f53-ec50-430f-8d1b-cf43615881ff admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:30.194752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada9f53-ec50-430f-8d1b-cf43615881ff admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:30.200720 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0f62b-b1c3-4755-bae9-b456dc816076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:30.201529 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0f62b-b1c3-4755-bae9-b456dc816076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:30.202213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0f62b-b1c3-4755-bae9-b456dc816076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:30.202630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0f62b-b1c3-4755-bae9-b456dc816076 admin admin] PATH_INFO: `/v3/projects/2589f79b5c274ffea58370c5ec2942eb/users/f81591f708604a238b79c999f755086a/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:30.227914 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0f62b-b1c3-4755-bae9-b456dc816076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2589f79b5c274ffea58370c5ec2942eb, user_id=f81591f708604a238b79c999f755086a, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:30.231005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0f62b-b1c3-4755-bae9-b456dc816076 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:30.253662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1231/2488] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:39:30 2022] PUT /identity/v3/projects/2589f79b5c274ffea58370c5ec2942eb/users/f81591f708604a238b79c999f755086a/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:30.259208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c17d13-6c1a-4d43-a4b7-8ed92756397d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:30.259560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c17d13-6c1a-4d43-a4b7-8ed92756397d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:30.259852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c17d13-6c1a-4d43-a4b7-8ed92756397d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:30.314822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-82c17d13-6c1a-4d43-a4b7-8ed92756397d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:30.316981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-82c17d13-6c1a-4d43-a4b7-8ed92756397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:30.446151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1258/2489] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:30.459990 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0f62b-b1c3-4755-bae9-b456dc816076 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:30.462431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-78e0f62b-b1c3-4755-bae9-b456dc816076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:30.550677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0f62b-b1c3-4755-bae9-b456dc816076 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:30.563696 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31922d00-4339-4b93-9aac-aeb7b4da1111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:30.564500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31922d00-4339-4b93-9aac-aeb7b4da1111 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:30.564888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31922d00-4339-4b93-9aac-aeb7b4da1111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:30.565264 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31922d00-4339-4b93-9aac-aeb7b4da1111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:30.580109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31922d00-4339-4b93-9aac-aeb7b4da1111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:30.581794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31922d00-4339-4b93-9aac-aeb7b4da1111 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:30.593553 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1232/2490] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:31.539808 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d911b-2a53-4eb6-9215-58b5f180bde8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:31.540392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d911b-2a53-4eb6-9215-58b5f180bde8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:31.540392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d911b-2a53-4eb6-9215-58b5f180bde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:31.579416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-fd3d911b-2a53-4eb6-9215-58b5f180bde8 None None] MFA Rules not processed for user `f81591f708604a238b79c999f755086a`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:31.580758 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fd3d911b-2a53-4eb6-9215-58b5f180bde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:31.675183 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1259/2491] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:31.680870 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31922d00-4339-4b93-9aac-aeb7b4da1111 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:31.696503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31922d00-4339-4b93-9aac-aeb7b4da1111 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:31.704884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04726bf2-2185-4700-a459-e6067eb99309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:31.704884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04726bf2-2185-4700-a459-e6067eb99309 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:31.704884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04726bf2-2185-4700-a459-e6067eb99309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:31.704884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04726bf2-2185-4700-a459-e6067eb99309 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:31.705318 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04726bf2-2185-4700-a459-e6067eb99309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:31.707240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04726bf2-2185-4700-a459-e6067eb99309 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:31.731397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:31.758123 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1233/2492] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:39:31 2022] POST /identity/v3/projects => generated 403 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:31.759046 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d911b-2a53-4eb6-9215-58b5f180bde8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:31.771821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d911b-2a53-4eb6-9215-58b5f180bde8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:31.836751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:31.844343 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411df292-4127-4c05-9c92-045956ceaf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:31.845727 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411df292-4127-4c05-9c92-045956ceaf6a admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:31.846105 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411df292-4127-4c05-9c92-045956ceaf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:31.846489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411df292-4127-4c05-9c92-045956ceaf6a admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:31.847281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411df292-4127-4c05-9c92-045956ceaf6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:31.849858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411df292-4127-4c05-9c92-045956ceaf6a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:31.888478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1260/2493] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:39:31 2022] POST /identity/v3/users => generated 308 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:31.892844 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04726bf2-2185-4700-a459-e6067eb99309 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:31.904843 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04726bf2-2185-4700-a459-e6067eb99309 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:31.911429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc328a-df63-43fa-8576-2baa9a7ed8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:31.912305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc328a-df63-43fa-8576-2baa9a7ed8fd admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:31.912750 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc328a-df63-43fa-8576-2baa9a7ed8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:31.913200 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc328a-df63-43fa-8576-2baa9a7ed8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:31.914077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc328a-df63-43fa-8576-2baa9a7ed8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:31.918221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc328a-df63-43fa-8576-2baa9a7ed8fd admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:31.933060 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1234/2494] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:39:31.937008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411df292-4127-4c05-9c92-045956ceaf6a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:31.951813 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411df292-4127-4c05-9c92-045956ceaf6a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:31.958534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58f849-b9ab-4109-83b5-b75de4fc14b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:31.959384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58f849-b9ab-4109-83b5-b75de4fc14b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:31.959684 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58f849-b9ab-4109-83b5-b75de4fc14b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:31.959995 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58f849-b9ab-4109-83b5-b75de4fc14b8 admin admin] PATH_INFO: `/v3/projects/d3feb6b6af3a4d4e9420f785e30f26d6/users/e3c61eff6edb45f98c2e1a70e067ca05/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:31.982434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58f849-b9ab-4109-83b5-b75de4fc14b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3feb6b6af3a4d4e9420f785e30f26d6, user_id=e3c61eff6edb45f98c2e1a70e067ca05, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:31.990111 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58f849-b9ab-4109-83b5-b75de4fc14b8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:32.011711 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1261/2495] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:39:31 2022] PUT /identity/v3/projects/d3feb6b6af3a4d4e9420f785e30f26d6/users/e3c61eff6edb45f98c2e1a70e067ca05/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:32.015345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc328a-df63-43fa-8576-2baa9a7ed8fd admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:32.027272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc328a-df63-43fa-8576-2baa9a7ed8fd admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:32.104484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7093de-f956-46fd-ac81-545792b900c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:32.105122 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7093de-f956-46fd-ac81-545792b900c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:32.105411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7093de-f956-46fd-ac81-545792b900c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:32.105688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7093de-f956-46fd-ac81-545792b900c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:32.106416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7093de-f956-46fd-ac81-545792b900c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:32.108059 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7093de-f956-46fd-ac81-545792b900c0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:32.126645 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1235/2496] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:39:32.128411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58f849-b9ab-4109-83b5-b75de4fc14b8 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:32.142663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58f849-b9ab-4109-83b5-b75de4fc14b8 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:32.147497 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5250b-07ac-4968-8219-fa2821f62010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:32.148222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5250b-07ac-4968-8219-fa2821f62010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:32.148504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5250b-07ac-4968-8219-fa2821f62010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:32.148777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5250b-07ac-4968-8219-fa2821f62010 admin admin] PATH_INFO: `/v3/projects/d3feb6b6af3a4d4e9420f785e30f26d6/users/e3c61eff6edb45f98c2e1a70e067ca05/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:32.150765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5250b-07ac-4968-8219-fa2821f62010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3feb6b6af3a4d4e9420f785e30f26d6, user_id=e3c61eff6edb45f98c2e1a70e067ca05, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:32.153458 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5250b-07ac-4968-8219-fa2821f62010 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:32.167090 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1262/2497] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:39:32 2022] PUT /identity/v3/projects/d3feb6b6af3a4d4e9420f785e30f26d6/users/e3c61eff6edb45f98c2e1a70e067ca05/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:33.269146 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a865e5d-1a9d-4eef-b985-56d9723475b8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:33.270526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a865e5d-1a9d-4eef-b985-56d9723475b8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:33.270819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a865e5d-1a9d-4eef-b985-56d9723475b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:33.339350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3a865e5d-1a9d-4eef-b985-56d9723475b8 None None] MFA Rules not processed for user `e3c61eff6edb45f98c2e1a70e067ca05`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:33.340630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3a865e5d-1a9d-4eef-b985-56d9723475b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:33.477232 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1236/2498] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:34.839266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5250b-07ac-4968-8219-fa2821f62010 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:34.934191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5250b-07ac-4968-8219-fa2821f62010 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:34.939698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:34.940384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:34.940672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:34.941070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] PATH_INFO: `/v3/users/f81591f708604a238b79c999f755086a` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:34.942226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81591f708604a238b79c999f755086a)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:34.944530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:35.019485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81591f708604a238b79c999f755086a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.028773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81591f708604a238b79c999f755086a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.038442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81591f708604a238b79c999f755086a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.039160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81591f708604a238b79c999f755086a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.039820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81591f708604a238b79c999f755086a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.060798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1263/2499] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:39:34 2022] DELETE /identity/v3/users/f81591f708604a238b79c999f755086a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:35.255572 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a865e5d-1a9d-4eef-b985-56d9723475b8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:35.272713 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a865e5d-1a9d-4eef-b985-56d9723475b8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:35.349176 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:35.349976 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:35.350271 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:35.350560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] PATH_INFO: `/v3/projects/2589f79b5c274ffea58370c5ec2942eb` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:35.352171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2589f79b5c274ffea58370c5ec2942eb)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:35.354248 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:35.367327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:35.425768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2589f79b5c274ffea58370c5ec2942eb', 'request_id': 'req-371de2b5-6259-440f-826f-b15fb3e6c44f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.438970 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2589f79b5c274ffea58370c5ec2942eb', 'request_id': 'req-371de2b5-6259-440f-826f-b15fb3e6c44f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.446951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2589f79b5c274ffea58370c5ec2942eb', 'request_id': 'req-371de2b5-6259-440f-826f-b15fb3e6c44f'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.461014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] The token cache is being invalidate because project 2589f79b5c274ffea58370c5ec2942eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:39:35.461408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.463069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.464951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1237/2500] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:39:35 2022] DELETE /identity/v3/projects/2589f79b5c274ffea58370c5ec2942eb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:35.468853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:35.472272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:35.498640 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772687b-1ed2-4b02-a30f-b2e818842f5b admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:35.525722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:35.578742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ca6d4-f1d1-4084-9606-0f99d1fe4f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:35.580124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ca6d4-f1d1-4084-9606-0f99d1fe4f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:35.580414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ca6d4-f1d1-4084-9606-0f99d1fe4f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:35.580691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ca6d4-f1d1-4084-9606-0f99d1fe4f34 admin admin] PATH_INFO: `/v3/users/e3c61eff6edb45f98c2e1a70e067ca05` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:35.583759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ca6d4-f1d1-4084-9606-0f99d1fe4f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c61eff6edb45f98c2e1a70e067ca05)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:35.586019 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ca6d4-f1d1-4084-9606-0f99d1fe4f34 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:35.648202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-760ca6d4-f1d1-4084-9606-0f99d1fe4f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c61eff6edb45f98c2e1a70e067ca05'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.698765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-760ca6d4-f1d1-4084-9606-0f99d1fe4f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c61eff6edb45f98c2e1a70e067ca05'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.708617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-760ca6d4-f1d1-4084-9606-0f99d1fe4f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c61eff6edb45f98c2e1a70e067ca05'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.709399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-760ca6d4-f1d1-4084-9606-0f99d1fe4f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c61eff6edb45f98c2e1a70e067ca05'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.710068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-760ca6d4-f1d1-4084-9606-0f99d1fe4f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c61eff6edb45f98c2e1a70e067ca05'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:35.729742 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1264/2501] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:39:35 2022] DELETE /identity/v3/users/e3c61eff6edb45f98c2e1a70e067ca05 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:35.941561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:35.943150 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:35.990847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371de2b5-6259-440f-826f-b15fb3e6c44f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:36.099079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:36.100024 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:36.101744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:36.101744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a admin admin] PATH_INFO: `/v3/projects/d3feb6b6af3a4d4e9420f785e30f26d6` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:36.102009 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3feb6b6af3a4d4e9420f785e30f26d6)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:36.104296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:36.182265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3feb6b6af3a4d4e9420f785e30f26d6', 'request_id': 'req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:36.192387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3feb6b6af3a4d4e9420f785e30f26d6', 'request_id': 'req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:36.201279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3feb6b6af3a4d4e9420f785e30f26d6', 'request_id': 'req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:36.219430 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a admin admin] The token cache is being invalidate because project d3feb6b6af3a4d4e9420f785e30f26d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:39:36.233919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:36.235953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8a4a3a0d-c4d0-4888-afd6-b243b8f4c84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:36.237714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1238/2502] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:39:35 2022] DELETE /identity/v3/projects/d3feb6b6af3a4d4e9420f785e30f26d6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:36.242597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266e3a6-33bd-4b86-8741-2ab78880024b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:36.243082 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266e3a6-33bd-4b86-8741-2ab78880024b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:36.243230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266e3a6-33bd-4b86-8741-2ab78880024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:36.269073 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-2266e3a6-33bd-4b86-8741-2ab78880024b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:36.269593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2266e3a6-33bd-4b86-8741-2ab78880024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:36.345147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1265/2503] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:39:36.353896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4316a-1b7f-415d-be6a-5e3d39bab0e2 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:36.354453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4316a-1b7f-415d-be6a-5e3d39bab0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:36.354674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4316a-1b7f-415d-be6a-5e3d39bab0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:36.381972 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5dd4316a-1b7f-415d-be6a-5e3d39bab0e2 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:36.383227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5dd4316a-1b7f-415d-be6a-5e3d39bab0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:36.397635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1239/2504] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:36.398830 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266e3a6-33bd-4b86-8741-2ab78880024b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:36.410569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266e3a6-33bd-4b86-8741-2ab78880024b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:36.415606 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba4701-133a-4a55-a637-55dbc5698980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:36.416276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba4701-133a-4a55-a637-55dbc5698980 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:36.416564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba4701-133a-4a55-a637-55dbc5698980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:36.416875 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba4701-133a-4a55-a637-55dbc5698980 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:36.417620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba4701-133a-4a55-a637-55dbc5698980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:39:36.418061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba4701-133a-4a55-a637-55dbc5698980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:36.419743 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba4701-133a-4a55-a637-55dbc5698980 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:36.436489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1266/2505] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:39:36.442327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4316a-1b7f-415d-be6a-5e3d39bab0e2 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:36.452962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4316a-1b7f-415d-be6a-5e3d39bab0e2 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:36.459957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05d402-c830-4f22-9df1-21c8ce64d8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:36.459957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05d402-c830-4f22-9df1-21c8ce64d8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:36.460501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05d402-c830-4f22-9df1-21c8ce64d8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:36.460591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05d402-c830-4f22-9df1-21c8ce64d8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:36.461911 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05d402-c830-4f22-9df1-21c8ce64d8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:36.463227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05d402-c830-4f22-9df1-21c8ce64d8a0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:36.482902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:36.500374 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1240/2506] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:39:36 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:36.505228 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba4701-133a-4a55-a637-55dbc5698980 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:36.516172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba4701-133a-4a55-a637-55dbc5698980 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:36.544971 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:36.582773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444073c8-e734-4073-bf0e-76cad1aa9184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:36.583436 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444073c8-e734-4073-bf0e-76cad1aa9184 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:36.583699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444073c8-e734-4073-bf0e-76cad1aa9184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:36.584150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444073c8-e734-4073-bf0e-76cad1aa9184 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:36.584828 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444073c8-e734-4073-bf0e-76cad1aa9184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:36.587067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444073c8-e734-4073-bf0e-76cad1aa9184 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:36.616034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1267/2507] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:39:36 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:39:36.619016 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05d402-c830-4f22-9df1-21c8ce64d8a0 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:36.635035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05d402-c830-4f22-9df1-21c8ce64d8a0 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:36.641383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da1ebb-889b-4b37-9195-16da2e79833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:36.642352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da1ebb-889b-4b37-9195-16da2e79833e admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:36.642701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da1ebb-889b-4b37-9195-16da2e79833e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:36.643068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da1ebb-889b-4b37-9195-16da2e79833e admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:36.643842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da1ebb-889b-4b37-9195-16da2e79833e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:36.646086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da1ebb-889b-4b37-9195-16da2e79833e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:36.661987 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1241/2508] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:39:36.663126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444073c8-e734-4073-bf0e-76cad1aa9184 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:36.675578 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444073c8-e734-4073-bf0e-76cad1aa9184 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:36.680518 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a472d6-25fe-4093-9c3a-3840bb1a2478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:36.681146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a472d6-25fe-4093-9c3a-3840bb1a2478 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:36.681435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a472d6-25fe-4093-9c3a-3840bb1a2478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:36.681721 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a472d6-25fe-4093-9c3a-3840bb1a2478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:36.682662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a472d6-25fe-4093-9c3a-3840bb1a2478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:36.684378 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a472d6-25fe-4093-9c3a-3840bb1a2478 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:36.699783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1268/2509] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:39:36.701540 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da1ebb-889b-4b37-9195-16da2e79833e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:36.713313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da1ebb-889b-4b37-9195-16da2e79833e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:36.718687 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652d421-428f-4f76-a1c5-ca3b3ca75c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:36.720035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d421-428f-4f76-a1c5-ca3b3ca75c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:36.720379 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d421-428f-4f76-a1c5-ca3b3ca75c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:36.720782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d421-428f-4f76-a1c5-ca3b3ca75c7c admin admin] PATH_INFO: `/v3/projects/fa1f1d80ee234aceb796d084a6c645ac/users/17ee7ee9c636435c9ee1f90aa86054d7/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:36.737507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652d421-428f-4f76-a1c5-ca3b3ca75c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1f1d80ee234aceb796d084a6c645ac, user_id=17ee7ee9c636435c9ee1f90aa86054d7, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:36.740167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652d421-428f-4f76-a1c5-ca3b3ca75c7c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:36.756498 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1242/2510] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:39:36 2022] PUT /identity/v3/projects/fa1f1d80ee234aceb796d084a6c645ac/users/17ee7ee9c636435c9ee1f90aa86054d7/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:36.767272 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad58316-1f38-43fe-803a-b3d2387b48da None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:36.767662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad58316-1f38-43fe-803a-b3d2387b48da None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:36.767979 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad58316-1f38-43fe-803a-b3d2387b48da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:36.801226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6ad58316-1f38-43fe-803a-b3d2387b48da None None] MFA Rules not processed for user `17ee7ee9c636435c9ee1f90aa86054d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:36.802730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6ad58316-1f38-43fe-803a-b3d2387b48da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:36.882820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1269/2511] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:36.884438 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652d421-428f-4f76-a1c5-ca3b3ca75c7c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:36.954205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652d421-428f-4f76-a1c5-ca3b3ca75c7c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:36.959441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548513b-bf05-4192-abd7-4e6bb839c7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:36.960444 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548513b-bf05-4192-abd7-4e6bb839c7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:36.960832 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548513b-bf05-4192-abd7-4e6bb839c7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:36.961209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548513b-bf05-4192-abd7-4e6bb839c7c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:36.961968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548513b-bf05-4192-abd7-4e6bb839c7c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:36.964132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548513b-bf05-4192-abd7-4e6bb839c7c4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:36.998041 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad58316-1f38-43fe-803a-b3d2387b48da None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:37.005606 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1243/2512] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:39:36 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:37.010639 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad58316-1f38-43fe-803a-b3d2387b48da None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:37.075534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cb6af-627a-4c3b-87fe-478fd1d279a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:37.076195 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cb6af-627a-4c3b-87fe-478fd1d279a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:37.076487 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cb6af-627a-4c3b-87fe-478fd1d279a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:37.076771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cb6af-627a-4c3b-87fe-478fd1d279a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:37.077470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cb6af-627a-4c3b-87fe-478fd1d279a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:37.079939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cb6af-627a-4c3b-87fe-478fd1d279a5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:37.104675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1270/2513] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:39:36 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:37.108566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548513b-bf05-4192-abd7-4e6bb839c7c4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:37.121047 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548513b-bf05-4192-abd7-4e6bb839c7c4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:37.127718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32971203-19f4-48cc-9bd4-863b0f76457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:37.128598 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971203-19f4-48cc-9bd4-863b0f76457b admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:37.129052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971203-19f4-48cc-9bd4-863b0f76457b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:37.129338 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971203-19f4-48cc-9bd4-863b0f76457b admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:37.130070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32971203-19f4-48cc-9bd4-863b0f76457b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:37.131660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32971203-19f4-48cc-9bd4-863b0f76457b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:37.144573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1244/2514] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:39:37.148615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cb6af-627a-4c3b-87fe-478fd1d279a5 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:37.160626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cb6af-627a-4c3b-87fe-478fd1d279a5 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:37.165508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bbb01-a869-46f2-86fc-ab4993c6876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:37.166194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bbb01-a869-46f2-86fc-ab4993c6876e admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:37.166656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bbb01-a869-46f2-86fc-ab4993c6876e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:37.166842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bbb01-a869-46f2-86fc-ab4993c6876e admin admin] PATH_INFO: `/v3/projects/a424cb0e1ece4327a6c1a368b4432775/users/da1399edf7e8488d975af0d75e643606/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:37.184252 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bbb01-a869-46f2-86fc-ab4993c6876e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a424cb0e1ece4327a6c1a368b4432775, user_id=da1399edf7e8488d975af0d75e643606, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:37.186973 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bbb01-a869-46f2-86fc-ab4993c6876e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:37.203205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1271/2515] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:39:37 2022] PUT /identity/v3/projects/a424cb0e1ece4327a6c1a368b4432775/users/da1399edf7e8488d975af0d75e643606/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:37.207925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32971203-19f4-48cc-9bd4-863b0f76457b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:37.220255 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32971203-19f4-48cc-9bd4-863b0f76457b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:37.293566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210e31d-018e-457a-bd10-60d44f31ecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:37.294473 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210e31d-018e-457a-bd10-60d44f31ecd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:37.294908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210e31d-018e-457a-bd10-60d44f31ecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:37.295256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210e31d-018e-457a-bd10-60d44f31ecd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:37.296093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210e31d-018e-457a-bd10-60d44f31ecd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:37.298963 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210e31d-018e-457a-bd10-60d44f31ecd7 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:37.311959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1245/2516] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:39:37.315032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bbb01-a869-46f2-86fc-ab4993c6876e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:37.321859 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:37.330366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bbb01-a869-46f2-86fc-ab4993c6876e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:37.337781 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9d399-31e8-4dae-9649-9b8a3ad83934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:37.338672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9d399-31e8-4dae-9649-9b8a3ad83934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:37.339137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9d399-31e8-4dae-9649-9b8a3ad83934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:37.339578 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9d399-31e8-4dae-9649-9b8a3ad83934 admin admin] PATH_INFO: `/v3/projects/a424cb0e1ece4327a6c1a368b4432775/users/da1399edf7e8488d975af0d75e643606/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:37.343252 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9d399-31e8-4dae-9649-9b8a3ad83934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a424cb0e1ece4327a6c1a368b4432775, user_id=da1399edf7e8488d975af0d75e643606, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:37.354404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9d399-31e8-4dae-9649-9b8a3ad83934 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:37.367557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1272/2517] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:39:37 2022] PUT /identity/v3/projects/a424cb0e1ece4327a6c1a368b4432775/users/da1399edf7e8488d975af0d75e643606/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:37.382321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557b656-b0cb-4826-9e53-bca56dce759b None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:37.383313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557b656-b0cb-4826-9e53-bca56dce759b None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:37.383617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557b656-b0cb-4826-9e53-bca56dce759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:37.419620 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-6557b656-b0cb-4826-9e53-bca56dce759b None None] MFA Rules not processed for user `da1399edf7e8488d975af0d75e643606`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:37.421509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6557b656-b0cb-4826-9e53-bca56dce759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:37.442801 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:37.512191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1246/2518] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:37 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:37.525205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9d399-31e8-4dae-9649-9b8a3ad83934 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:37.527154 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e8f9d399-31e8-4dae-9649-9b8a3ad83934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:37.601673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9d399-31e8-4dae-9649-9b8a3ad83934 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:37.606412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01526ca4-68dd-4660-be12-0e6a8b29a4ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:37.607510 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01526ca4-68dd-4660-be12-0e6a8b29a4ca service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:37.608081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01526ca4-68dd-4660-be12-0e6a8b29a4ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:37.608415 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01526ca4-68dd-4660-be12-0e6a8b29a4ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:37.620994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01526ca4-68dd-4660-be12-0e6a8b29a4ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:37.622600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01526ca4-68dd-4660-be12-0e6a8b29a4ca service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:37.633850 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1273/2519] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:37 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:37.685143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557b656-b0cb-4826-9e53-bca56dce759b None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:37.686667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6557b656-b0cb-4826-9e53-bca56dce759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:37.699415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557b656-b0cb-4826-9e53-bca56dce759b None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:37.703920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df68dae-8da1-478a-9e56-da2d9f89a960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:37.704790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df68dae-8da1-478a-9e56-da2d9f89a960 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:37.705403 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df68dae-8da1-478a-9e56-da2d9f89a960 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:37.705403 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df68dae-8da1-478a-9e56-da2d9f89a960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:37.768853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df68dae-8da1-478a-9e56-da2d9f89a960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:37.770364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df68dae-8da1-478a-9e56-da2d9f89a960 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:37.783268 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1247/2520] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:38.452643 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01526ca4-68dd-4660-be12-0e6a8b29a4ca service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:38.455375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-01526ca4-68dd-4660-be12-0e6a8b29a4ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:38.551146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01526ca4-68dd-4660-be12-0e6a8b29a4ca service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:38.557192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639e21c-b40a-4f9f-aadf-f831a9edfc90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:38.557853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639e21c-b40a-4f9f-aadf-f831a9edfc90 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:38.558143 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639e21c-b40a-4f9f-aadf-f831a9edfc90 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:38.558418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639e21c-b40a-4f9f-aadf-f831a9edfc90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:38.560378 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6639e21c-b40a-4f9f-aadf-f831a9edfc90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:38.648362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639e21c-b40a-4f9f-aadf-f831a9edfc90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:38.650697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639e21c-b40a-4f9f-aadf-f831a9edfc90 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:38.665237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1274/2521] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:41.473462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df68dae-8da1-478a-9e56-da2d9f89a960 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:41.556010 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df68dae-8da1-478a-9e56-da2d9f89a960 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:41.561297 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:41.561966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:41.562259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:41.562540 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] PATH_INFO: `/v3/users/17ee7ee9c636435c9ee1f90aa86054d7` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:41.563826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17ee7ee9c636435c9ee1f90aa86054d7)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:41.565863 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:41.614014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17ee7ee9c636435c9ee1f90aa86054d7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:41.621471 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17ee7ee9c636435c9ee1f90aa86054d7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:41.623322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:41.635286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17ee7ee9c636435c9ee1f90aa86054d7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:41.636021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17ee7ee9c636435c9ee1f90aa86054d7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:41.636670 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17ee7ee9c636435c9ee1f90aa86054d7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:41.659093 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1248/2522] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:39:41 2022] DELETE /identity/v3/users/17ee7ee9c636435c9ee1f90aa86054d7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:41.663663 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356e0c5-e91b-4250-b71f-2e0e9290efa8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:41.664119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356e0c5-e91b-4250-b71f-2e0e9290efa8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:41.664276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356e0c5-e91b-4250-b71f-2e0e9290efa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:41.686273 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-6356e0c5-e91b-4250-b71f-2e0e9290efa8 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:41.687767 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6356e0c5-e91b-4250-b71f-2e0e9290efa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:41.719422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:41.769800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1275/2523] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:41.780260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:41.782847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:41.846442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac76cd-3a6e-4320-b2b0-1bfd9bfcd2c4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:41.850779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f6786-34c5-4ae5-be97-fce9e9c89aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:41.851452 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f6786-34c5-4ae5-be97-fce9e9c89aea service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:41.851739 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f6786-34c5-4ae5-be97-fce9e9c89aea service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:41.852056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f6786-34c5-4ae5-be97-fce9e9c89aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:41.863593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f6786-34c5-4ae5-be97-fce9e9c89aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:41.865121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f6786-34c5-4ae5-be97-fce9e9c89aea service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:41.875285 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1249/2524] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:42.154037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356e0c5-e91b-4250-b71f-2e0e9290efa8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:42.155608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-6356e0c5-e91b-4250-b71f-2e0e9290efa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:42.168348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356e0c5-e91b-4250-b71f-2e0e9290efa8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:42.173799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:42.174475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:42.174787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:42.175069 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] PATH_INFO: `/v3/projects/fa1f1d80ee234aceb796d084a6c645ac` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:42.176312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1f1d80ee234aceb796d084a6c645ac)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:42.178248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:42.229581 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1f1d80ee234aceb796d084a6c645ac', 'request_id': 'req-936ff339-2bda-4b3b-bae5-a79c15615476'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.236750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1f1d80ee234aceb796d084a6c645ac', 'request_id': 'req-936ff339-2bda-4b3b-bae5-a79c15615476'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.242335 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1f1d80ee234aceb796d084a6c645ac', 'request_id': 'req-936ff339-2bda-4b3b-bae5-a79c15615476'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.256924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] The token cache is being invalidate because project fa1f1d80ee234aceb796d084a6c645ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:39:42.257202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.257928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.262475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1276/2525] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:39:42 2022] DELETE /identity/v3/projects/fa1f1d80ee234aceb796d084a6c645ac => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:42.263525 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f6786-34c5-4ae5-be97-fce9e9c89aea service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:42.274107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f6786-34c5-4ae5-be97-fce9e9c89aea service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:42.354114 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ff184-41f0-453d-9dae-2cc9e71ee29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:42.354788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ff184-41f0-453d-9dae-2cc9e71ee29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:42.355068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ff184-41f0-453d-9dae-2cc9e71ee29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:42.355343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ff184-41f0-453d-9dae-2cc9e71ee29c admin admin] PATH_INFO: `/v3/users/da1399edf7e8488d975af0d75e643606` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:42.356529 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ff184-41f0-453d-9dae-2cc9e71ee29c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da1399edf7e8488d975af0d75e643606)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:42.358442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ff184-41f0-453d-9dae-2cc9e71ee29c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:42.408888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0c3ff184-41f0-453d-9dae-2cc9e71ee29c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da1399edf7e8488d975af0d75e643606'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.415781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0c3ff184-41f0-453d-9dae-2cc9e71ee29c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da1399edf7e8488d975af0d75e643606'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.424480 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0c3ff184-41f0-453d-9dae-2cc9e71ee29c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da1399edf7e8488d975af0d75e643606'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.425122 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0c3ff184-41f0-453d-9dae-2cc9e71ee29c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da1399edf7e8488d975af0d75e643606'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.425737 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0c3ff184-41f0-453d-9dae-2cc9e71ee29c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da1399edf7e8488d975af0d75e643606'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.437309 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:42.447380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1250/2526] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:39:42 2022] DELETE /identity/v3/users/da1399edf7e8488d975af0d75e643606 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:42.731782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:42.734034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:42.762549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff339-2bda-4b3b-bae5-a79c15615476 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:42.821803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc919a-c896-44e2-8b23-32112700448e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:42.822463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc919a-c896-44e2-8b23-32112700448e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:42.822753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc919a-c896-44e2-8b23-32112700448e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:42.823034 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc919a-c896-44e2-8b23-32112700448e admin admin] PATH_INFO: `/v3/projects/a424cb0e1ece4327a6c1a368b4432775` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:42.824491 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc919a-c896-44e2-8b23-32112700448e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a424cb0e1ece4327a6c1a368b4432775)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:42.826800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc919a-c896-44e2-8b23-32112700448e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:42.874952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cfcc919a-c896-44e2-8b23-32112700448e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a424cb0e1ece4327a6c1a368b4432775', 'request_id': 'req-cfcc919a-c896-44e2-8b23-32112700448e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.881105 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cfcc919a-c896-44e2-8b23-32112700448e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a424cb0e1ece4327a6c1a368b4432775', 'request_id': 'req-cfcc919a-c896-44e2-8b23-32112700448e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.882386 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:42.889126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cfcc919a-c896-44e2-8b23-32112700448e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a424cb0e1ece4327a6c1a368b4432775', 'request_id': 'req-cfcc919a-c896-44e2-8b23-32112700448e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.901713 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cfcc919a-c896-44e2-8b23-32112700448e admin admin] The token cache is being invalidate because project a424cb0e1ece4327a6c1a368b4432775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:39:42.902005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cfcc919a-c896-44e2-8b23-32112700448e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.902635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cfcc919a-c896-44e2-8b23-32112700448e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:42.904204 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1277/2527] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:39:42 2022] DELETE /identity/v3/projects/a424cb0e1ece4327a6c1a368b4432775 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:42.909671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1236643-e05e-46bc-a414-ca89eb0f87f9 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:42.910164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1236643-e05e-46bc-a414-ca89eb0f87f9 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:42.910275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1236643-e05e-46bc-a414-ca89eb0f87f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:42.930417 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c1236643-e05e-46bc-a414-ca89eb0f87f9 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:42.931656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c1236643-e05e-46bc-a414-ca89eb0f87f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:42.991882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1251/2528] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:42.999878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b65527-7c19-449c-8087-c88675870a40 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.000191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b65527-7c19-449c-8087-c88675870a40 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.000553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b65527-7c19-449c-8087-c88675870a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.021052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-14b65527-7c19-449c-8087-c88675870a40 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:43.022275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-14b65527-7c19-449c-8087-c88675870a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:43.030248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1278/2529] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:43.035520 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1236643-e05e-46bc-a414-ca89eb0f87f9 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:43.045198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1236643-e05e-46bc-a414-ca89eb0f87f9 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:43.049981 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ab66d-c34e-4761-9b7f-2544127ddd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:43.050587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab66d-c34e-4761-9b7f-2544127ddd14 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.050871 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab66d-c34e-4761-9b7f-2544127ddd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.051145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab66d-c34e-4761-9b7f-2544127ddd14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.051830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ab66d-c34e-4761-9b7f-2544127ddd14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:39:43.052162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ab66d-c34e-4761-9b7f-2544127ddd14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:43.053747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ab66d-c34e-4761-9b7f-2544127ddd14 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:43.065292 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1252/2530] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:39:43.070023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b65527-7c19-449c-8087-c88675870a40 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:43.080205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b65527-7c19-449c-8087-c88675870a40 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:43.085594 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b18e7a-a4e5-4016-83c2-5a8f1fe072ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:43.086218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b18e7a-a4e5-4016-83c2-5a8f1fe072ce admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.086507 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b18e7a-a4e5-4016-83c2-5a8f1fe072ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.086787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b18e7a-a4e5-4016-83c2-5a8f1fe072ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.087454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b18e7a-a4e5-4016-83c2-5a8f1fe072ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:43.089403 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b18e7a-a4e5-4016-83c2-5a8f1fe072ce admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:43.117834 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1279/2531] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:39:43 2022] POST /identity/v3/projects => generated 409 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:39:43.121936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ab66d-c34e-4761-9b7f-2544127ddd14 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:43.132283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ab66d-c34e-4761-9b7f-2544127ddd14 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:43.194630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5ed82-7b2b-44e6-9022-6e55080b7cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:43.195259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5ed82-7b2b-44e6-9022-6e55080b7cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.195549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5ed82-7b2b-44e6-9022-6e55080b7cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.195830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5ed82-7b2b-44e6-9022-6e55080b7cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.196561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5ed82-7b2b-44e6-9022-6e55080b7cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:43.198481 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5ed82-7b2b-44e6-9022-6e55080b7cb0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:43.220915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1253/2532] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:39:43 2022] POST /identity/v3/users => generated 305 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:39:43.225142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b18e7a-a4e5-4016-83c2-5a8f1fe072ce admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:43.236093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b18e7a-a4e5-4016-83c2-5a8f1fe072ce admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:43.240741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a42996-9aa4-49ce-8428-2bb2a3feac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:43.241352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42996-9aa4-49ce-8428-2bb2a3feac09 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.241636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42996-9aa4-49ce-8428-2bb2a3feac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.241965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42996-9aa4-49ce-8428-2bb2a3feac09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.242606 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a42996-9aa4-49ce-8428-2bb2a3feac09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:43.244240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a42996-9aa4-49ce-8428-2bb2a3feac09 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:43.255052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1280/2533] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:39:43.258997 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5ed82-7b2b-44e6-9022-6e55080b7cb0 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:43.269556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5ed82-7b2b-44e6-9022-6e55080b7cb0 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:43.274314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95902697-9d7d-4d70-a9d3-40473819d63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:43.274929 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95902697-9d7d-4d70-a9d3-40473819d63a admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.275214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95902697-9d7d-4d70-a9d3-40473819d63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.275493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95902697-9d7d-4d70-a9d3-40473819d63a admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.276226 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95902697-9d7d-4d70-a9d3-40473819d63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:43.277820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95902697-9d7d-4d70-a9d3-40473819d63a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:43.289042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1254/2534] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:39:43.293409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a42996-9aa4-49ce-8428-2bb2a3feac09 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:43.304471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a42996-9aa4-49ce-8428-2bb2a3feac09 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:43.309416 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e15620-4a59-460b-ae3e-2b392ee58df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:43.309957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e15620-4a59-460b-ae3e-2b392ee58df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.310244 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e15620-4a59-460b-ae3e-2b392ee58df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.310527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e15620-4a59-460b-ae3e-2b392ee58df1 admin admin] PATH_INFO: `/v3/projects/d2a5e60a0e014bb7a2d95c5f0827b6e5/users/baff0d4e26874f6892fb9a32ecd4ad37/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.326512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e15620-4a59-460b-ae3e-2b392ee58df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a5e60a0e014bb7a2d95c5f0827b6e5, user_id=baff0d4e26874f6892fb9a32ecd4ad37, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:43.329717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e15620-4a59-460b-ae3e-2b392ee58df1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:43.342957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1281/2535] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:39:43 2022] PUT /identity/v3/projects/d2a5e60a0e014bb7a2d95c5f0827b6e5/users/baff0d4e26874f6892fb9a32ecd4ad37/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:43.353966 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e28f51-f61e-4568-a558-177838d00789 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.354252 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e28f51-f61e-4568-a558-177838d00789 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.354527 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e28f51-f61e-4568-a558-177838d00789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.383106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f7e28f51-f61e-4568-a558-177838d00789 None None] MFA Rules not processed for user `baff0d4e26874f6892fb9a32ecd4ad37`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:43.384347 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f7e28f51-f61e-4568-a558-177838d00789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:43.431819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:43.449526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1255/2536] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:43.454153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e15620-4a59-460b-ae3e-2b392ee58df1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:43.520664 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e15620-4a59-460b-ae3e-2b392ee58df1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:43.525406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe951315-0369-4caf-b540-fca52041495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:43.526027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe951315-0369-4caf-b540-fca52041495a admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.526315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe951315-0369-4caf-b540-fca52041495a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.526601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe951315-0369-4caf-b540-fca52041495a admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.527283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe951315-0369-4caf-b540-fca52041495a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:43.529257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe951315-0369-4caf-b540-fca52041495a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:43.558886 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1282/2537] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:39:43 2022] POST /identity/v3/projects => generated 409 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:43.562613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e28f51-f61e-4568-a558-177838d00789 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:43.573982 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e28f51-f61e-4568-a558-177838d00789 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:43.644142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743bb84-c77f-493f-bf75-ba081f08c48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:43.644780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743bb84-c77f-493f-bf75-ba081f08c48d admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.646136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743bb84-c77f-493f-bf75-ba081f08c48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.646136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743bb84-c77f-493f-bf75-ba081f08c48d admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.646136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743bb84-c77f-493f-bf75-ba081f08c48d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:43.647968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743bb84-c77f-493f-bf75-ba081f08c48d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:43.670518 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1256/2538] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:39:43 2022] POST /identity/v3/users => generated 311 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:43.675590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe951315-0369-4caf-b540-fca52041495a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:43.687327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe951315-0369-4caf-b540-fca52041495a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:43.692500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af519fcb-56d0-4d94-94fa-02dd5d9d7e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:43.693126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af519fcb-56d0-4d94-94fa-02dd5d9d7e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.693412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af519fcb-56d0-4d94-94fa-02dd5d9d7e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.693688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af519fcb-56d0-4d94-94fa-02dd5d9d7e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.694388 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af519fcb-56d0-4d94-94fa-02dd5d9d7e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:43.696031 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af519fcb-56d0-4d94-94fa-02dd5d9d7e33 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:43.709219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1283/2539] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:39:43.713789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743bb84-c77f-493f-bf75-ba081f08c48d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:43.725144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743bb84-c77f-493f-bf75-ba081f08c48d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:43.730480 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932592c-aa9c-421d-bc97-c577ec483ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:43.731228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932592c-aa9c-421d-bc97-c577ec483ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.731586 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932592c-aa9c-421d-bc97-c577ec483ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.731973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932592c-aa9c-421d-bc97-c577ec483ca8 admin admin] PATH_INFO: `/v3/projects/8363c8488cf14161834c98641d6f718a/users/48a86469b8b444ed8fd167559ab75939/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.748818 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932592c-aa9c-421d-bc97-c577ec483ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8363c8488cf14161834c98641d6f718a, user_id=48a86469b8b444ed8fd167559ab75939, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:43.751541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932592c-aa9c-421d-bc97-c577ec483ca8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:43.765979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1257/2540] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:39:43 2022] PUT /identity/v3/projects/8363c8488cf14161834c98641d6f718a/users/48a86469b8b444ed8fd167559ab75939/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:43.770896 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af519fcb-56d0-4d94-94fa-02dd5d9d7e33 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:43.782682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af519fcb-56d0-4d94-94fa-02dd5d9d7e33 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:43.838739 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:43.850762 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72fb95-34fb-41e4-b12b-9a6df139473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:43.851662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72fb95-34fb-41e4-b12b-9a6df139473a admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.851986 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72fb95-34fb-41e4-b12b-9a6df139473a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.852302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72fb95-34fb-41e4-b12b-9a6df139473a admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.853022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72fb95-34fb-41e4-b12b-9a6df139473a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:43.854641 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72fb95-34fb-41e4-b12b-9a6df139473a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:43.868922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1284/2541] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:39:43.870350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932592c-aa9c-421d-bc97-c577ec483ca8 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:43.884999 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932592c-aa9c-421d-bc97-c577ec483ca8 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:43.890314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e406291-ce3e-47c2-acf8-4a43707fba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:43.891167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e406291-ce3e-47c2-acf8-4a43707fba8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.891500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e406291-ce3e-47c2-acf8-4a43707fba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.891985 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e406291-ce3e-47c2-acf8-4a43707fba8a admin admin] PATH_INFO: `/v3/projects/8363c8488cf14161834c98641d6f718a/users/48a86469b8b444ed8fd167559ab75939/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.894466 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e406291-ce3e-47c2-acf8-4a43707fba8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8363c8488cf14161834c98641d6f718a, user_id=48a86469b8b444ed8fd167559ab75939, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:43.897223 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e406291-ce3e-47c2-acf8-4a43707fba8a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:43.912746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1258/2542] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:39:43 2022] PUT /identity/v3/projects/8363c8488cf14161834c98641d6f718a/users/48a86469b8b444ed8fd167559ab75939/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:43.924322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300b84f-e0f2-474f-b0ca-ab6ed5458c33 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:43.924616 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300b84f-e0f2-474f-b0ca-ab6ed5458c33 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:43.924900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300b84f-e0f2-474f-b0ca-ab6ed5458c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:43.954777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c300b84f-e0f2-474f-b0ca-ab6ed5458c33 None None] MFA Rules not processed for user `48a86469b8b444ed8fd167559ab75939`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:43.956129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c300b84f-e0f2-474f-b0ca-ab6ed5458c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:44.037124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1285/2543] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:44.047921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e406291-ce3e-47c2-acf8-4a43707fba8a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:44.049686 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9e406291-ce3e-47c2-acf8-4a43707fba8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:44.113953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e406291-ce3e-47c2-acf8-4a43707fba8a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:44.117874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55737a3a-a390-4f90-8da1-8be24bf42504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:44.118502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55737a3a-a390-4f90-8da1-8be24bf42504 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:44.118784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55737a3a-a390-4f90-8da1-8be24bf42504 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:44.119061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55737a3a-a390-4f90-8da1-8be24bf42504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:44.129559 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55737a3a-a390-4f90-8da1-8be24bf42504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:44.130978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55737a3a-a390-4f90-8da1-8be24bf42504 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:44.140648 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1259/2544] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:44 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:44.342590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300b84f-e0f2-474f-b0ca-ab6ed5458c33 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:44.353991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300b84f-e0f2-474f-b0ca-ab6ed5458c33 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:44.358159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e1979-9286-4e8f-958b-8311804b7177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:44.358788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e1979-9286-4e8f-958b-8311804b7177 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:44.359080 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e1979-9286-4e8f-958b-8311804b7177 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:44.359364 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e1979-9286-4e8f-958b-8311804b7177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:44.430406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e1979-9286-4e8f-958b-8311804b7177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:44.431925 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e1979-9286-4e8f-958b-8311804b7177 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:44.441115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1286/2545] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:44.630235 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203ba2b-4e7a-4f19-87b9-d0d7ecf51b2a None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:44.630461 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203ba2b-4e7a-4f19-87b9-d0d7ecf51b2a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:44.630745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203ba2b-4e7a-4f19-87b9-d0d7ecf51b2a None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:44.635947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1260/2546] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:39:44.640267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551868-c2bd-4914-a7af-75d9e32ebd7a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:44.640566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551868-c2bd-4914-a7af-75d9e32ebd7a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:44.640855 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551868-c2bd-4914-a7af-75d9e32ebd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:44.676066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ed551868-c2bd-4914-a7af-75d9e32ebd7a None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:44.677955 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ed551868-c2bd-4914-a7af-75d9e32ebd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:44.779209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1287/2547] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:39:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:39:44.793688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203ba2b-4e7a-4f19-87b9-d0d7ecf51b2a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:44.795524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a203ba2b-4e7a-4f19-87b9-d0d7ecf51b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:44.859584 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:44.868594 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203ba2b-4e7a-4f19-87b9-d0d7ecf51b2a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:44.872415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbcdbc-4186-4307-bf29-e91c2ec41176 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1832d9988604b81bcb075ae77db6d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:44.873311 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbcdbc-4186-4307-bf29-e91c2ec41176 service glance] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:44.873601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbcdbc-4186-4307-bf29-e91c2ec41176 service glance] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:44.873875 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbcdbc-4186-4307-bf29-e91c2ec41176 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:44.885718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbcdbc-4186-4307-bf29-e91c2ec41176 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:44.887181 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbcdbc-4186-4307-bf29-e91c2ec41176 service glance] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:44.898898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1261/2548] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:44.968188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de4aca-8e52-49d1-a53a-00f159bff843 None None] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:44.968483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de4aca-8e52-49d1-a53a-00f159bff843 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:44.968775 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de4aca-8e52-49d1-a53a-00f159bff843 None None] PATH_INFO: `/` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:44.970735 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1288/2549] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:39:44.976325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc3fa8-32dc-4c68-bfeb-a4e1fee123ad None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:44.976847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc3fa8-32dc-4c68-bfeb-a4e1fee123ad None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:44.976946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc3fa8-32dc-4c68-bfeb-a4e1fee123ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:44.998767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-43fc3fa8-32dc-4c68-bfeb-a4e1fee123ad None None] MFA Rules not processed for user `73325bdd109749ad92a66e600fd61a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:45.000020 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-43fc3fa8-32dc-4c68-bfeb-a4e1fee123ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:45.051471 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1262/2550] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:39:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:45.063336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de4aca-8e52-49d1-a53a-00f159bff843 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:45.065101 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-81de4aca-8e52-49d1-a53a-00f159bff843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:45.074192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:45.079096 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de4aca-8e52-49d1-a53a-00f159bff843 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:45.083053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86d58a-8119-4df8-ad45-23cc024b9c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:45.083678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86d58a-8119-4df8-ad45-23cc024b9c45 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:45.083992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86d58a-8119-4df8-ad45-23cc024b9c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:45.084275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86d58a-8119-4df8-ad45-23cc024b9c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:45.091612 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86d58a-8119-4df8-ad45-23cc024b9c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:45.093077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86d58a-8119-4df8-ad45-23cc024b9c45 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:45.101469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1289/2551] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:45.187909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea46bb-aaca-453d-9a94-35e63e4b2173 None None] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:45.188796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea46bb-aaca-453d-9a94-35e63e4b2173 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:45.189101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea46bb-aaca-453d-9a94-35e63e4b2173 None None] PATH_INFO: `/` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:45.190496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1263/2552] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 16:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 16:39:45.196746 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f64cd8-2370-48b9-8fcf-51c724f9a1ff None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:45.197063 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f64cd8-2370-48b9-8fcf-51c724f9a1ff None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:45.197351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f64cd8-2370-48b9-8fcf-51c724f9a1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:45.220679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-12f64cd8-2370-48b9-8fcf-51c724f9a1ff None None] MFA Rules not processed for user `9d5a8ef373ca4ed7bf31361e24e42e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:45.222007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-12f64cd8-2370-48b9-8fcf-51c724f9a1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:45.231625 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1290/2553] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:45.243702 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea46bb-aaca-453d-9a94-35e63e4b2173 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:45.245536 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-edea46bb-aaca-453d-9a94-35e63e4b2173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:45.259853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea46bb-aaca-453d-9a94-35e63e4b2173 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:45.263562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317c18b-9db4-454d-bcf5-86db4e75b951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:45.264218 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317c18b-9db4-454d-bcf5-86db4e75b951 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:45.264498 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317c18b-9db4-454d-bcf5-86db4e75b951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:45.264774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317c18b-9db4-454d-bcf5-86db4e75b951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:45.276851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317c18b-9db4-454d-bcf5-86db4e75b951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:45.278281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317c18b-9db4-454d-bcf5-86db4e75b951 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:45.290414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1264/2554] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:45.353018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f64cd8-2370-48b9-8fcf-51c724f9a1ff None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:45.354413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-12f64cd8-2370-48b9-8fcf-51c724f9a1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:45.424991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f64cd8-2370-48b9-8fcf-51c724f9a1ff None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:45.430442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880cda1-b37d-477a-8c90-f26e15011bc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f602decb26be477b867493429352bd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:45.431067 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880cda1-b37d-477a-8c90-f26e15011bc2 service placement] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:45.431354 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880cda1-b37d-477a-8c90-f26e15011bc2 service placement] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:45.431632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880cda1-b37d-477a-8c90-f26e15011bc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:45.433529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2880cda1-b37d-477a-8c90-f26e15011bc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:45.446150 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880cda1-b37d-477a-8c90-f26e15011bc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:45.447780 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880cda1-b37d-477a-8c90-f26e15011bc2 service placement] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:45.458799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1291/2555] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:46.382212 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317c18b-9db4-454d-bcf5-86db4e75b951 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:46.391382 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317c18b-9db4-454d-bcf5-86db4e75b951 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:46.395610 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631e46b-1cba-4c94-a2df-c44511dc3f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:46.396354 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631e46b-1cba-4c94-a2df-c44511dc3f58 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:46.396641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631e46b-1cba-4c94-a2df-c44511dc3f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:46.396920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631e46b-1cba-4c94-a2df-c44511dc3f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:46.398755 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c631e46b-1cba-4c94-a2df-c44511dc3f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:46.410003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631e46b-1cba-4c94-a2df-c44511dc3f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:46.411432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631e46b-1cba-4c94-a2df-c44511dc3f58 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:46.419785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1265/2556] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:47.279629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066e61-ad98-4f5e-aa45-bf38188e569a None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:47.280192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066e61-ad98-4f5e-aa45-bf38188e569a None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:47.280368 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb066e61-ad98-4f5e-aa45-bf38188e569a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:47.305326 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-fb066e61-ad98-4f5e-aa45-bf38188e569a None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:47.306665 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fb066e61-ad98-4f5e-aa45-bf38188e569a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:47.381586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1292/2557] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:47.397321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631e46b-1cba-4c94-a2df-c44511dc3f58 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:47.398905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c631e46b-1cba-4c94-a2df-c44511dc3f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:47.494234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631e46b-1cba-4c94-a2df-c44511dc3f58 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:47.500148 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676e0db-e57c-4357-9662-f4cbd2a666cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:47.501487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676e0db-e57c-4357-9662-f4cbd2a666cc service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:47.501768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676e0db-e57c-4357-9662-f4cbd2a666cc service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:47.502039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676e0db-e57c-4357-9662-f4cbd2a666cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:47.511646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676e0db-e57c-4357-9662-f4cbd2a666cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:47.513278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676e0db-e57c-4357-9662-f4cbd2a666cc service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:47.522219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1266/2558] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:39:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 16:39:47.630964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb066e61-ad98-4f5e-aa45-bf38188e569a None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:47.633023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fb066e61-ad98-4f5e-aa45-bf38188e569a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:47.674811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb066e61-ad98-4f5e-aa45-bf38188e569a None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:47.689813 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbc4eb-7c4a-4cce-ac5f-c902f7628913 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:47.690604 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc4eb-7c4a-4cce-ac5f-c902f7628913 service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:47.690898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc4eb-7c4a-4cce-ac5f-c902f7628913 service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:47.691176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc4eb-7c4a-4cce-ac5f-c902f7628913 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:47.693858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f6bbc4eb-7c4a-4cce-ac5f-c902f7628913 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:47.799369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbc4eb-7c4a-4cce-ac5f-c902f7628913 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:47.803172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbc4eb-7c4a-4cce-ac5f-c902f7628913 service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:47.829911 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1293/2559] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:50.046771 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676e0db-e57c-4357-9662-f4cbd2a666cc service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:50.125413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676e0db-e57c-4357-9662-f4cbd2a666cc service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:50.131601 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:50.132470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:50.132858 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:50.133241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] PATH_INFO: `/v3/users/baff0d4e26874f6892fb9a32ecd4ad37` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:50.135197 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baff0d4e26874f6892fb9a32ecd4ad37)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:50.139057 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:50.142789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:50.208562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baff0d4e26874f6892fb9a32ecd4ad37'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:50.215678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baff0d4e26874f6892fb9a32ecd4ad37'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:50.225397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baff0d4e26874f6892fb9a32ecd4ad37'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:50.226107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baff0d4e26874f6892fb9a32ecd4ad37'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:50.226724 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baff0d4e26874f6892fb9a32ecd4ad37'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:50.245711 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1267/2560] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:39:50 2022] DELETE /identity/v3/users/baff0d4e26874f6892fb9a32ecd4ad37 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:50.251294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fcb8c-a41e-442c-a5e1-914d750a3cbc None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:50.252480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fcb8c-a41e-442c-a5e1-914d750a3cbc None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:50.252480 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fcb8c-a41e-442c-a5e1-914d750a3cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:50.272703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-390fcb8c-a41e-442c-a5e1-914d750a3cbc None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:50.274923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-390fcb8c-a41e-442c-a5e1-914d750a3cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:50.290060 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:50.348700 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1294/2561] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:50.358735 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:50.360824 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:50.424607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a3989-a9f7-4d3e-8144-b4fbb70e8d47 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:50.428569 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0735bb-b0a1-4dc4-8825-db2626d079bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:50.429283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0735bb-b0a1-4dc4-8825-db2626d079bb service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:50.429648 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0735bb-b0a1-4dc4-8825-db2626d079bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:50.429928 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0735bb-b0a1-4dc4-8825-db2626d079bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:50.441842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0735bb-b0a1-4dc4-8825-db2626d079bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:50.443283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0735bb-b0a1-4dc4-8825-db2626d079bb service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:50.454665 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1268/2562] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:50.893338 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fcb8c-a41e-442c-a5e1-914d750a3cbc None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:50.896920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-390fcb8c-a41e-442c-a5e1-914d750a3cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:50.926295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fcb8c-a41e-442c-a5e1-914d750a3cbc None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:50.931164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:50.931956 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:50.932314 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:50.932743 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] PATH_INFO: `/v3/projects/d2a5e60a0e014bb7a2d95c5f0827b6e5` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:50.934264 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a5e60a0e014bb7a2d95c5f0827b6e5)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:50.936548 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:51.009072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a5e60a0e014bb7a2d95c5f0827b6e5', 'request_id': 'req-9f100a1f-5c3b-4715-8005-a1ee67d4937e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.016020 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a5e60a0e014bb7a2d95c5f0827b6e5', 'request_id': 'req-9f100a1f-5c3b-4715-8005-a1ee67d4937e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.023755 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a5e60a0e014bb7a2d95c5f0827b6e5', 'request_id': 'req-9f100a1f-5c3b-4715-8005-a1ee67d4937e'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.041373 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] The token cache is being invalidate because project d2a5e60a0e014bb7a2d95c5f0827b6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:39:51.041801 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.042542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.044498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1295/2563] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:39:50 2022] DELETE /identity/v3/projects/d2a5e60a0e014bb7a2d95c5f0827b6e5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:51.048723 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0735bb-b0a1-4dc4-8825-db2626d079bb service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:51.058946 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0735bb-b0a1-4dc4-8825-db2626d079bb service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:51.126130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3bd92-7bc5-4a62-bca5-a7e5742f774e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:51.126645 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3bd92-7bc5-4a62-bca5-a7e5742f774e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:51.126933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3bd92-7bc5-4a62-bca5-a7e5742f774e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:51.127216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3bd92-7bc5-4a62-bca5-a7e5742f774e admin admin] PATH_INFO: `/v3/users/48a86469b8b444ed8fd167559ab75939` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:51.128439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3bd92-7bc5-4a62-bca5-a7e5742f774e admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a86469b8b444ed8fd167559ab75939)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:51.130378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3bd92-7bc5-4a62-bca5-a7e5742f774e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:51.164119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:51.196745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-95d3bd92-7bc5-4a62-bca5-a7e5742f774e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a86469b8b444ed8fd167559ab75939'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.204286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-95d3bd92-7bc5-4a62-bca5-a7e5742f774e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a86469b8b444ed8fd167559ab75939'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.214153 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-95d3bd92-7bc5-4a62-bca5-a7e5742f774e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a86469b8b444ed8fd167559ab75939'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.214754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-95d3bd92-7bc5-4a62-bca5-a7e5742f774e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a86469b8b444ed8fd167559ab75939'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.215360 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-95d3bd92-7bc5-4a62-bca5-a7e5742f774e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a86469b8b444ed8fd167559ab75939'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.234219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1269/2564] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:39:51 2022] DELETE /identity/v3/users/48a86469b8b444ed8fd167559ab75939 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:39:51.560618 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:51.562273 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:51.585188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f100a1f-5c3b-4715-8005-a1ee67d4937e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:51.681901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb22e17-9827-4d6a-a530-4ab00861fdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:51.682887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb22e17-9827-4d6a-a530-4ab00861fdb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:51.683420 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb22e17-9827-4d6a-a530-4ab00861fdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:51.683976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb22e17-9827-4d6a-a530-4ab00861fdb0 admin admin] PATH_INFO: `/v3/projects/8363c8488cf14161834c98641d6f718a` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:51.685317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb22e17-9827-4d6a-a530-4ab00861fdb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8363c8488cf14161834c98641d6f718a)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:51.687359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb22e17-9827-4d6a-a530-4ab00861fdb0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:51.755407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:51.761964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7fb22e17-9827-4d6a-a530-4ab00861fdb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8363c8488cf14161834c98641d6f718a', 'request_id': 'req-7fb22e17-9827-4d6a-a530-4ab00861fdb0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.771702 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7fb22e17-9827-4d6a-a530-4ab00861fdb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8363c8488cf14161834c98641d6f718a', 'request_id': 'req-7fb22e17-9827-4d6a-a530-4ab00861fdb0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.793528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7fb22e17-9827-4d6a-a530-4ab00861fdb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8363c8488cf14161834c98641d6f718a', 'request_id': 'req-7fb22e17-9827-4d6a-a530-4ab00861fdb0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.808839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7fb22e17-9827-4d6a-a530-4ab00861fdb0 admin admin] The token cache is being invalidate because project 8363c8488cf14161834c98641d6f718a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:39:51.809134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7fb22e17-9827-4d6a-a530-4ab00861fdb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.809786 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7fb22e17-9827-4d6a-a530-4ab00861fdb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:51.815551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1296/2565] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:39:51 2022] DELETE /identity/v3/projects/8363c8488cf14161834c98641d6f718a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:51.817523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5a8ef-32b6-4f7c-a1bb-517ed91a262e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:51.817967 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5a8ef-32b6-4f7c-a1bb-517ed91a262e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:51.818244 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5a8ef-32b6-4f7c-a1bb-517ed91a262e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:51.841629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-66b5a8ef-32b6-4f7c-a1bb-517ed91a262e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:51.843107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-66b5a8ef-32b6-4f7c-a1bb-517ed91a262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:51.929107 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1270/2566] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:51.936741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85ac89-193d-420a-81dc-f405f2589490 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:51.937039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85ac89-193d-420a-81dc-f405f2589490 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:51.937321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85ac89-193d-420a-81dc-f405f2589490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:51.958261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8f85ac89-193d-420a-81dc-f405f2589490 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:51.959488 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8f85ac89-193d-420a-81dc-f405f2589490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:51.985513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1297/2567] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:51.989549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5a8ef-32b6-4f7c-a1bb-517ed91a262e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:52.000426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5a8ef-32b6-4f7c-a1bb-517ed91a262e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:52.006622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42422bb-5752-4fcd-a2cf-9433b6834ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:52.007341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42422bb-5752-4fcd-a2cf-9433b6834ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:52.007627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42422bb-5752-4fcd-a2cf-9433b6834ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:52.007948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42422bb-5752-4fcd-a2cf-9433b6834ff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:52.008743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42422bb-5752-4fcd-a2cf-9433b6834ff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:39:52.009046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42422bb-5752-4fcd-a2cf-9433b6834ff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:52.010670 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42422bb-5752-4fcd-a2cf-9433b6834ff2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:52.027155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1271/2568] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:39:52.028577 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85ac89-193d-420a-81dc-f405f2589490 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:52.043388 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85ac89-193d-420a-81dc-f405f2589490 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:52.049102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7aa91-3fa0-4184-9f94-4fa7a44e3da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:52.049775 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7aa91-3fa0-4184-9f94-4fa7a44e3da0 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:52.050070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7aa91-3fa0-4184-9f94-4fa7a44e3da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:52.050346 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7aa91-3fa0-4184-9f94-4fa7a44e3da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:52.051027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7aa91-3fa0-4184-9f94-4fa7a44e3da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:52.053186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7aa91-3fa0-4184-9f94-4fa7a44e3da0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:52.087898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1298/2569] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:39:52 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:39:52.091920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42422bb-5752-4fcd-a2cf-9433b6834ff2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:52.107416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42422bb-5752-4fcd-a2cf-9433b6834ff2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:52.186216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9aeb6-e84c-4a68-b508-fe5e191bbe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:52.186870 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9aeb6-e84c-4a68-b508-fe5e191bbe68 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:52.187238 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9aeb6-e84c-4a68-b508-fe5e191bbe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:52.187580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9aeb6-e84c-4a68-b508-fe5e191bbe68 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:52.189145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9aeb6-e84c-4a68-b508-fe5e191bbe68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:52.191384 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9aeb6-e84c-4a68-b508-fe5e191bbe68 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:52.215894 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1272/2570] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:39:52 2022] POST /identity/v3/users => generated 284 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:52.219377 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7aa91-3fa0-4184-9f94-4fa7a44e3da0 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:52.230485 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7aa91-3fa0-4184-9f94-4fa7a44e3da0 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:52.235906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c07de-101a-4e72-a593-747245458719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:52.236630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c07de-101a-4e72-a593-747245458719 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:52.237066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c07de-101a-4e72-a593-747245458719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:52.237353 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c07de-101a-4e72-a593-747245458719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:52.238692 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c07de-101a-4e72-a593-747245458719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:52.240345 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c07de-101a-4e72-a593-747245458719 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:52.252672 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1299/2571] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:39:52.257128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9aeb6-e84c-4a68-b508-fe5e191bbe68 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:52.270791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9aeb6-e84c-4a68-b508-fe5e191bbe68 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:52.277290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fa74b-8ea1-4a7e-9b18-dc4e5a590114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:52.278406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fa74b-8ea1-4a7e-9b18-dc4e5a590114 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:52.278698 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fa74b-8ea1-4a7e-9b18-dc4e5a590114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:52.279056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fa74b-8ea1-4a7e-9b18-dc4e5a590114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:52.279851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fa74b-8ea1-4a7e-9b18-dc4e5a590114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:52.281884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fa74b-8ea1-4a7e-9b18-dc4e5a590114 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:52.299204 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1273/2572] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:39:52.301697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c07de-101a-4e72-a593-747245458719 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:52.312784 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c07de-101a-4e72-a593-747245458719 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:52.318820 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422f86f-c1a1-4750-bb7e-7e76a95f7247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:52.319595 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422f86f-c1a1-4750-bb7e-7e76a95f7247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:52.320024 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422f86f-c1a1-4750-bb7e-7e76a95f7247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:52.320385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422f86f-c1a1-4750-bb7e-7e76a95f7247 admin admin] PATH_INFO: `/v3/projects/12d0fb491fe24adb8aa25e8f3f245b7d/users/71eb26d8212f450b9e0731f68131549b/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:52.353757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422f86f-c1a1-4750-bb7e-7e76a95f7247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d0fb491fe24adb8aa25e8f3f245b7d, user_id=71eb26d8212f450b9e0731f68131549b, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:52.356617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422f86f-c1a1-4750-bb7e-7e76a95f7247 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:52.370893 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1300/2573] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:39:52 2022] PUT /identity/v3/projects/12d0fb491fe24adb8aa25e8f3f245b7d/users/71eb26d8212f450b9e0731f68131549b/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:52.443191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7528ac-24aa-489f-8952-a4bc2f7d94ab None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:52.443387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7528ac-24aa-489f-8952-a4bc2f7d94ab None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:52.443656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7528ac-24aa-489f-8952-a4bc2f7d94ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:52.466413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:52.476646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1f7528ac-24aa-489f-8952-a4bc2f7d94ab None None] MFA Rules not processed for user `71eb26d8212f450b9e0731f68131549b`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:52.478688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1f7528ac-24aa-489f-8952-a4bc2f7d94ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:52.564717 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1274/2574] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:52.569312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422f86f-c1a1-4750-bb7e-7e76a95f7247 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:52.653103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422f86f-c1a1-4750-bb7e-7e76a95f7247 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:52.658515 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118a2bc-9b57-4b57-be24-afaa074bd027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:52.659608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a2bc-9b57-4b57-be24-afaa074bd027 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:52.660018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a2bc-9b57-4b57-be24-afaa074bd027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:52.660394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a2bc-9b57-4b57-be24-afaa074bd027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:52.661194 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118a2bc-9b57-4b57-be24-afaa074bd027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:52.663262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118a2bc-9b57-4b57-be24-afaa074bd027 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:52.703882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1301/2575] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:39:52 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:52.705261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7528ac-24aa-489f-8952-a4bc2f7d94ab None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:52.718108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7528ac-24aa-489f-8952-a4bc2f7d94ab None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:52.786321 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d16dd4-ed93-4485-a8e4-7f2aa28b6464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:52.786952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d16dd4-ed93-4485-a8e4-7f2aa28b6464 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:52.787238 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d16dd4-ed93-4485-a8e4-7f2aa28b6464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:52.787667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d16dd4-ed93-4485-a8e4-7f2aa28b6464 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:52.788418 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d16dd4-ed93-4485-a8e4-7f2aa28b6464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:52.790338 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d16dd4-ed93-4485-a8e4-7f2aa28b6464 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:52.816879 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1275/2576] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:39:52 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:39:52.818315 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118a2bc-9b57-4b57-be24-afaa074bd027 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:52.843590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118a2bc-9b57-4b57-be24-afaa074bd027 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:52.850457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccdcc5-ccda-4be2-a3b2-243c7aef0e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:52.851197 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccdcc5-ccda-4be2-a3b2-243c7aef0e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:52.851549 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccdcc5-ccda-4be2-a3b2-243c7aef0e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:52.851923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccdcc5-ccda-4be2-a3b2-243c7aef0e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:52.852733 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccdcc5-ccda-4be2-a3b2-243c7aef0e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:52.854446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccdcc5-ccda-4be2-a3b2-243c7aef0e84 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:52.873054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1302/2577] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:39:52.874509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d16dd4-ed93-4485-a8e4-7f2aa28b6464 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:52.885265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d16dd4-ed93-4485-a8e4-7f2aa28b6464 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:52.890118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef212-ad95-4dde-8045-6b7867fa911d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:52.890854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef212-ad95-4dde-8045-6b7867fa911d admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:52.891083 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef212-ad95-4dde-8045-6b7867fa911d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:52.891986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef212-ad95-4dde-8045-6b7867fa911d admin admin] PATH_INFO: `/v3/projects/bb0adde3e64e458889d9ff8e5faf263c/users/975b8d4ee7db4f569a9a12daf003dc1e/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:52.909172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fef212-ad95-4dde-8045-6b7867fa911d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0adde3e64e458889d9ff8e5faf263c, user_id=975b8d4ee7db4f569a9a12daf003dc1e, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:52.911903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fef212-ad95-4dde-8045-6b7867fa911d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:52.930010 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1276/2578] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:39:52 2022] PUT /identity/v3/projects/bb0adde3e64e458889d9ff8e5faf263c/users/975b8d4ee7db4f569a9a12daf003dc1e/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:52.934281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccdcc5-ccda-4be2-a3b2-243c7aef0e84 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:52.945900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccdcc5-ccda-4be2-a3b2-243c7aef0e84 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:52.996341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:53.022885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602a2bb-06ae-460b-91d7-50a73ac6fcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:53.023538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a2bb-06ae-460b-91d7-50a73ac6fcff admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:53.023822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a2bb-06ae-460b-91d7-50a73ac6fcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:53.024126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a2bb-06ae-460b-91d7-50a73ac6fcff admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:53.024848 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602a2bb-06ae-460b-91d7-50a73ac6fcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:53.026621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602a2bb-06ae-460b-91d7-50a73ac6fcff admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:53.040673 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1303/2579] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:39:53.045094 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef212-ad95-4dde-8045-6b7867fa911d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:53.055914 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef212-ad95-4dde-8045-6b7867fa911d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:53.060632 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183c66e-f3d6-40ca-9166-c18e647b5e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:53.061336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183c66e-f3d6-40ca-9166-c18e647b5e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:53.061627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183c66e-f3d6-40ca-9166-c18e647b5e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:53.061904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183c66e-f3d6-40ca-9166-c18e647b5e16 admin admin] PATH_INFO: `/v3/projects/bb0adde3e64e458889d9ff8e5faf263c/users/975b8d4ee7db4f569a9a12daf003dc1e/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:53.064672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183c66e-f3d6-40ca-9166-c18e647b5e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0adde3e64e458889d9ff8e5faf263c, user_id=975b8d4ee7db4f569a9a12daf003dc1e, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:53.067646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183c66e-f3d6-40ca-9166-c18e647b5e16 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:53.080471 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1277/2580] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:39:53 2022] PUT /identity/v3/projects/bb0adde3e64e458889d9ff8e5faf263c/users/975b8d4ee7db4f569a9a12daf003dc1e/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:53.090850 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd46e89-68e3-4b14-928f-e64f306b424d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:53.091156 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd46e89-68e3-4b14-928f-e64f306b424d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:53.091434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd46e89-68e3-4b14-928f-e64f306b424d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:53.134659 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-bdd46e89-68e3-4b14-928f-e64f306b424d None None] MFA Rules not processed for user `975b8d4ee7db4f569a9a12daf003dc1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:53.135981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bdd46e89-68e3-4b14-928f-e64f306b424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:53.236161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1304/2581] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:53.244487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183c66e-f3d6-40ca-9166-c18e647b5e16 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:53.246444 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b183c66e-f3d6-40ca-9166-c18e647b5e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:53.351018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183c66e-f3d6-40ca-9166-c18e647b5e16 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:53.354885 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5cce6-5470-46b9-be14-117795299f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:53.355871 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5cce6-5470-46b9-be14-117795299f5b service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:53.356225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5cce6-5470-46b9-be14-117795299f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:53.356532 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5cce6-5470-46b9-be14-117795299f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:53.364774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:53.369263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5cce6-5470-46b9-be14-117795299f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:53.371087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5cce6-5470-46b9-be14-117795299f5b service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:53.386135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1278/2582] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:53 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:53.494565 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd46e89-68e3-4b14-928f-e64f306b424d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:53.506053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd46e89-68e3-4b14-928f-e64f306b424d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:53.509793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a02e02-95e1-40e4-97ea-bbb543aa3239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:53.510423 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a02e02-95e1-40e4-97ea-bbb543aa3239 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:53.511201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a02e02-95e1-40e4-97ea-bbb543aa3239 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:53.511201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a02e02-95e1-40e4-97ea-bbb543aa3239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:53.588921 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a02e02-95e1-40e4-97ea-bbb543aa3239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:53.590439 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a02e02-95e1-40e4-97ea-bbb543aa3239 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:53.601036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1305/2583] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:58.568897 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5cce6-5470-46b9-be14-117795299f5b service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:58.633170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5cce6-5470-46b9-be14-117795299f5b service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:58.637700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:58.638350 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:58.638629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:58.638901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] PATH_INFO: `/v3/users/71eb26d8212f450b9e0731f68131549b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:58.640085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=71eb26d8212f450b9e0731f68131549b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:58.642662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:58.692042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71eb26d8212f450b9e0731f68131549b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:58.699061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71eb26d8212f450b9e0731f68131549b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:58.706712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71eb26d8212f450b9e0731f68131549b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:58.707373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71eb26d8212f450b9e0731f68131549b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:58.708073 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71eb26d8212f450b9e0731f68131549b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:58.726781 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1279/2584] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:39:58 2022] DELETE /identity/v3/users/71eb26d8212f450b9e0731f68131549b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:58.731385 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1e7b5-4993-4a79-b6f4-e6b99b217a06 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:58.731922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1e7b5-4993-4a79-b6f4-e6b99b217a06 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:58.732032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1e7b5-4993-4a79-b6f4-e6b99b217a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:58.753363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-bbf1e7b5-4993-4a79-b6f4-e6b99b217a06 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:39:58.754570 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bbf1e7b5-4993-4a79-b6f4-e6b99b217a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:58.817040 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1306/2585] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:39:58.826980 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:58.828450 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:58.906821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b700653-81cf-4857-a3e2-de0868436fdd admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:58.910919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2506f-1722-46a1-8fda-6bd15e5c0fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:58.911573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2506f-1722-46a1-8fda-6bd15e5c0fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:58.911877 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2506f-1722-46a1-8fda-6bd15e5c0fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:58.912165 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2506f-1722-46a1-8fda-6bd15e5c0fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:58.921447 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2506f-1722-46a1-8fda-6bd15e5c0fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:58.923485 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2506f-1722-46a1-8fda-6bd15e5c0fe9 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:58.933288 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1280/2586] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:39:59.323126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1e7b5-4993-4a79-b6f4-e6b99b217a06 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:59.324583 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bbf1e7b5-4993-4a79-b6f4-e6b99b217a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:59.331630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:59.337900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1e7b5-4993-4a79-b6f4-e6b99b217a06 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:59.342624 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:59.343188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:59.343470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:59.343768 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] PATH_INFO: `/v3/projects/12d0fb491fe24adb8aa25e8f3f245b7d` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:59.345764 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d0fb491fe24adb8aa25e8f3f245b7d)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:59.347654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:59.404446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d0fb491fe24adb8aa25e8f3f245b7d', 'request_id': 'req-9db4e03f-ffad-42b1-ba25-324058504345'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:59.412127 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d0fb491fe24adb8aa25e8f3f245b7d', 'request_id': 'req-9db4e03f-ffad-42b1-ba25-324058504345'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:59.418310 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d0fb491fe24adb8aa25e8f3f245b7d', 'request_id': 'req-9db4e03f-ffad-42b1-ba25-324058504345'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:59.431905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] The token cache is being invalidate because project 12d0fb491fe24adb8aa25e8f3f245b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:39:59.432202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:59.432821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:59.434340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1307/2587] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:39:59 2022] DELETE /identity/v3/projects/12d0fb491fe24adb8aa25e8f3f245b7d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:59.438441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2506f-1722-46a1-8fda-6bd15e5c0fe9 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:59.448671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2506f-1722-46a1-8fda-6bd15e5c0fe9 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:39:59.460796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:39:59.509065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21dcb2-f10b-4421-9ac3-5265d3c3071f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:39:59.509629 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21dcb2-f10b-4421-9ac3-5265d3c3071f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:39:59.509913 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21dcb2-f10b-4421-9ac3-5265d3c3071f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:39:59.510195 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21dcb2-f10b-4421-9ac3-5265d3c3071f admin admin] PATH_INFO: `/v3/users/975b8d4ee7db4f569a9a12daf003dc1e` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:39:59.511364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21dcb2-f10b-4421-9ac3-5265d3c3071f admin admin] RBAC: Authorizing `identity:delete_user(user_id=975b8d4ee7db4f569a9a12daf003dc1e)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:39:59.513314 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21dcb2-f10b-4421-9ac3-5265d3c3071f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:39:59.562266 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2c21dcb2-f10b-4421-9ac3-5265d3c3071f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975b8d4ee7db4f569a9a12daf003dc1e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:59.570554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2c21dcb2-f10b-4421-9ac3-5265d3c3071f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975b8d4ee7db4f569a9a12daf003dc1e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:59.579718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2c21dcb2-f10b-4421-9ac3-5265d3c3071f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975b8d4ee7db4f569a9a12daf003dc1e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:59.580546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2c21dcb2-f10b-4421-9ac3-5265d3c3071f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975b8d4ee7db4f569a9a12daf003dc1e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:59.581164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2c21dcb2-f10b-4421-9ac3-5265d3c3071f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975b8d4ee7db4f569a9a12daf003dc1e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:39:59.600084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1281/2588] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:39:59 2022] DELETE /identity/v3/users/975b8d4ee7db4f569a9a12daf003dc1e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:39:59.984218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:39:59.985821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:39:59.999949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4e03f-ffad-42b1-ba25-324058504345 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:00.065979 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d629e6-d40f-4156-bf0d-c1c91701eb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:00.066625 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d629e6-d40f-4156-bf0d-c1c91701eb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:00.066909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d629e6-d40f-4156-bf0d-c1c91701eb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:00.067188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d629e6-d40f-4156-bf0d-c1c91701eb98 admin admin] PATH_INFO: `/v3/projects/bb0adde3e64e458889d9ff8e5faf263c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:00.068387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d629e6-d40f-4156-bf0d-c1c91701eb98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0adde3e64e458889d9ff8e5faf263c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:00.070282 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d629e6-d40f-4156-bf0d-c1c91701eb98 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:00.116260 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c0d629e6-d40f-4156-bf0d-c1c91701eb98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0adde3e64e458889d9ff8e5faf263c', 'request_id': 'req-c0d629e6-d40f-4156-bf0d-c1c91701eb98'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:00.122320 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c0d629e6-d40f-4156-bf0d-c1c91701eb98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0adde3e64e458889d9ff8e5faf263c', 'request_id': 'req-c0d629e6-d40f-4156-bf0d-c1c91701eb98'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:00.128799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c0d629e6-d40f-4156-bf0d-c1c91701eb98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0adde3e64e458889d9ff8e5faf263c', 'request_id': 'req-c0d629e6-d40f-4156-bf0d-c1c91701eb98'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:00.142538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c0d629e6-d40f-4156-bf0d-c1c91701eb98 admin admin] The token cache is being invalidate because project bb0adde3e64e458889d9ff8e5faf263c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:40:00.142823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c0d629e6-d40f-4156-bf0d-c1c91701eb98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:00.143660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c0d629e6-d40f-4156-bf0d-c1c91701eb98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:00.145208 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1308/2589] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:39:59 2022] DELETE /identity/v3/projects/bb0adde3e64e458889d9ff8e5faf263c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:00.150171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539233be-9d00-4457-8393-a4434a18e62f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:00.150456 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539233be-9d00-4457-8393-a4434a18e62f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:00.150731 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539233be-9d00-4457-8393-a4434a18e62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:00.171538 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-539233be-9d00-4457-8393-a4434a18e62f None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:00.173521 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-539233be-9d00-4457-8393-a4434a18e62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:00.233061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1282/2590] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:00.241991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad59605-30d2-412c-9b9c-0bd905220153 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:00.242290 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad59605-30d2-412c-9b9c-0bd905220153 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:00.242578 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad59605-30d2-412c-9b9c-0bd905220153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:00.264880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7ad59605-30d2-412c-9b9c-0bd905220153 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:00.266038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7ad59605-30d2-412c-9b9c-0bd905220153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:00.275754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1309/2591] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:00.280068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539233be-9d00-4457-8393-a4434a18e62f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:00.290790 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539233be-9d00-4457-8393-a4434a18e62f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:00.295906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0f1cd-52ff-4298-b90c-fbcf1bf028eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:00.296557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0f1cd-52ff-4298-b90c-fbcf1bf028eb admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:00.296842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0f1cd-52ff-4298-b90c-fbcf1bf028eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:00.297119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0f1cd-52ff-4298-b90c-fbcf1bf028eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:00.298530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0f1cd-52ff-4298-b90c-fbcf1bf028eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:40:00.298817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0f1cd-52ff-4298-b90c-fbcf1bf028eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:00.300459 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0f1cd-52ff-4298-b90c-fbcf1bf028eb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:00.312881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1283/2592] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:40:00.318048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad59605-30d2-412c-9b9c-0bd905220153 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:00.328296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad59605-30d2-412c-9b9c-0bd905220153 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:00.333115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcb8a8-bb63-41f4-9fbe-300dc0558ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:00.333739 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcb8a8-bb63-41f4-9fbe-300dc0558ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:00.334026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcb8a8-bb63-41f4-9fbe-300dc0558ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:00.334307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcb8a8-bb63-41f4-9fbe-300dc0558ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:00.335043 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcb8a8-bb63-41f4-9fbe-300dc0558ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:00.337004 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcb8a8-bb63-41f4-9fbe-300dc0558ce1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:00.342597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:00.371351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1310/2593] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:40:00 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:40:00.372898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0f1cd-52ff-4298-b90c-fbcf1bf028eb admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:00.385286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0f1cd-52ff-4298-b90c-fbcf1bf028eb admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:00.411259 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:00.463599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9869c2-164a-48c8-b679-1a7b02a55711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:00.464370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9869c2-164a-48c8-b679-1a7b02a55711 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:00.464732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9869c2-164a-48c8-b679-1a7b02a55711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:00.465079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9869c2-164a-48c8-b679-1a7b02a55711 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:00.466291 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9869c2-164a-48c8-b679-1a7b02a55711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:00.468028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9869c2-164a-48c8-b679-1a7b02a55711 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:00.499621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1284/2594] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:40:00 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:40:00.504792 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcb8a8-bb63-41f4-9fbe-300dc0558ce1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:00.516259 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcb8a8-bb63-41f4-9fbe-300dc0558ce1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:00.521180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67044db4-bade-497e-bc63-53a6fb7d7b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:00.521947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67044db4-bade-497e-bc63-53a6fb7d7b85 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:00.522300 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67044db4-bade-497e-bc63-53a6fb7d7b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:00.522651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67044db4-bade-497e-bc63-53a6fb7d7b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:00.523370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67044db4-bade-497e-bc63-53a6fb7d7b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:00.525000 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67044db4-bade-497e-bc63-53a6fb7d7b85 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:00.536245 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1311/2595] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:40:00.540217 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9869c2-164a-48c8-b679-1a7b02a55711 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:00.552453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9869c2-164a-48c8-b679-1a7b02a55711 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:00.557341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febedee-fe38-4a5f-bd8e-44a0ed28cd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:00.558205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febedee-fe38-4a5f-bd8e-44a0ed28cd0b admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:00.558326 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febedee-fe38-4a5f-bd8e-44a0ed28cd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:00.558515 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febedee-fe38-4a5f-bd8e-44a0ed28cd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:00.559216 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febedee-fe38-4a5f-bd8e-44a0ed28cd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:00.560828 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febedee-fe38-4a5f-bd8e-44a0ed28cd0b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:00.576627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1285/2596] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:40:00.577812 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67044db4-bade-497e-bc63-53a6fb7d7b85 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:00.588652 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67044db4-bade-497e-bc63-53a6fb7d7b85 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:00.593676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efc441-5ea7-41ae-9786-76acafe74c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:00.594370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efc441-5ea7-41ae-9786-76acafe74c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:00.594658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efc441-5ea7-41ae-9786-76acafe74c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:00.594930 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efc441-5ea7-41ae-9786-76acafe74c08 admin admin] PATH_INFO: `/v3/projects/8c04b4684b724cc4ba0921cd43aed0dd/users/9be0c8bbbfa04c3da1c6214b618302c7/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:00.613741 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efc441-5ea7-41ae-9786-76acafe74c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c04b4684b724cc4ba0921cd43aed0dd, user_id=9be0c8bbbfa04c3da1c6214b618302c7, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:00.616435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efc441-5ea7-41ae-9786-76acafe74c08 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:00.631770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1312/2597] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:00 2022] PUT /identity/v3/projects/8c04b4684b724cc4ba0921cd43aed0dd/users/9be0c8bbbfa04c3da1c6214b618302c7/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:00.637095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453a143-8426-414a-9195-73c9c78506d5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:00.637495 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453a143-8426-414a-9195-73c9c78506d5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:00.637874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453a143-8426-414a-9195-73c9c78506d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:00.659487 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1453a143-8426-414a-9195-73c9c78506d5 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:00.660743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1453a143-8426-414a-9195-73c9c78506d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:00.723087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1286/2598] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:00.732716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efc441-5ea7-41ae-9786-76acafe74c08 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:00.734602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-40efc441-5ea7-41ae-9786-76acafe74c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:00.799039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efc441-5ea7-41ae-9786-76acafe74c08 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:00.802731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeecac8-1b3c-4f3b-8c47-8de36c4c1627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:00.803353 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeecac8-1b3c-4f3b-8c47-8de36c4c1627 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:00.803633 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeecac8-1b3c-4f3b-8c47-8de36c4c1627 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:00.803934 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeecac8-1b3c-4f3b-8c47-8de36c4c1627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:00.813562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeecac8-1b3c-4f3b-8c47-8de36c4c1627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:00.815166 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeecac8-1b3c-4f3b-8c47-8de36c4c1627 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:00.824959 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1313/2599] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:01.573019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4da8b0-f717-42f9-89e1-748b6ee44c49 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:01.573019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4da8b0-f717-42f9-89e1-748b6ee44c49 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:01.573019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4da8b0-f717-42f9-89e1-748b6ee44c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:01.604264 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1f4da8b0-f717-42f9-89e1-748b6ee44c49 None None] MFA Rules not processed for user `9be0c8bbbfa04c3da1c6214b618302c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:01.605552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1f4da8b0-f717-42f9-89e1-748b6ee44c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:01.707547 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1287/2600] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:01.721597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeecac8-1b3c-4f3b-8c47-8de36c4c1627 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:01.723455 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-eaeecac8-1b3c-4f3b-8c47-8de36c4c1627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:01.807456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeecac8-1b3c-4f3b-8c47-8de36c4c1627 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:01.811893 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c87cb-a967-465f-a692-0ebfc42a2029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:01.812847 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c87cb-a967-465f-a692-0ebfc42a2029 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:01.813409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c87cb-a967-465f-a692-0ebfc42a2029 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:01.813888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c87cb-a967-465f-a692-0ebfc42a2029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:01.829362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c87cb-a967-465f-a692-0ebfc42a2029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:01.831554 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c87cb-a967-465f-a692-0ebfc42a2029 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:01.854432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1314/2601] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:02.936927 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4da8b0-f717-42f9-89e1-748b6ee44c49 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:02.939486 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1f4da8b0-f717-42f9-89e1-748b6ee44c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:03.014271 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:03.104257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4da8b0-f717-42f9-89e1-748b6ee44c49 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:03.112232 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939785d-f21e-404f-a14f-a33d660c6b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:03.113067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939785d-f21e-404f-a14f-a33d660c6b44 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:03.113320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939785d-f21e-404f-a14f-a33d660c6b44 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:03.113802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939785d-f21e-404f-a14f-a33d660c6b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:03.116681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3939785d-f21e-404f-a14f-a33d660c6b44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:03.148653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939785d-f21e-404f-a14f-a33d660c6b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:03.150944 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939785d-f21e-404f-a14f-a33d660c6b44 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:03.169581 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1288/2602] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:40:03.292796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b58d9-5099-440a-b089-7fba8ee56722 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:03.293532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b58d9-5099-440a-b089-7fba8ee56722 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:03.293950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b58d9-5099-440a-b089-7fba8ee56722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:03.319443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-942b58d9-5099-440a-b089-7fba8ee56722 None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:03.320746 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-942b58d9-5099-440a-b089-7fba8ee56722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:03.393785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1315/2603] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 27 16:40:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:03.407793 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939785d-f21e-404f-a14f-a33d660c6b44 service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:03.409360 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3939785d-f21e-404f-a14f-a33d660c6b44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:03.512019 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939785d-f21e-404f-a14f-a33d660c6b44 service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:03.520872 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3bbb6-f8b9-4f52-a5bd-3c9c999e1d21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:03.521734 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3bbb6-f8b9-4f52-a5bd-3c9c999e1d21 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:03.522300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3bbb6-f8b9-4f52-a5bd-3c9c999e1d21 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:03.522654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3bbb6-f8b9-4f52-a5bd-3c9c999e1d21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:03.535684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3bbb6-f8b9-4f52-a5bd-3c9c999e1d21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:03.538301 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3bbb6-f8b9-4f52-a5bd-3c9c999e1d21 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:03.548965 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1289/2604] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:40:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 16:40:03.697172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c55b9e-748f-4720-aec1-397109120983 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:03.697765 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c55b9e-748f-4720-aec1-397109120983 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:03.698049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c55b9e-748f-4720-aec1-397109120983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:03.708595 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:03.729119 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-99c55b9e-748f-4720-aec1-397109120983 None None] MFA Rules not processed for user `9be0c8bbbfa04c3da1c6214b618302c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:03.730804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-99c55b9e-748f-4720-aec1-397109120983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:03.739383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1316/2605] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:04.104375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3bbb6-f8b9-4f52-a5bd-3c9c999e1d21 service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:04.117373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3bbb6-f8b9-4f52-a5bd-3c9c999e1d21 service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:04.122690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98d56c-2249-46ca-adb4-4c591ae3d928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:04.123464 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98d56c-2249-46ca-adb4-4c591ae3d928 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:04.123753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98d56c-2249-46ca-adb4-4c591ae3d928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:04.124470 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98d56c-2249-46ca-adb4-4c591ae3d928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:04.126616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bb98d56c-2249-46ca-adb4-4c591ae3d928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:04.139692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98d56c-2249-46ca-adb4-4c591ae3d928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:04.141480 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98d56c-2249-46ca-adb4-4c591ae3d928 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:04.156056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1290/2606] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:09.369560 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c55b9e-748f-4720-aec1-397109120983 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:09.371238 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-99c55b9e-748f-4720-aec1-397109120983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:09.392572 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c55b9e-748f-4720-aec1-397109120983 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:09.396496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2e2ca-da81-43e0-93c1-775e275cf7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:09.397186 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2e2ca-da81-43e0-93c1-775e275cf7df service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:09.397635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2e2ca-da81-43e0-93c1-775e275cf7df service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:09.397854 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2e2ca-da81-43e0-93c1-775e275cf7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:09.399950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-06c2e2ca-da81-43e0-93c1-775e275cf7df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:09.416890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2e2ca-da81-43e0-93c1-775e275cf7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:09.418546 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2e2ca-da81-43e0-93c1-775e275cf7df service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:09.437180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1317/2607] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:12.511384 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98d56c-2249-46ca-adb4-4c591ae3d928 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:12.513609 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-bb98d56c-2249-46ca-adb4-4c591ae3d928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:12.534919 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98d56c-2249-46ca-adb4-4c591ae3d928 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:12.541386 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc2c19-50dc-49f3-84fe-dfcba39f8154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:12.542152 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc2c19-50dc-49f3-84fe-dfcba39f8154 service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:12.542568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc2c19-50dc-49f3-84fe-dfcba39f8154 service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:12.542911 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc2c19-50dc-49f3-84fe-dfcba39f8154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:12.544885 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-edbc2c19-50dc-49f3-84fe-dfcba39f8154 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:12.560824 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc2c19-50dc-49f3-84fe-dfcba39f8154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:12.562542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc2c19-50dc-49f3-84fe-dfcba39f8154 service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:12.577911 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1291/2608] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:13.229796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2e2ca-da81-43e0-93c1-775e275cf7df service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:13.232934 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-06c2e2ca-da81-43e0-93c1-775e275cf7df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:13.248237 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2e2ca-da81-43e0-93c1-775e275cf7df service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:13.256509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68954868-bd9d-458c-a89a-16f7be5696a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:13.257243 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954868-bd9d-458c-a89a-16f7be5696a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:13.257472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954868-bd9d-458c-a89a-16f7be5696a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:13.257753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954868-bd9d-458c-a89a-16f7be5696a4 admin admin] PATH_INFO: `/v3/users/bc75a052c6b14904a314cf8f7bd4bad7` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:13.258978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68954868-bd9d-458c-a89a-16f7be5696a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc75a052c6b14904a314cf8f7bd4bad7)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:13.261510 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68954868-bd9d-458c-a89a-16f7be5696a4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:13.315649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68954868-bd9d-458c-a89a-16f7be5696a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc75a052c6b14904a314cf8f7bd4bad7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:13.329209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68954868-bd9d-458c-a89a-16f7be5696a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc75a052c6b14904a314cf8f7bd4bad7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:13.338562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68954868-bd9d-458c-a89a-16f7be5696a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc75a052c6b14904a314cf8f7bd4bad7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:13.339370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68954868-bd9d-458c-a89a-16f7be5696a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc75a052c6b14904a314cf8f7bd4bad7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:13.340152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68954868-bd9d-458c-a89a-16f7be5696a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc75a052c6b14904a314cf8f7bd4bad7'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:13.365685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1318/2609] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:40:13 2022] DELETE /identity/v3/users/bc75a052c6b14904a314cf8f7bd4bad7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:40:13.556173 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc2c19-50dc-49f3-84fe-dfcba39f8154 service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:13.579562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc2c19-50dc-49f3-84fe-dfcba39f8154 service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:13.642303 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6073a0-3f32-4780-963c-f0d11bf302e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:13.642980 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6073a0-3f32-4780-963c-f0d11bf302e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:13.643936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6073a0-3f32-4780-963c-f0d11bf302e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:13.644164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6073a0-3f32-4780-963c-f0d11bf302e3 admin admin] PATH_INFO: `/v3/projects/be258adc704748749dd73c64091db71c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:13.645379 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6073a0-3f32-4780-963c-f0d11bf302e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be258adc704748749dd73c64091db71c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:13.647279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6073a0-3f32-4780-963c-f0d11bf302e3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:13.673540 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=100 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:13.709959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8b6073a0-3f32-4780-963c-f0d11bf302e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be258adc704748749dd73c64091db71c', 'request_id': 'req-8b6073a0-3f32-4780-963c-f0d11bf302e3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:13.720646 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8b6073a0-3f32-4780-963c-f0d11bf302e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be258adc704748749dd73c64091db71c', 'request_id': 'req-8b6073a0-3f32-4780-963c-f0d11bf302e3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:13.734969 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8b6073a0-3f32-4780-963c-f0d11bf302e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be258adc704748749dd73c64091db71c', 'request_id': 'req-8b6073a0-3f32-4780-963c-f0d11bf302e3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:13.747066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8b6073a0-3f32-4780-963c-f0d11bf302e3 admin admin] The token cache is being invalidate because project be258adc704748749dd73c64091db71c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:40:13.747066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8b6073a0-3f32-4780-963c-f0d11bf302e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:13.747763 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-8b6073a0-3f32-4780-963c-f0d11bf302e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:13.749389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1292/2610] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:40:13 2022] DELETE /identity/v3/projects/be258adc704748749dd73c64091db71c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:13.755984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbc6fc-8cae-437b-a109-7d071eb570b7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:13.756274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbc6fc-8cae-437b-a109-7d071eb570b7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:13.756561 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbc6fc-8cae-437b-a109-7d071eb570b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:13.777489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-46bbc6fc-8cae-437b-a109-7d071eb570b7 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:13.778762 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-46bbc6fc-8cae-437b-a109-7d071eb570b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:13.840606 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1319/2611] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:40:13.849878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc135fb-2f2e-4c8f-81d1-7451db62fa7e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:13.850256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc135fb-2f2e-4c8f-81d1-7451db62fa7e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:13.850613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc135fb-2f2e-4c8f-81d1-7451db62fa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:13.872682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-efc135fb-2f2e-4c8f-81d1-7451db62fa7e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:13.873908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-efc135fb-2f2e-4c8f-81d1-7451db62fa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:13.883593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1293/2612] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:13.888451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbc6fc-8cae-437b-a109-7d071eb570b7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:13.900532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbc6fc-8cae-437b-a109-7d071eb570b7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:13.905391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fcca1-2038-4593-a496-5bb43a0d665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:13.906023 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fcca1-2038-4593-a496-5bb43a0d665f admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:13.906352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fcca1-2038-4593-a496-5bb43a0d665f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:13.906572 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fcca1-2038-4593-a496-5bb43a0d665f admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:13.907323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fcca1-2038-4593-a496-5bb43a0d665f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:40:13.907641 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fcca1-2038-4593-a496-5bb43a0d665f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:13.909902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fcca1-2038-4593-a496-5bb43a0d665f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:13.926654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1320/2613] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:40:13.930004 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc135fb-2f2e-4c8f-81d1-7451db62fa7e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:13.940546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc135fb-2f2e-4c8f-81d1-7451db62fa7e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:13.946095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03770f-92ad-42ee-8218-92ebfe74546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:13.946722 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03770f-92ad-42ee-8218-92ebfe74546d admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:13.947006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03770f-92ad-42ee-8218-92ebfe74546d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:13.947284 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03770f-92ad-42ee-8218-92ebfe74546d admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:13.948012 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03770f-92ad-42ee-8218-92ebfe74546d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:13.950197 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03770f-92ad-42ee-8218-92ebfe74546d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:13.981710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1294/2614] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:40:13 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:13.986106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fcca1-2038-4593-a496-5bb43a0d665f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:13.998703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fcca1-2038-4593-a496-5bb43a0d665f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:14.044969 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:14.066179 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d75cac-aebc-4017-ac54-a676ed1a8638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:14.066822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d75cac-aebc-4017-ac54-a676ed1a8638 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:14.067106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d75cac-aebc-4017-ac54-a676ed1a8638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:14.067394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d75cac-aebc-4017-ac54-a676ed1a8638 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:14.068111 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d75cac-aebc-4017-ac54-a676ed1a8638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:14.070059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d75cac-aebc-4017-ac54-a676ed1a8638 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:14.092531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1321/2615] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:40:13 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:40:14.098008 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03770f-92ad-42ee-8218-92ebfe74546d admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:14.110002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03770f-92ad-42ee-8218-92ebfe74546d admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:14.116393 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225bb08-a6b9-4093-8f8d-44e732c6d881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:14.126773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225bb08-a6b9-4093-8f8d-44e732c6d881 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:14.126773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225bb08-a6b9-4093-8f8d-44e732c6d881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:14.126773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225bb08-a6b9-4093-8f8d-44e732c6d881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:14.126773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225bb08-a6b9-4093-8f8d-44e732c6d881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:14.126773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225bb08-a6b9-4093-8f8d-44e732c6d881 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:14.132851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1295/2616] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:40:14.136830 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d75cac-aebc-4017-ac54-a676ed1a8638 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:14.148582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d75cac-aebc-4017-ac54-a676ed1a8638 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:14.153604 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0986a-6829-4ef0-a76f-06649b4c8e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:14.154300 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0986a-6829-4ef0-a76f-06649b4c8e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:14.154590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0986a-6829-4ef0-a76f-06649b4c8e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:14.154875 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0986a-6829-4ef0-a76f-06649b4c8e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:14.155582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0986a-6829-4ef0-a76f-06649b4c8e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:14.157258 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0986a-6829-4ef0-a76f-06649b4c8e23 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:14.170638 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1322/2617] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:40:14.176295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225bb08-a6b9-4093-8f8d-44e732c6d881 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:14.187757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225bb08-a6b9-4093-8f8d-44e732c6d881 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:14.192733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c110466-bc3b-4f31-868f-b6a97e6a9f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:14.193439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c110466-bc3b-4f31-868f-b6a97e6a9f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:14.193721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c110466-bc3b-4f31-868f-b6a97e6a9f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:14.194003 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c110466-bc3b-4f31-868f-b6a97e6a9f7e admin admin] PATH_INFO: `/v3/projects/faf28ac9a16d42a8b23dd7d47c7bc614/users/154b5dfdb320456bb992111c66db6662/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:14.209959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c110466-bc3b-4f31-868f-b6a97e6a9f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf28ac9a16d42a8b23dd7d47c7bc614, user_id=154b5dfdb320456bb992111c66db6662, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:14.212706 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c110466-bc3b-4f31-868f-b6a97e6a9f7e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:14.230938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1296/2618] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:14 2022] PUT /identity/v3/projects/faf28ac9a16d42a8b23dd7d47c7bc614/users/154b5dfdb320456bb992111c66db6662/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:40:14.242318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9407b-7465-4c81-93a1-3262f1f28b6f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:14.242889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9407b-7465-4c81-93a1-3262f1f28b6f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:14.242889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9407b-7465-4c81-93a1-3262f1f28b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:14.273735 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-61b9407b-7465-4c81-93a1-3262f1f28b6f None None] MFA Rules not processed for user `154b5dfdb320456bb992111c66db6662`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:14.275022 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-61b9407b-7465-4c81-93a1-3262f1f28b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:14.352336 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1323/2619] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:40:14.356812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c110466-bc3b-4f31-868f-b6a97e6a9f7e admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:14.447521 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c110466-bc3b-4f31-868f-b6a97e6a9f7e admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:14.454571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a67192-a150-4a6f-926d-3079e64143ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:14.455414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a67192-a150-4a6f-926d-3079e64143ec admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:14.456376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a67192-a150-4a6f-926d-3079e64143ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:14.456713 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a67192-a150-4a6f-926d-3079e64143ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:14.457526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a67192-a150-4a6f-926d-3079e64143ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:14.459691 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a67192-a150-4a6f-926d-3079e64143ec admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:14.502167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1297/2620] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:40:14 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:14.505061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9407b-7465-4c81-93a1-3262f1f28b6f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:14.527676 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9407b-7465-4c81-93a1-3262f1f28b6f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:14.604131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221c4b3-38f9-4f3e-9f15-e08c8cedb652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:14.605198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221c4b3-38f9-4f3e-9f15-e08c8cedb652 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:14.605544 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221c4b3-38f9-4f3e-9f15-e08c8cedb652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:14.605954 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221c4b3-38f9-4f3e-9f15-e08c8cedb652 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:14.606717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221c4b3-38f9-4f3e-9f15-e08c8cedb652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:14.609656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221c4b3-38f9-4f3e-9f15-e08c8cedb652 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:14.639343 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1324/2621] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:40:14 2022] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:14.643782 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a67192-a150-4a6f-926d-3079e64143ec admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:14.655289 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a67192-a150-4a6f-926d-3079e64143ec admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:14.662370 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b3eb8-ae6e-42d5-9093-9ca5d2bf10cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:14.662848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3eb8-ae6e-42d5-9093-9ca5d2bf10cb admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:14.663413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3eb8-ae6e-42d5-9093-9ca5d2bf10cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:14.663413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3eb8-ae6e-42d5-9093-9ca5d2bf10cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:14.664225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b3eb8-ae6e-42d5-9093-9ca5d2bf10cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:14.665854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b3eb8-ae6e-42d5-9093-9ca5d2bf10cb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:14.679935 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1298/2622] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:40:14.684468 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221c4b3-38f9-4f3e-9f15-e08c8cedb652 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:14.695176 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221c4b3-38f9-4f3e-9f15-e08c8cedb652 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:14.704389 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c5be3-728f-426d-bb79-e7610396eb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:14.705193 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c5be3-728f-426d-bb79-e7610396eb80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:14.705418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c5be3-728f-426d-bb79-e7610396eb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:14.706376 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c5be3-728f-426d-bb79-e7610396eb80 admin admin] PATH_INFO: `/v3/projects/98037f17e86e46189c6487d4d5ae1d6c/users/b54c7ce84f3540b7898a06ab652aedee/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:14.730554 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c5be3-728f-426d-bb79-e7610396eb80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98037f17e86e46189c6487d4d5ae1d6c, user_id=b54c7ce84f3540b7898a06ab652aedee, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:14.733539 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c5be3-728f-426d-bb79-e7610396eb80 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:14.751473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1325/2623] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:14 2022] PUT /identity/v3/projects/98037f17e86e46189c6487d4d5ae1d6c/users/b54c7ce84f3540b7898a06ab652aedee/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:14.757126 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b3eb8-ae6e-42d5-9093-9ca5d2bf10cb admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:14.769206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b3eb8-ae6e-42d5-9093-9ca5d2bf10cb admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:14.788891 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:14.844888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e8cdc-18e4-4db1-9ca5-da54b70afbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:14.844888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e8cdc-18e4-4db1-9ca5-da54b70afbfb admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:14.845117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e8cdc-18e4-4db1-9ca5-da54b70afbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:14.845208 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e8cdc-18e4-4db1-9ca5-da54b70afbfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:14.846155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e8cdc-18e4-4db1-9ca5-da54b70afbfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:14.848705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e8cdc-18e4-4db1-9ca5-da54b70afbfb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:14.860097 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1299/2624] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:40:14.869152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c5be3-728f-426d-bb79-e7610396eb80 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:14.882230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c5be3-728f-426d-bb79-e7610396eb80 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:14.889571 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f2dd1-a75c-4fdf-bfd5-f2bfc3f99601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:14.890656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f2dd1-a75c-4fdf-bfd5-f2bfc3f99601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:14.891147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f2dd1-a75c-4fdf-bfd5-f2bfc3f99601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:14.891593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f2dd1-a75c-4fdf-bfd5-f2bfc3f99601 admin admin] PATH_INFO: `/v3/projects/98037f17e86e46189c6487d4d5ae1d6c/users/b54c7ce84f3540b7898a06ab652aedee/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:14.895475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f2dd1-a75c-4fdf-bfd5-f2bfc3f99601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98037f17e86e46189c6487d4d5ae1d6c, user_id=b54c7ce84f3540b7898a06ab652aedee, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:14.898160 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f2dd1-a75c-4fdf-bfd5-f2bfc3f99601 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:14.916317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1326/2625] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:14 2022] PUT /identity/v3/projects/98037f17e86e46189c6487d4d5ae1d6c/users/b54c7ce84f3540b7898a06ab652aedee/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:14.934921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c10463-b963-4003-89de-e032899b1b1f None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:14.935225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c10463-b963-4003-89de-e032899b1b1f None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:14.935512 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c10463-b963-4003-89de-e032899b1b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:14.967931 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-32c10463-b963-4003-89de-e032899b1b1f None None] MFA Rules not processed for user `b54c7ce84f3540b7898a06ab652aedee`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:14.969162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-32c10463-b963-4003-89de-e032899b1b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:15.059102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1300/2626] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:15.072948 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f2dd1-a75c-4fdf-bfd5-f2bfc3f99601 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:15.074796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-183f2dd1-a75c-4fdf-bfd5-f2bfc3f99601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:15.083144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:15.151743 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f2dd1-a75c-4fdf-bfd5-f2bfc3f99601 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:15.157042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52e2ca-ce50-499a-9891-59f2ed6c4a86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:15.157811 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52e2ca-ce50-499a-9891-59f2ed6c4a86 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:15.158099 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52e2ca-ce50-499a-9891-59f2ed6c4a86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:15.158379 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52e2ca-ce50-499a-9891-59f2ed6c4a86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:15.170615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52e2ca-ce50-499a-9891-59f2ed6c4a86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:15.172054 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52e2ca-ce50-499a-9891-59f2ed6c4a86 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:15.182902 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1327/2627] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:40:16.724016 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c10463-b963-4003-89de-e032899b1b1f None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:16.791439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c10463-b963-4003-89de-e032899b1b1f None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:16.797090 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:16.797748 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:16.798036 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:16.798313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] PATH_INFO: `/v3/users/154b5dfdb320456bb992111c66db6662` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:16.800261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=154b5dfdb320456bb992111c66db6662)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:16.802576 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:16.851004 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:16.853742 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154b5dfdb320456bb992111c66db6662'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:16.863168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154b5dfdb320456bb992111c66db6662'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:16.870842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154b5dfdb320456bb992111c66db6662'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:16.871762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154b5dfdb320456bb992111c66db6662'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:16.872544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154b5dfdb320456bb992111c66db6662'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:16.896117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1301/2628] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:40:16 2022] DELETE /identity/v3/users/154b5dfdb320456bb992111c66db6662 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:16.901233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43727-ffd2-4ce1-864b-544eec5daca0 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:16.901733 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43727-ffd2-4ce1-864b-544eec5daca0 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:16.902157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43727-ffd2-4ce1-864b-544eec5daca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:16.922602 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-4dd43727-ffd2-4ce1-864b-544eec5daca0 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:16.923835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4dd43727-ffd2-4ce1-864b-544eec5daca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:16.996788 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1328/2629] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:17.007240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:17.008862 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:17.077968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147b32b-57bd-4f58-8992-8523e265a8b9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:17.084503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e649b-065a-46ea-88be-08d80926d1eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:17.085157 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e649b-065a-46ea-88be-08d80926d1eb service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:17.085440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e649b-065a-46ea-88be-08d80926d1eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:17.085718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e649b-065a-46ea-88be-08d80926d1eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:17.095756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e649b-065a-46ea-88be-08d80926d1eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:17.097859 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e649b-065a-46ea-88be-08d80926d1eb service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:17.108125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1302/2630] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:17.433608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43727-ffd2-4ce1-864b-544eec5daca0 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:17.435065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4dd43727-ffd2-4ce1-864b-544eec5daca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:17.448201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43727-ffd2-4ce1-864b-544eec5daca0 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:17.455128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:17.455848 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:17.456211 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:17.456492 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] PATH_INFO: `/v3/projects/faf28ac9a16d42a8b23dd7d47c7bc614` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:17.457762 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf28ac9a16d42a8b23dd7d47c7bc614)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:17.459748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:17.526098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf28ac9a16d42a8b23dd7d47c7bc614', 'request_id': 'req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:17.533407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf28ac9a16d42a8b23dd7d47c7bc614', 'request_id': 'req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:17.540252 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf28ac9a16d42a8b23dd7d47c7bc614', 'request_id': 'req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:17.556441 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] The token cache is being invalidate because project faf28ac9a16d42a8b23dd7d47c7bc614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:40:17.556941 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:17.557706 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:17.559998 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1329/2631] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:40:17 2022] DELETE /identity/v3/projects/faf28ac9a16d42a8b23dd7d47c7bc614 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:17.565979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e649b-065a-46ea-88be-08d80926d1eb service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:17.578741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e649b-065a-46ea-88be-08d80926d1eb service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:17.678718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5690c3-890d-4384-8320-d983d6de296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:17.679103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5690c3-890d-4384-8320-d983d6de296c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:17.679351 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5690c3-890d-4384-8320-d983d6de296c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:17.679679 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5690c3-890d-4384-8320-d983d6de296c admin admin] PATH_INFO: `/v3/users/b54c7ce84f3540b7898a06ab652aedee` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:17.680910 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5690c3-890d-4384-8320-d983d6de296c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54c7ce84f3540b7898a06ab652aedee)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:17.683745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5690c3-890d-4384-8320-d983d6de296c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:17.760511 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6a5690c3-890d-4384-8320-d983d6de296c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54c7ce84f3540b7898a06ab652aedee'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:17.772465 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6a5690c3-890d-4384-8320-d983d6de296c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54c7ce84f3540b7898a06ab652aedee'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:17.786413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6a5690c3-890d-4384-8320-d983d6de296c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54c7ce84f3540b7898a06ab652aedee'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:17.788067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6a5690c3-890d-4384-8320-d983d6de296c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54c7ce84f3540b7898a06ab652aedee'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:17.789726 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6a5690c3-890d-4384-8320-d983d6de296c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54c7ce84f3540b7898a06ab652aedee'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:17.793876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:17.822848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1303/2632] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:40:17 2022] DELETE /identity/v3/users/b54c7ce84f3540b7898a06ab652aedee => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:18.133147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:18.134703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:18.148525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbab7b5-e08a-47cd-9e57-bd79c121bed9 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:18.194870 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:18.229331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:18.229994 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:18.230277 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:18.230688 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a admin admin] PATH_INFO: `/v3/projects/98037f17e86e46189c6487d4d5ae1d6c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:18.231909 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=98037f17e86e46189c6487d4d5ae1d6c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:18.233837 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:18.293877 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98037f17e86e46189c6487d4d5ae1d6c', 'request_id': 'req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:18.301053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98037f17e86e46189c6487d4d5ae1d6c', 'request_id': 'req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:18.308433 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98037f17e86e46189c6487d4d5ae1d6c', 'request_id': 'req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:18.324947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a admin admin] The token cache is being invalidate because project 98037f17e86e46189c6487d4d5ae1d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:40:18.325280 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:18.326053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-29a1f3d1-3c11-41e0-b26d-7d9ab2fafb6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:18.327947 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1330/2633] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:40:18 2022] DELETE /identity/v3/projects/98037f17e86e46189c6487d4d5ae1d6c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:18.335695 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193f0ca-8844-4890-a5a9-d2f53a0e9f5c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:18.336106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193f0ca-8844-4890-a5a9-d2f53a0e9f5c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:18.336454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193f0ca-8844-4890-a5a9-d2f53a0e9f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:18.363810 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c193f0ca-8844-4890-a5a9-d2f53a0e9f5c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:18.365852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c193f0ca-8844-4890-a5a9-d2f53a0e9f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:18.438568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1304/2634] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:18.447271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1629ff-6663-40a8-a039-8245c99a45a8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:18.447562 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1629ff-6663-40a8-a039-8245c99a45a8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:18.447846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1629ff-6663-40a8-a039-8245c99a45a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:18.469263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-7b1629ff-6663-40a8-a039-8245c99a45a8 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:18.470496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-7b1629ff-6663-40a8-a039-8245c99a45a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:18.479002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1331/2635] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:18.484452 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193f0ca-8844-4890-a5a9-d2f53a0e9f5c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:18.496203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193f0ca-8844-4890-a5a9-d2f53a0e9f5c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:18.501457 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2ea40-051e-4f01-a557-23cd3834f839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:18.502080 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2ea40-051e-4f01-a557-23cd3834f839 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:18.502369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2ea40-051e-4f01-a557-23cd3834f839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:18.503694 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2ea40-051e-4f01-a557-23cd3834f839 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:18.504627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2ea40-051e-4f01-a557-23cd3834f839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:40:18.505169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2ea40-051e-4f01-a557-23cd3834f839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:18.507696 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2ea40-051e-4f01-a557-23cd3834f839 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:18.520295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1305/2636] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:40:18.524833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1629ff-6663-40a8-a039-8245c99a45a8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:18.535316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1629ff-6663-40a8-a039-8245c99a45a8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:18.540190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3efba-828e-477c-bd00-95c96d45b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:18.540819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3efba-828e-477c-bd00-95c96d45b85a admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:18.541097 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3efba-828e-477c-bd00-95c96d45b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:18.541372 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3efba-828e-477c-bd00-95c96d45b85a admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:18.542108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3efba-828e-477c-bd00-95c96d45b85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:18.544146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3efba-828e-477c-bd00-95c96d45b85a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:18.573731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1332/2637] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:40:18 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:18.578733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2ea40-051e-4f01-a557-23cd3834f839 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:18.592732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2ea40-051e-4f01-a557-23cd3834f839 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:18.656357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c6c32-223b-423f-8134-babdd21fb023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:18.657407 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6c32-223b-423f-8134-babdd21fb023 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:18.657759 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6c32-223b-423f-8134-babdd21fb023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:18.658224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6c32-223b-423f-8134-babdd21fb023 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:18.659917 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c6c32-223b-423f-8134-babdd21fb023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:18.662231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c6c32-223b-423f-8134-babdd21fb023 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:18.689453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1306/2638] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:40:18 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:18.694264 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3efba-828e-477c-bd00-95c96d45b85a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:18.711406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3efba-828e-477c-bd00-95c96d45b85a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:18.717403 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35991-f141-45ca-9138-5d3209a11cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:18.718200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35991-f141-45ca-9138-5d3209a11cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:18.718509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35991-f141-45ca-9138-5d3209a11cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:18.718785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35991-f141-45ca-9138-5d3209a11cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:18.719495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c35991-f141-45ca-9138-5d3209a11cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:18.721147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c35991-f141-45ca-9138-5d3209a11cc4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:18.733717 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1333/2639] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:40:18.740425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c6c32-223b-423f-8134-babdd21fb023 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:18.753491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c6c32-223b-423f-8134-babdd21fb023 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:18.759454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b40eba-85ff-4290-ae25-1f91599fa438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:18.760270 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40eba-85ff-4290-ae25-1f91599fa438 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:18.760719 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40eba-85ff-4290-ae25-1f91599fa438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:18.762250 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40eba-85ff-4290-ae25-1f91599fa438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:18.762250 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b40eba-85ff-4290-ae25-1f91599fa438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:18.763546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b40eba-85ff-4290-ae25-1f91599fa438 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:18.775189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1307/2640] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:40:18.779392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35991-f141-45ca-9138-5d3209a11cc4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:18.790324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35991-f141-45ca-9138-5d3209a11cc4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:18.795071 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa1182-cfc5-4329-850b-f54b687e391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:18.795679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1182-cfc5-4329-850b-f54b687e391d admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:18.796035 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1182-cfc5-4329-850b-f54b687e391d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:18.796293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1182-cfc5-4329-850b-f54b687e391d admin admin] PATH_INFO: `/v3/projects/278aa0a89b2244568f57fbba5249f351/users/f339196b6b564c729b97d0e51bc417f0/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:18.813613 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa1182-cfc5-4329-850b-f54b687e391d admin admin] RBAC: Authorizing `identity:create_grant(project_id=278aa0a89b2244568f57fbba5249f351, user_id=f339196b6b564c729b97d0e51bc417f0, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:18.816496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa1182-cfc5-4329-850b-f54b687e391d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:18.831525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1334/2641] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:18 2022] PUT /identity/v3/projects/278aa0a89b2244568f57fbba5249f351/users/f339196b6b564c729b97d0e51bc417f0/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:18.849477 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a87b8-eabd-4f7a-9c79-ff073371bf84 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:18.849855 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a87b8-eabd-4f7a-9c79-ff073371bf84 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:18.850205 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a87b8-eabd-4f7a-9c79-ff073371bf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:18.879924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522f7e1-e0f9-42c1-980a-06f926d42d95 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:18.880298 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522f7e1-e0f9-42c1-980a-06f926d42d95 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:18.880588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522f7e1-e0f9-42c1-980a-06f926d42d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:18.897091 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-208a87b8-eabd-4f7a-9c79-ff073371bf84 None None] MFA Rules not processed for user `f339196b6b564c729b97d0e51bc417f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:18.898341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-208a87b8-eabd-4f7a-9c79-ff073371bf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:18.901600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a522f7e1-e0f9-42c1-980a-06f926d42d95 None None] MFA Rules not processed for user `9be0c8bbbfa04c3da1c6214b618302c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:18.902791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a522f7e1-e0f9-42c1-980a-06f926d42d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:18.940830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:18.958343 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:18.973144 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1335/2642] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:40:18.983132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1308/2643] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:18.988530 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522f7e1-e0f9-42c1-980a-06f926d42d95 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:19.064787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522f7e1-e0f9-42c1-980a-06f926d42d95 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:19.071164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd1a59-df8a-47a0-87fb-86b3c3decb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:19.071662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd1a59-df8a-47a0-87fb-86b3c3decb8e admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:19.071981 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd1a59-df8a-47a0-87fb-86b3c3decb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:19.072314 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd1a59-df8a-47a0-87fb-86b3c3decb8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:19.073190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd1a59-df8a-47a0-87fb-86b3c3decb8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:19.075879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd1a59-df8a-47a0-87fb-86b3c3decb8e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:19.110960 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1336/2644] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:40:18 2022] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:19.115052 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a87b8-eabd-4f7a-9c79-ff073371bf84 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:19.127147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a87b8-eabd-4f7a-9c79-ff073371bf84 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:19.201214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780980b7-60c1-4d8b-b1a9-5c364755fd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:19.201849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780980b7-60c1-4d8b-b1a9-5c364755fd15 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:19.202140 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780980b7-60c1-4d8b-b1a9-5c364755fd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:19.202424 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780980b7-60c1-4d8b-b1a9-5c364755fd15 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:19.203106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780980b7-60c1-4d8b-b1a9-5c364755fd15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:19.205111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780980b7-60c1-4d8b-b1a9-5c364755fd15 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:19.236500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1309/2645] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:40:19 2022] POST /identity/v3/users => generated 302 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:19.242341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd1a59-df8a-47a0-87fb-86b3c3decb8e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:19.254908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd1a59-df8a-47a0-87fb-86b3c3decb8e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:19.260817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02235700-d074-4aec-845b-eb8bba16c7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:19.261539 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02235700-d074-4aec-845b-eb8bba16c7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:19.261898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02235700-d074-4aec-845b-eb8bba16c7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:19.262418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02235700-d074-4aec-845b-eb8bba16c7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:19.263803 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02235700-d074-4aec-845b-eb8bba16c7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:19.265143 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02235700-d074-4aec-845b-eb8bba16c7a6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:19.279927 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1337/2646] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:40:19.282839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780980b7-60c1-4d8b-b1a9-5c364755fd15 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:19.295433 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780980b7-60c1-4d8b-b1a9-5c364755fd15 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:19.300724 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54970-a828-4b0b-8c58-19e538a58425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:19.301442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54970-a828-4b0b-8c58-19e538a58425 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:19.301938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54970-a828-4b0b-8c58-19e538a58425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:19.302282 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54970-a828-4b0b-8c58-19e538a58425 admin admin] PATH_INFO: `/v3/projects/ae813aaee48e4ef48744eff631dcafbb/users/2d57e7502e4347769cf91068296fc4f8/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:19.326098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc54970-a828-4b0b-8c58-19e538a58425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae813aaee48e4ef48744eff631dcafbb, user_id=2d57e7502e4347769cf91068296fc4f8, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:19.328742 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc54970-a828-4b0b-8c58-19e538a58425 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:19.345621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1310/2647] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:19 2022] PUT /identity/v3/projects/ae813aaee48e4ef48744eff631dcafbb/users/2d57e7502e4347769cf91068296fc4f8/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:19.351378 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02235700-d074-4aec-845b-eb8bba16c7a6 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:19.363258 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02235700-d074-4aec-845b-eb8bba16c7a6 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:19.441262 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f1367-0d43-426e-b8f9-5e626e48f0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:19.442099 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1367-0d43-426e-b8f9-5e626e48f0bc admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:19.442486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1367-0d43-426e-b8f9-5e626e48f0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:19.442937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1367-0d43-426e-b8f9-5e626e48f0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:19.443898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f1367-0d43-426e-b8f9-5e626e48f0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:19.445771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f1367-0d43-426e-b8f9-5e626e48f0bc admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:19.461180 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1338/2648] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:40:19.469853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54970-a828-4b0b-8c58-19e538a58425 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:19.484305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc54970-a828-4b0b-8c58-19e538a58425 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:19.490833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac55e8-fdb9-44ec-848f-70a8e8cc7d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:19.491524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac55e8-fdb9-44ec-848f-70a8e8cc7d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:19.491812 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac55e8-fdb9-44ec-848f-70a8e8cc7d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:19.492201 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac55e8-fdb9-44ec-848f-70a8e8cc7d6c admin admin] PATH_INFO: `/v3/projects/ae813aaee48e4ef48744eff631dcafbb/users/2d57e7502e4347769cf91068296fc4f8/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:19.494179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac55e8-fdb9-44ec-848f-70a8e8cc7d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae813aaee48e4ef48744eff631dcafbb, user_id=2d57e7502e4347769cf91068296fc4f8, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:19.496970 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac55e8-fdb9-44ec-848f-70a8e8cc7d6c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:19.510886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1311/2649] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:19 2022] PUT /identity/v3/projects/ae813aaee48e4ef48744eff631dcafbb/users/2d57e7502e4347769cf91068296fc4f8/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:19.524403 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca8d7e-b088-4396-8c3b-5e18ee38a1f4 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:19.525469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca8d7e-b088-4396-8c3b-5e18ee38a1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:19.526104 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca8d7e-b088-4396-8c3b-5e18ee38a1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:19.567037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8bca8d7e-b088-4396-8c3b-5e18ee38a1f4 None None] MFA Rules not processed for user `2d57e7502e4347769cf91068296fc4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:19.568227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8bca8d7e-b088-4396-8c3b-5e18ee38a1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:19.671362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:19.696912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1339/2650] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:19.711381 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac55e8-fdb9-44ec-848f-70a8e8cc7d6c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:19.713198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ecac55e8-fdb9-44ec-848f-70a8e8cc7d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:19.788030 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac55e8-fdb9-44ec-848f-70a8e8cc7d6c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:19.792848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4956f-01b7-4b8c-ac9b-b787e42dacd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:19.793654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4956f-01b7-4b8c-ac9b-b787e42dacd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:19.794044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4956f-01b7-4b8c-ac9b-b787e42dacd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:19.794410 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4956f-01b7-4b8c-ac9b-b787e42dacd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:19.815413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4956f-01b7-4b8c-ac9b-b787e42dacd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:19.818233 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4956f-01b7-4b8c-ac9b-b787e42dacd5 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:19.837249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1312/2651] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:19.914849 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca8d7e-b088-4396-8c3b-5e18ee38a1f4 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:19.917010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8bca8d7e-b088-4396-8c3b-5e18ee38a1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:19.931296 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca8d7e-b088-4396-8c3b-5e18ee38a1f4 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:19.937226 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a6745-28c0-4c3e-819c-e421f93ff810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:19.937870 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a6745-28c0-4c3e-819c-e421f93ff810 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:19.938153 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a6745-28c0-4c3e-819c-e421f93ff810 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:19.938432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a6745-28c0-4c3e-819c-e421f93ff810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:20.032632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a6745-28c0-4c3e-819c-e421f93ff810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:20.034209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a6745-28c0-4c3e-819c-e421f93ff810 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:20.045990 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1340/2652] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:23.610624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4956f-01b7-4b8c-ac9b-b787e42dacd5 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:23.654648 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:23.691214 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4956f-01b7-4b8c-ac9b-b787e42dacd5 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:23.696087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:23.696827 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:23.697105 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:23.697376 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] PATH_INFO: `/v3/users/f339196b6b564c729b97d0e51bc417f0` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:23.698565 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f339196b6b564c729b97d0e51bc417f0)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:23.700551 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:23.760167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f339196b6b564c729b97d0e51bc417f0'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:23.772883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f339196b6b564c729b97d0e51bc417f0'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:23.782566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f339196b6b564c729b97d0e51bc417f0'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:23.783449 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f339196b6b564c729b97d0e51bc417f0'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:23.785609 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f339196b6b564c729b97d0e51bc417f0'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:23.806829 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1313/2653] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:40:23 2022] DELETE /identity/v3/users/f339196b6b564c729b97d0e51bc417f0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:23.812264 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e151-5dac-449c-b4e4-f04a42197b91 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:23.812870 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e151-5dac-449c-b4e4-f04a42197b91 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:23.813106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e151-5dac-449c-b4e4-f04a42197b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:23.834283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0cf3e151-5dac-449c-b4e4-f04a42197b91 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:23.835532 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0cf3e151-5dac-449c-b4e4-f04a42197b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:23.906494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1341/2654] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:23.919402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:23.921329 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:24.006752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04f22a-9f40-4de8-943a-9d953a35326a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:24.010844 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aaef5-b197-49b6-b565-41c22a6bc852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:24.011484 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aaef5-b197-49b6-b565-41c22a6bc852 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:24.011767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aaef5-b197-49b6-b565-41c22a6bc852 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:24.012070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aaef5-b197-49b6-b565-41c22a6bc852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:24.024317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287aaef5-b197-49b6-b565-41c22a6bc852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:24.027084 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287aaef5-b197-49b6-b565-41c22a6bc852 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:24.040138 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1314/2655] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:24.567551 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3e151-5dac-449c-b4e4-f04a42197b91 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:24.569221 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0cf3e151-5dac-449c-b4e4-f04a42197b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:24.584328 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3e151-5dac-449c-b4e4-f04a42197b91 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:24.589432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:24.590113 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:24.590419 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:24.590691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] PATH_INFO: `/v3/projects/278aa0a89b2244568f57fbba5249f351` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:24.591983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=278aa0a89b2244568f57fbba5249f351)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:24.593999 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:24.662668 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278aa0a89b2244568f57fbba5249f351', 'request_id': 'req-12cde1e9-3ba2-4173-81e7-0a9d6568d385'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:24.672225 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278aa0a89b2244568f57fbba5249f351', 'request_id': 'req-12cde1e9-3ba2-4173-81e7-0a9d6568d385'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:24.681700 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278aa0a89b2244568f57fbba5249f351', 'request_id': 'req-12cde1e9-3ba2-4173-81e7-0a9d6568d385'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:24.700508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] The token cache is being invalidate because project 278aa0a89b2244568f57fbba5249f351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:40:24.700791 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:24.701515 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:24.703130 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1342/2656] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:40:24 2022] DELETE /identity/v3/projects/278aa0a89b2244568f57fbba5249f351 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:24.708117 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aaef5-b197-49b6-b565-41c22a6bc852 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:24.718951 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aaef5-b197-49b6-b565-41c22a6bc852 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:24.785016 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:24.797070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4da4e2-60b9-4c69-9e36-131394ce207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:24.797788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4da4e2-60b9-4c69-9e36-131394ce207a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:24.798256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4da4e2-60b9-4c69-9e36-131394ce207a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:24.798256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4da4e2-60b9-4c69-9e36-131394ce207a admin admin] PATH_INFO: `/v3/users/2d57e7502e4347769cf91068296fc4f8` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:24.800172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4da4e2-60b9-4c69-9e36-131394ce207a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d57e7502e4347769cf91068296fc4f8)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:24.802592 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4da4e2-60b9-4c69-9e36-131394ce207a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:24.861161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3a4da4e2-60b9-4c69-9e36-131394ce207a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d57e7502e4347769cf91068296fc4f8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:24.871772 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3a4da4e2-60b9-4c69-9e36-131394ce207a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d57e7502e4347769cf91068296fc4f8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:24.882325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3a4da4e2-60b9-4c69-9e36-131394ce207a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d57e7502e4347769cf91068296fc4f8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:24.883510 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3a4da4e2-60b9-4c69-9e36-131394ce207a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d57e7502e4347769cf91068296fc4f8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:24.884246 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3a4da4e2-60b9-4c69-9e36-131394ce207a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d57e7502e4347769cf91068296fc4f8'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:24.906337 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1315/2657] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:40:24 2022] DELETE /identity/v3/users/2d57e7502e4347769cf91068296fc4f8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:25.265422 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:25.267027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:25.284443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cde1e9-3ba2-4173-81e7-0a9d6568d385 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:25.307641 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:25.373200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441a737-1df1-463e-8abb-d4dab1cadfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:25.373872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a737-1df1-463e-8abb-d4dab1cadfe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:25.374253 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a737-1df1-463e-8abb-d4dab1cadfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:25.374421 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a737-1df1-463e-8abb-d4dab1cadfe1 admin admin] PATH_INFO: `/v3/projects/ae813aaee48e4ef48744eff631dcafbb` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:25.375912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441a737-1df1-463e-8abb-d4dab1cadfe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae813aaee48e4ef48744eff631dcafbb)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:25.378833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441a737-1df1-463e-8abb-d4dab1cadfe1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:25.441106 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c441a737-1df1-463e-8abb-d4dab1cadfe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae813aaee48e4ef48744eff631dcafbb', 'request_id': 'req-c441a737-1df1-463e-8abb-d4dab1cadfe1'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:25.450992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c441a737-1df1-463e-8abb-d4dab1cadfe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae813aaee48e4ef48744eff631dcafbb', 'request_id': 'req-c441a737-1df1-463e-8abb-d4dab1cadfe1'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:25.459965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c441a737-1df1-463e-8abb-d4dab1cadfe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae813aaee48e4ef48744eff631dcafbb', 'request_id': 'req-c441a737-1df1-463e-8abb-d4dab1cadfe1'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:25.480683 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c441a737-1df1-463e-8abb-d4dab1cadfe1 admin admin] The token cache is being invalidate because project ae813aaee48e4ef48744eff631dcafbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:40:25.481293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c441a737-1df1-463e-8abb-d4dab1cadfe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:25.482051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c441a737-1df1-463e-8abb-d4dab1cadfe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:25.483650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1343/2658] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:40:25 2022] DELETE /identity/v3/projects/ae813aaee48e4ef48744eff631dcafbb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:40:25.489983 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133477-0e15-45a3-ad1f-b6bc6410df57 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:25.490384 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133477-0e15-45a3-ad1f-b6bc6410df57 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:25.490797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133477-0e15-45a3-ad1f-b6bc6410df57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:25.519101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-71133477-0e15-45a3-ad1f-b6bc6410df57 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:25.520492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-71133477-0e15-45a3-ad1f-b6bc6410df57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:25.595644 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1316/2659] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:25.604853 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b8373-a84f-4742-b7c4-9ef5c7e8eb14 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:25.605185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b8373-a84f-4742-b7c4-9ef5c7e8eb14 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:25.605417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b8373-a84f-4742-b7c4-9ef5c7e8eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:25.629031 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0e2b8373-a84f-4742-b7c4-9ef5c7e8eb14 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:25.630267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0e2b8373-a84f-4742-b7c4-9ef5c7e8eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:25.639253 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1344/2660] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:40:25.643842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71133477-0e15-45a3-ad1f-b6bc6410df57 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:25.654632 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71133477-0e15-45a3-ad1f-b6bc6410df57 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:25.660502 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03f31d-e418-4b42-8988-a62051ad24d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:25.661142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03f31d-e418-4b42-8988-a62051ad24d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:25.661426 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03f31d-e418-4b42-8988-a62051ad24d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:25.661710 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03f31d-e418-4b42-8988-a62051ad24d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:25.662416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03f31d-e418-4b42-8988-a62051ad24d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:40:25.662726 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03f31d-e418-4b42-8988-a62051ad24d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:25.664362 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03f31d-e418-4b42-8988-a62051ad24d7 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:25.678165 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1317/2661] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 16:40:25.683190 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b8373-a84f-4742-b7c4-9ef5c7e8eb14 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:25.698914 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b8373-a84f-4742-b7c4-9ef5c7e8eb14 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:25.706137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40e298-922f-425a-87bc-d55bd3ba76e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:25.706885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40e298-922f-425a-87bc-d55bd3ba76e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:25.707172 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40e298-922f-425a-87bc-d55bd3ba76e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:25.707452 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40e298-922f-425a-87bc-d55bd3ba76e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:25.708164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40e298-922f-425a-87bc-d55bd3ba76e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:25.710188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40e298-922f-425a-87bc-d55bd3ba76e1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:25.744709 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1345/2662] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:40:25 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:25.751500 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03f31d-e418-4b42-8988-a62051ad24d7 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:25.769393 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03f31d-e418-4b42-8988-a62051ad24d7 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:25.840811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f04a3-f6e9-4f76-ad81-c05f47714dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:25.841835 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f04a3-f6e9-4f76-ad81-c05f47714dab admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:25.842343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f04a3-f6e9-4f76-ad81-c05f47714dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:25.842745 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f04a3-f6e9-4f76-ad81-c05f47714dab admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:25.843773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f04a3-f6e9-4f76-ad81-c05f47714dab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:25.848413 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f04a3-f6e9-4f76-ad81-c05f47714dab admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:25.860821 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:25.881819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1318/2663] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:40:25 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:25.886382 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40e298-922f-425a-87bc-d55bd3ba76e1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:25.900459 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40e298-922f-425a-87bc-d55bd3ba76e1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:25.906072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2be660-eaaf-4a8c-9dfb-355813ceab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:25.906751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2be660-eaaf-4a8c-9dfb-355813ceab15 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:25.907041 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2be660-eaaf-4a8c-9dfb-355813ceab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:25.907322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2be660-eaaf-4a8c-9dfb-355813ceab15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:25.908133 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2be660-eaaf-4a8c-9dfb-355813ceab15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:25.910161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2be660-eaaf-4a8c-9dfb-355813ceab15 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:25.922723 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1346/2664] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:40:25.927770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f04a3-f6e9-4f76-ad81-c05f47714dab admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:25.938316 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f04a3-f6e9-4f76-ad81-c05f47714dab admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:25.943624 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256cf48-fbb5-4aec-9b34-ea61f9093851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:25.944275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256cf48-fbb5-4aec-9b34-ea61f9093851 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:25.944566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256cf48-fbb5-4aec-9b34-ea61f9093851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:25.944848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256cf48-fbb5-4aec-9b34-ea61f9093851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:25.945548 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256cf48-fbb5-4aec-9b34-ea61f9093851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:25.947209 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256cf48-fbb5-4aec-9b34-ea61f9093851 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:25.959882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1319/2665] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:40:25.964323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2be660-eaaf-4a8c-9dfb-355813ceab15 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:25.975978 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2be660-eaaf-4a8c-9dfb-355813ceab15 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:25.980852 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb51e3-7c5e-412b-932f-254106a543c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:25.982772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb51e3-7c5e-412b-932f-254106a543c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:25.983057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb51e3-7c5e-412b-932f-254106a543c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:25.983370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb51e3-7c5e-412b-932f-254106a543c4 admin admin] PATH_INFO: `/v3/projects/82889906937a4ce0bd301a62d1cb5581/users/b8768036642c42f48a0aa8497148c86b/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:26.002392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb51e3-7c5e-412b-932f-254106a543c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82889906937a4ce0bd301a62d1cb5581, user_id=b8768036642c42f48a0aa8497148c86b, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:26.006521 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb51e3-7c5e-412b-932f-254106a543c4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:26.025976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1347/2666] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:25 2022] PUT /identity/v3/projects/82889906937a4ce0bd301a62d1cb5581/users/b8768036642c42f48a0aa8497148c86b/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:26.037746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e5b0d-c628-487c-b719-5b2e867d16fb None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:26.037746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e5b0d-c628-487c-b719-5b2e867d16fb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:26.037746 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e5b0d-c628-487c-b719-5b2e867d16fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:26.068940 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-e62e5b0d-c628-487c-b719-5b2e867d16fb None None] MFA Rules not processed for user `b8768036642c42f48a0aa8497148c86b`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:26.070184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-e62e5b0d-c628-487c-b719-5b2e867d16fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:26.145592 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1320/2667] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:40:26.150171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb51e3-7c5e-412b-932f-254106a543c4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:26.210884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:26.240426 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb51e3-7c5e-412b-932f-254106a543c4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:26.245536 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa9aee-4b06-4504-b8f7-472e427f9fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:26.246165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa9aee-4b06-4504-b8f7-472e427f9fde admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:26.246443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa9aee-4b06-4504-b8f7-472e427f9fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:26.246721 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa9aee-4b06-4504-b8f7-472e427f9fde admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:26.247387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa9aee-4b06-4504-b8f7-472e427f9fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:26.249316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa9aee-4b06-4504-b8f7-472e427f9fde admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:26.279408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1348/2668] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:40:26 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:26.285070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e5b0d-c628-487c-b719-5b2e867d16fb None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:26.301608 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e5b0d-c628-487c-b719-5b2e867d16fb None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:26.382339 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f88ba-a79f-4318-a9ac-a2d90d003637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:26.383081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f88ba-a79f-4318-a9ac-a2d90d003637 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:26.383441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f88ba-a79f-4318-a9ac-a2d90d003637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:26.383799 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f88ba-a79f-4318-a9ac-a2d90d003637 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:26.384577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f88ba-a79f-4318-a9ac-a2d90d003637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:26.386592 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f88ba-a79f-4318-a9ac-a2d90d003637 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:26.413294 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1321/2669] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:40:26 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:26.417047 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa9aee-4b06-4504-b8f7-472e427f9fde admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:26.428429 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa9aee-4b06-4504-b8f7-472e427f9fde admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:26.433319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd232dd9-307b-4648-a400-efc99ad31354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:26.433952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd232dd9-307b-4648-a400-efc99ad31354 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:26.434295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd232dd9-307b-4648-a400-efc99ad31354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:26.434579 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd232dd9-307b-4648-a400-efc99ad31354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:26.435369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd232dd9-307b-4648-a400-efc99ad31354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:26.437029 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd232dd9-307b-4648-a400-efc99ad31354 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:26.456157 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1349/2670] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:40:26.459724 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f88ba-a79f-4318-a9ac-a2d90d003637 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:26.473285 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f88ba-a79f-4318-a9ac-a2d90d003637 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:26.478909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411616e-67f2-4005-856f-0f36df1bc9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:26.479701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411616e-67f2-4005-856f-0f36df1bc9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:26.480096 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411616e-67f2-4005-856f-0f36df1bc9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:26.480473 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411616e-67f2-4005-856f-0f36df1bc9c9 admin admin] PATH_INFO: `/v3/projects/e55c1537062742418c8b99a98a03a233/users/c11556a1e8914ec9aa42666a897685ad/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:26.498982 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411616e-67f2-4005-856f-0f36df1bc9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e55c1537062742418c8b99a98a03a233, user_id=c11556a1e8914ec9aa42666a897685ad, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:26.501994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411616e-67f2-4005-856f-0f36df1bc9c9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:26.516828 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1322/2671] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:26 2022] PUT /identity/v3/projects/e55c1537062742418c8b99a98a03a233/users/c11556a1e8914ec9aa42666a897685ad/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:40:26.522341 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd232dd9-307b-4648-a400-efc99ad31354 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:26.552967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd232dd9-307b-4648-a400-efc99ad31354 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:26.656123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcf605-f1d8-46d8-b3f1-a8d4a596439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:26.656946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf605-f1d8-46d8-b3f1-a8d4a596439d admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:26.657376 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf605-f1d8-46d8-b3f1-a8d4a596439d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:26.657695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf605-f1d8-46d8-b3f1-a8d4a596439d admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:26.658471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcf605-f1d8-46d8-b3f1-a8d4a596439d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:26.661584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcf605-f1d8-46d8-b3f1-a8d4a596439d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:26.673752 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1350/2672] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:40:26.679547 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411616e-67f2-4005-856f-0f36df1bc9c9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:26.694836 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411616e-67f2-4005-856f-0f36df1bc9c9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:26.700713 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af8036-29fc-489a-87a9-69b030a6eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:26.701517 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af8036-29fc-489a-87a9-69b030a6eda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:26.701806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af8036-29fc-489a-87a9-69b030a6eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:26.702089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af8036-29fc-489a-87a9-69b030a6eda5 admin admin] PATH_INFO: `/v3/projects/e55c1537062742418c8b99a98a03a233/users/c11556a1e8914ec9aa42666a897685ad/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:26.704371 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af8036-29fc-489a-87a9-69b030a6eda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e55c1537062742418c8b99a98a03a233, user_id=c11556a1e8914ec9aa42666a897685ad, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:26.707774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af8036-29fc-489a-87a9-69b030a6eda5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:26.719911 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1323/2673] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:26 2022] PUT /identity/v3/projects/e55c1537062742418c8b99a98a03a233/users/c11556a1e8914ec9aa42666a897685ad/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:26.733108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0db11-cd7d-4635-bd57-c5eb38486196 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:26.733414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0db11-cd7d-4635-bd57-c5eb38486196 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:26.733698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0db11-cd7d-4635-bd57-c5eb38486196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:26.767446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-33b0db11-cd7d-4635-bd57-c5eb38486196 None None] MFA Rules not processed for user `c11556a1e8914ec9aa42666a897685ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:26.769289 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-33b0db11-cd7d-4635-bd57-c5eb38486196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:26.875958 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1351/2674] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:26.887546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af8036-29fc-489a-87a9-69b030a6eda5 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:26.891160 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-37af8036-29fc-489a-87a9-69b030a6eda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:26.928234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:26.982032 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af8036-29fc-489a-87a9-69b030a6eda5 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:26.988516 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011288a-cecb-41d7-84c9-aed0cf6489f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:26.989313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011288a-cecb-41d7-84c9-aed0cf6489f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:26.989611 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011288a-cecb-41d7-84c9-aed0cf6489f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:26.989886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011288a-cecb-41d7-84c9-aed0cf6489f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:27.005406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011288a-cecb-41d7-84c9-aed0cf6489f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:27.008290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011288a-cecb-41d7-84c9-aed0cf6489f0 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:27.021845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1324/2675] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:27.172960 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0db11-cd7d-4635-bd57-c5eb38486196 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:27.186126 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0db11-cd7d-4635-bd57-c5eb38486196 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:27.189857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163db6f-de24-4684-9bf1-342ae722ad16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:27.190782 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163db6f-de24-4684-9bf1-342ae722ad16 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:27.191511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163db6f-de24-4684-9bf1-342ae722ad16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:27.192009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163db6f-de24-4684-9bf1-342ae722ad16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:27.241026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:27.265426 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163db6f-de24-4684-9bf1-342ae722ad16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:27.266905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163db6f-de24-4684-9bf1-342ae722ad16 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:27.279292 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1352/2676] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:29.989789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011288a-cecb-41d7-84c9-aed0cf6489f0 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:30.069791 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011288a-cecb-41d7-84c9-aed0cf6489f0 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:30.075453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:30.076251 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:30.076747 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:30.077199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] PATH_INFO: `/v3/users/b8768036642c42f48a0aa8497148c86b` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:30.078539 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8768036642c42f48a0aa8497148c86b)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:30.080716 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:30.136622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8768036642c42f48a0aa8497148c86b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:30.146402 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8768036642c42f48a0aa8497148c86b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:30.159095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8768036642c42f48a0aa8497148c86b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:30.160664 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8768036642c42f48a0aa8497148c86b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:30.161550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8768036642c42f48a0aa8497148c86b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:30.183632 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1325/2677] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:40:29 2022] DELETE /identity/v3/users/b8768036642c42f48a0aa8497148c86b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:30.188253 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3efd1-b680-48c3-b075-e83ff22274a8 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:30.188866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3efd1-b680-48c3-b075-e83ff22274a8 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:30.188866 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3efd1-b680-48c3-b075-e83ff22274a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:30.212976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-dfb3efd1-b680-48c3-b075-e83ff22274a8 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:30.214214 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-dfb3efd1-b680-48c3-b075-e83ff22274a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:30.280589 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1353/2678] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:30.291256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:30.292784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:30.345397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:30.361451 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82474983-3a84-4f59-955e-038925e50fff admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:30.367242 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b7d3c-c7f1-4465-a628-687a58928e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:30.367959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b7d3c-c7f1-4465-a628-687a58928e67 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:30.368278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b7d3c-c7f1-4465-a628-687a58928e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:30.368554 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b7d3c-c7f1-4465-a628-687a58928e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:30.379523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b7d3c-c7f1-4465-a628-687a58928e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:30.381488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b7d3c-c7f1-4465-a628-687a58928e67 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:30.397076 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1326/2679] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:40:30.785525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3efd1-b680-48c3-b075-e83ff22274a8 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:30.793660 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-dfb3efd1-b680-48c3-b075-e83ff22274a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:30.824479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3efd1-b680-48c3-b075-e83ff22274a8 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:30.830730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:30.831678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:30.832083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:30.832503 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] PATH_INFO: `/v3/projects/82889906937a4ce0bd301a62d1cb5581` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:30.833965 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82889906937a4ce0bd301a62d1cb5581)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:30.835928 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:30.899343 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82889906937a4ce0bd301a62d1cb5581', 'request_id': 'req-e4043a4e-65c0-404f-9851-3450ccb3b4a4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:30.913255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82889906937a4ce0bd301a62d1cb5581', 'request_id': 'req-e4043a4e-65c0-404f-9851-3450ccb3b4a4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:30.920162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82889906937a4ce0bd301a62d1cb5581', 'request_id': 'req-e4043a4e-65c0-404f-9851-3450ccb3b4a4'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:30.938428 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] The token cache is being invalidate because project 82889906937a4ce0bd301a62d1cb5581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:40:30.938783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:30.939699 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:30.942152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1354/2680] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:40:30 2022] DELETE /identity/v3/projects/82889906937a4ce0bd301a62d1cb5581 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:30.946767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b7d3c-c7f1-4465-a628-687a58928e67 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:30.959591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b7d3c-c7f1-4465-a628-687a58928e67 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:31.043847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604df6a6-2f36-4e4d-820c-613f488a115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:31.044909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604df6a6-2f36-4e4d-820c-613f488a115e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:31.045359 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604df6a6-2f36-4e4d-820c-613f488a115e admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:31.045816 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604df6a6-2f36-4e4d-820c-613f488a115e admin admin] PATH_INFO: `/v3/users/c11556a1e8914ec9aa42666a897685ad` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:31.047841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604df6a6-2f36-4e4d-820c-613f488a115e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11556a1e8914ec9aa42666a897685ad)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:31.053874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604df6a6-2f36-4e4d-820c-613f488a115e admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:31.125636 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-604df6a6-2f36-4e4d-820c-613f488a115e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11556a1e8914ec9aa42666a897685ad'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:31.137340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-604df6a6-2f36-4e4d-820c-613f488a115e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11556a1e8914ec9aa42666a897685ad'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:31.151769 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-604df6a6-2f36-4e4d-820c-613f488a115e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11556a1e8914ec9aa42666a897685ad'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:31.154861 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-604df6a6-2f36-4e4d-820c-613f488a115e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11556a1e8914ec9aa42666a897685ad'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:31.155853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-604df6a6-2f36-4e4d-820c-613f488a115e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11556a1e8914ec9aa42666a897685ad'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:31.188665 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1327/2681] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:40:30 2022] DELETE /identity/v3/users/c11556a1e8914ec9aa42666a897685ad => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:40:31.567076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:31.569614 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:31.588890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4043a4e-65c0-404f-9851-3450ccb3b4a4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:31.680451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:31.681540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:31.682042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:31.682519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf admin admin] PATH_INFO: `/v3/projects/e55c1537062742418c8b99a98a03a233` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:31.685049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e55c1537062742418c8b99a98a03a233)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:31.689103 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:31.692859 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:31.756921 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e55c1537062742418c8b99a98a03a233', 'request_id': 'req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:31.765137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e55c1537062742418c8b99a98a03a233', 'request_id': 'req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:31.776693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e55c1537062742418c8b99a98a03a233', 'request_id': 'req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:31.795451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf admin admin] The token cache is being invalidate because project e55c1537062742418c8b99a98a03a233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:40:31.795849 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:31.796922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-145a6e78-f4f1-490e-9e5b-2aae74b0dddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:31.799037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1355/2682] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:40:31 2022] DELETE /identity/v3/projects/e55c1537062742418c8b99a98a03a233 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:31.805794 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805dd3e-1719-46d7-9655-5b54719ccad6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:31.806086 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805dd3e-1719-46d7-9655-5b54719ccad6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:31.806368 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805dd3e-1719-46d7-9655-5b54719ccad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:31.832523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-8805dd3e-1719-46d7-9655-5b54719ccad6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:31.834636 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-8805dd3e-1719-46d7-9655-5b54719ccad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:31.911737 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1328/2683] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:31.920945 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45f567-fdd3-4a95-b0f7-7b50c9038c5b None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:31.921232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45f567-fdd3-4a95-b0f7-7b50c9038c5b None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:31.921527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45f567-fdd3-4a95-b0f7-7b50c9038c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:31.944274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0a45f567-fdd3-4a95-b0f7-7b50c9038c5b None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:31.945619 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0a45f567-fdd3-4a95-b0f7-7b50c9038c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:31.956944 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1356/2684] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:40:31.964682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805dd3e-1719-46d7-9655-5b54719ccad6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:31.980509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805dd3e-1719-46d7-9655-5b54719ccad6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:31.985741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01cb32-03ab-4a25-9d36-9c33388aeef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:31.986591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01cb32-03ab-4a25-9d36-9c33388aeef5 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:31.986927 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01cb32-03ab-4a25-9d36-9c33388aeef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:31.987241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01cb32-03ab-4a25-9d36-9c33388aeef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:31.988239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01cb32-03ab-4a25-9d36-9c33388aeef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:40:31.988552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01cb32-03ab-4a25-9d36-9c33388aeef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:31.990583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01cb32-03ab-4a25-9d36-9c33388aeef5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:31.993027 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:32.014494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1329/2685] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:40:32.016015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45f567-fdd3-4a95-b0f7-7b50c9038c5b None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:32.027512 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45f567-fdd3-4a95-b0f7-7b50c9038c5b None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:32.034779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaddf22-cefb-485d-9d00-86f0874536c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:32.035399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaddf22-cefb-485d-9d00-86f0874536c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:32.035698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaddf22-cefb-485d-9d00-86f0874536c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:32.036010 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaddf22-cefb-485d-9d00-86f0874536c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:32.036784 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaddf22-cefb-485d-9d00-86f0874536c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:32.038828 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaddf22-cefb-485d-9d00-86f0874536c1 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:32.069434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1357/2686] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:40:32 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:32.075621 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01cb32-03ab-4a25-9d36-9c33388aeef5 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:32.087519 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01cb32-03ab-4a25-9d36-9c33388aeef5 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:32.152039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140acd42-4932-4828-b957-8fd99e205e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:32.152669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140acd42-4932-4828-b957-8fd99e205e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:32.152948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140acd42-4932-4828-b957-8fd99e205e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:32.153230 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140acd42-4932-4828-b957-8fd99e205e17 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:32.153905 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140acd42-4932-4828-b957-8fd99e205e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:32.155936 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140acd42-4932-4828-b957-8fd99e205e17 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:32.180094 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1330/2687] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:40:32 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:32.184504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaddf22-cefb-485d-9d00-86f0874536c1 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:32.195771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaddf22-cefb-485d-9d00-86f0874536c1 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:32.200528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9ff91-83db-44d8-9b0c-d0bdbb6becc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:32.201131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9ff91-83db-44d8-9b0c-d0bdbb6becc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:32.201414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9ff91-83db-44d8-9b0c-d0bdbb6becc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:32.201693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9ff91-83db-44d8-9b0c-d0bdbb6becc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:32.202382 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9ff91-83db-44d8-9b0c-d0bdbb6becc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:32.204016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9ff91-83db-44d8-9b0c-d0bdbb6becc6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:32.214722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1358/2688] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:40:32.218849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140acd42-4932-4828-b957-8fd99e205e17 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:32.230174 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140acd42-4932-4828-b957-8fd99e205e17 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:32.235070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efc588-703a-4b05-9dcd-d6c613592102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:32.235737 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efc588-703a-4b05-9dcd-d6c613592102 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:32.236061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efc588-703a-4b05-9dcd-d6c613592102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:32.236343 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efc588-703a-4b05-9dcd-d6c613592102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:32.237325 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efc588-703a-4b05-9dcd-d6c613592102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:32.238769 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efc588-703a-4b05-9dcd-d6c613592102 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:32.251104 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1331/2689] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:40:32.256199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9ff91-83db-44d8-9b0c-d0bdbb6becc6 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:32.267564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9ff91-83db-44d8-9b0c-d0bdbb6becc6 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:32.272689 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dc9c8-b1fa-4312-b07e-6a2e861c973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:32.273372 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc9c8-b1fa-4312-b07e-6a2e861c973c admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:32.273656 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc9c8-b1fa-4312-b07e-6a2e861c973c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:32.273961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc9c8-b1fa-4312-b07e-6a2e861c973c admin admin] PATH_INFO: `/v3/projects/c944c43ba911492a827900639378d4ea/users/c6c5d2815121493fbbcb6fea85ae1a0a/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:32.291428 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dc9c8-b1fa-4312-b07e-6a2e861c973c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c944c43ba911492a827900639378d4ea, user_id=c6c5d2815121493fbbcb6fea85ae1a0a, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:32.294155 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dc9c8-b1fa-4312-b07e-6a2e861c973c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:32.318275 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1359/2690] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:32 2022] PUT /identity/v3/projects/c944c43ba911492a827900639378d4ea/users/c6c5d2815121493fbbcb6fea85ae1a0a/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:40:32.325078 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6af14-fbb6-4580-a15c-ffe7da958593 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:32.325458 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6af14-fbb6-4580-a15c-ffe7da958593 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:32.325789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6af14-fbb6-4580-a15c-ffe7da958593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:32.348367 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-c7f6af14-fbb6-4580-a15c-ffe7da958593 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:32.349573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-c7f6af14-fbb6-4580-a15c-ffe7da958593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:32.412416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1332/2691] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:32.422451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dc9c8-b1fa-4312-b07e-6a2e861c973c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:32.424197 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-828dc9c8-b1fa-4312-b07e-6a2e861c973c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:32.482457 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dc9c8-b1fa-4312-b07e-6a2e861c973c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:32.488418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49637d7f-efb4-4280-a4e0-1ba598acb879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:32.489061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637d7f-efb4-4280-a4e0-1ba598acb879 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:32.489348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637d7f-efb4-4280-a4e0-1ba598acb879 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:32.489627 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637d7f-efb4-4280-a4e0-1ba598acb879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:32.499299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49637d7f-efb4-4280-a4e0-1ba598acb879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:32.501049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49637d7f-efb4-4280-a4e0-1ba598acb879 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:32.510759 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1360/2692] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:33.224353 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800d5e-3f3a-4027-8000-b5ea6d2b42df None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:33.224353 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800d5e-3f3a-4027-8000-b5ea6d2b42df None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:33.225110 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800d5e-3f3a-4027-8000-b5ea6d2b42df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:33.255655 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-01800d5e-3f3a-4027-8000-b5ea6d2b42df None None] MFA Rules not processed for user `c6c5d2815121493fbbcb6fea85ae1a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:33.257345 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-01800d5e-3f3a-4027-8000-b5ea6d2b42df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:33.371187 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1333/2693] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:33.372461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49637d7f-efb4-4280-a4e0-1ba598acb879 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:33.387968 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49637d7f-efb4-4280-a4e0-1ba598acb879 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:33.391843 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257b71d-d1a4-4f1b-a3ed-c2221a7586e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:33.392682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257b71d-d1a4-4f1b-a3ed-c2221a7586e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:33.395547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257b71d-d1a4-4f1b-a3ed-c2221a7586e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:33.395766 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257b71d-d1a4-4f1b-a3ed-c2221a7586e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:33.396588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257b71d-d1a4-4f1b-a3ed-c2221a7586e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:33.399520 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257b71d-d1a4-4f1b-a3ed-c2221a7586e4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:33.442938 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1361/2694] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:40:33 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:33.447139 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01800d5e-3f3a-4027-8000-b5ea6d2b42df None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:33.453228 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:33.463678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01800d5e-3f3a-4027-8000-b5ea6d2b42df None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:33.535067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a13b0e-ad2b-44ac-a25d-9c9df7f087ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:33.535693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a13b0e-ad2b-44ac-a25d-9c9df7f087ab admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:33.536079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a13b0e-ad2b-44ac-a25d-9c9df7f087ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:33.536366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a13b0e-ad2b-44ac-a25d-9c9df7f087ab admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:33.537059 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a13b0e-ad2b-44ac-a25d-9c9df7f087ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:33.539007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a13b0e-ad2b-44ac-a25d-9c9df7f087ab admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:33.563411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1334/2695] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:40:33 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:33.570319 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257b71d-d1a4-4f1b-a3ed-c2221a7586e4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:33.583246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257b71d-d1a4-4f1b-a3ed-c2221a7586e4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:33.588501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e64006-2a40-42f2-99e3-fbc39991560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:33.589223 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e64006-2a40-42f2-99e3-fbc39991560c admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:33.589597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e64006-2a40-42f2-99e3-fbc39991560c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:33.589943 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e64006-2a40-42f2-99e3-fbc39991560c admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:33.590729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e64006-2a40-42f2-99e3-fbc39991560c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:33.592439 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e64006-2a40-42f2-99e3-fbc39991560c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:33.594949 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:33.605846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1362/2696] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:40:33.611085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a13b0e-ad2b-44ac-a25d-9c9df7f087ab admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:33.622639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a13b0e-ad2b-44ac-a25d-9c9df7f087ab admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:33.628870 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3203cc-e2f6-4bec-ba3b-8bb4a3a47850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:33.629822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3203cc-e2f6-4bec-ba3b-8bb4a3a47850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:33.630181 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3203cc-e2f6-4bec-ba3b-8bb4a3a47850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:33.630524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3203cc-e2f6-4bec-ba3b-8bb4a3a47850 admin admin] PATH_INFO: `/v3/projects/7dbfb140f77747e8a2f35589ccb85d6e/users/0b4c0b70d16f4188af301d44411b0979/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:33.657663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3203cc-e2f6-4bec-ba3b-8bb4a3a47850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbfb140f77747e8a2f35589ccb85d6e, user_id=0b4c0b70d16f4188af301d44411b0979, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:33.661302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3203cc-e2f6-4bec-ba3b-8bb4a3a47850 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:33.677139 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1335/2697] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:33 2022] PUT /identity/v3/projects/7dbfb140f77747e8a2f35589ccb85d6e/users/0b4c0b70d16f4188af301d44411b0979/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:40:33.681191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e64006-2a40-42f2-99e3-fbc39991560c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:33.693220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e64006-2a40-42f2-99e3-fbc39991560c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:33.773576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d98da-3f2a-4f6f-9766-f1961ade97e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:33.775117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d98da-3f2a-4f6f-9766-f1961ade97e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:33.775516 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d98da-3f2a-4f6f-9766-f1961ade97e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:33.776072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d98da-3f2a-4f6f-9766-f1961ade97e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:33.777257 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d98da-3f2a-4f6f-9766-f1961ade97e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:33.779906 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d98da-3f2a-4f6f-9766-f1961ade97e5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:33.794636 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1363/2698] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:40:33.799248 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3203cc-e2f6-4bec-ba3b-8bb4a3a47850 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:33.812915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3203cc-e2f6-4bec-ba3b-8bb4a3a47850 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:33.819620 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218728fe-d2ac-42ce-b276-bb0a17cf7fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:33.820428 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218728fe-d2ac-42ce-b276-bb0a17cf7fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:33.820792 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218728fe-d2ac-42ce-b276-bb0a17cf7fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:33.821141 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218728fe-d2ac-42ce-b276-bb0a17cf7fad admin admin] PATH_INFO: `/v3/projects/7dbfb140f77747e8a2f35589ccb85d6e/users/0b4c0b70d16f4188af301d44411b0979/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:33.823388 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218728fe-d2ac-42ce-b276-bb0a17cf7fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbfb140f77747e8a2f35589ccb85d6e, user_id=0b4c0b70d16f4188af301d44411b0979, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:33.826578 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218728fe-d2ac-42ce-b276-bb0a17cf7fad admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:33.860056 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1336/2699] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:33 2022] PUT /identity/v3/projects/7dbfb140f77747e8a2f35589ccb85d6e/users/0b4c0b70d16f4188af301d44411b0979/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:34.538923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb807f33-002e-403b-974c-e66dbea7ede2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:34.539415 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb807f33-002e-403b-974c-e66dbea7ede2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:34.539561 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb807f33-002e-403b-974c-e66dbea7ede2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:34.569534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-fb807f33-002e-403b-974c-e66dbea7ede2 None None] MFA Rules not processed for user `0b4c0b70d16f4188af301d44411b0979`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:34.570681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fb807f33-002e-403b-974c-e66dbea7ede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:34.647489 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1364/2700] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:34.658474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d83ac-0674-46fc-8250-a66994589bc4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:34.658906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d83ac-0674-46fc-8250-a66994589bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:34.660155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d83ac-0674-46fc-8250-a66994589bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:34.680674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-712d83ac-0674-46fc-8250-a66994589bc4 None None] MFA Rules not processed for user `c6c5d2815121493fbbcb6fea85ae1a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:34.681896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-712d83ac-0674-46fc-8250-a66994589bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:34.742495 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1337/2701] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:34.754840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb807f33-002e-403b-974c-e66dbea7ede2 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:34.756628 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fb807f33-002e-403b-974c-e66dbea7ede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:34.833483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb807f33-002e-403b-974c-e66dbea7ede2 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:34.839230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8c03-b120-4b85-8635-bd160eef1ffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:34.839848 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8c03-b120-4b85-8635-bd160eef1ffa service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:34.840164 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8c03-b120-4b85-8635-bd160eef1ffa service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:34.840443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8c03-b120-4b85-8635-bd160eef1ffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:34.849390 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b8c03-b120-4b85-8635-bd160eef1ffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:34.850992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b8c03-b120-4b85-8635-bd160eef1ffa service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:34.860020 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1365/2702] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:36.825178 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb5e58-b1c2-4291-a3a3-d49feffa5936 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:36.825672 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb5e58-b1c2-4291-a3a3-d49feffa5936 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:36.825784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb5e58-b1c2-4291-a3a3-d49feffa5936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:36.845902 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-50bb5e58-b1c2-4291-a3a3-d49feffa5936 None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:36.847811 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-50bb5e58-b1c2-4291-a3a3-d49feffa5936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:36.908689 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1338/2703] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:40:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:36.934218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8c03-b120-4b85-8635-bd160eef1ffa service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:36.936230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a95b8c03-b120-4b85-8635-bd160eef1ffa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:36.942915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=100 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:37.026413 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8c03-b120-4b85-8635-bd160eef1ffa service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:37.034972 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7250c-1932-44a9-b7cf-e66c5e21b441 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:37.035651 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7250c-1932-44a9-b7cf-e66c5e21b441 service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:37.035976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7250c-1932-44a9-b7cf-e66c5e21b441 service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:37.036280 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7250c-1932-44a9-b7cf-e66c5e21b441 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:37.045770 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7250c-1932-44a9-b7cf-e66c5e21b441 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:37.047390 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7250c-1932-44a9-b7cf-e66c5e21b441 service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:37.057277 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1366/2704] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:40:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 16:40:42.865869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb5e58-b1c2-4291-a3a3-d49feffa5936 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:42.871526 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-50bb5e58-b1c2-4291-a3a3-d49feffa5936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:42.890789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:42.902540 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb5e58-b1c2-4291-a3a3-d49feffa5936 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:42.913364 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adae87-ecf6-44ac-953c-2336b19b3dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:42.914981 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adae87-ecf6-44ac-953c-2336b19b3dff service nova] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:42.915549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adae87-ecf6-44ac-953c-2336b19b3dff service nova] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:42.916040 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adae87-ecf6-44ac-953c-2336b19b3dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:42.918151 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-01adae87-ecf6-44ac-953c-2336b19b3dff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:42.935284 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adae87-ecf6-44ac-953c-2336b19b3dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:42.937275 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adae87-ecf6-44ac-953c-2336b19b3dff service nova] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:42.979017 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1339/2705] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:47.053805 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=30 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:48.192185 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7250c-1932-44a9-b7cf-e66c5e21b441 service swift] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:48.275261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7250c-1932-44a9-b7cf-e66c5e21b441 service swift] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:48.282181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb115d1-e1f7-455c-9aa4-1fcaec8236b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:48.283476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb115d1-e1f7-455c-9aa4-1fcaec8236b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:48.283967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb115d1-e1f7-455c-9aa4-1fcaec8236b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:48.285118 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb115d1-e1f7-455c-9aa4-1fcaec8236b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:48.287649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bdb115d1-e1f7-455c-9aa4-1fcaec8236b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:48.376141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb115d1-e1f7-455c-9aa4-1fcaec8236b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:48.377503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adae87-ecf6-44ac-953c-2336b19b3dff service nova] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:48.378935 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb115d1-e1f7-455c-9aa4-1fcaec8236b4 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:48.380762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-01adae87-ecf6-44ac-953c-2336b19b3dff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:48.408832 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1367/2706] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:48.496592 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adae87-ecf6-44ac-953c-2336b19b3dff service nova] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:48.500245 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5b109-a4d5-4b71-ad21-1cbefa3b103a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:48.501069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5b109-a4d5-4b71-ad21-1cbefa3b103a service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:48.501509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5b109-a4d5-4b71-ad21-1cbefa3b103a service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:48.502234 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5b109-a4d5-4b71-ad21-1cbefa3b103a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:48.512968 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5b109-a4d5-4b71-ad21-1cbefa3b103a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:48.514707 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5b109-a4d5-4b71-ad21-1cbefa3b103a service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:48.526180 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1340/2707] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:53.135799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb115d1-e1f7-455c-9aa4-1fcaec8236b4 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:53.140307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bdb115d1-e1f7-455c-9aa4-1fcaec8236b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:53.177895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb115d1-e1f7-455c-9aa4-1fcaec8236b4 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:53.184306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4e150-5913-4795-8da5-9e5a5b54c35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:53.184988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4e150-5913-4795-8da5-9e5a5b54c35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:53.185268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4e150-5913-4795-8da5-9e5a5b54c35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:53.185755 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4e150-5913-4795-8da5-9e5a5b54c35d admin admin] PATH_INFO: `/v3/users/17804273371846b7abdcbd663a06c227` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:53.187335 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4e150-5913-4795-8da5-9e5a5b54c35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=17804273371846b7abdcbd663a06c227)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:53.189414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4e150-5913-4795-8da5-9e5a5b54c35d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:53.256472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2e4e150-5913-4795-8da5-9e5a5b54c35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17804273371846b7abdcbd663a06c227'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:53.269325 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2e4e150-5913-4795-8da5-9e5a5b54c35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17804273371846b7abdcbd663a06c227'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:53.283128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2e4e150-5913-4795-8da5-9e5a5b54c35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17804273371846b7abdcbd663a06c227'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:53.285075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2e4e150-5913-4795-8da5-9e5a5b54c35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17804273371846b7abdcbd663a06c227'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:53.286898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-c2e4e150-5913-4795-8da5-9e5a5b54c35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17804273371846b7abdcbd663a06c227'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:53.325030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1368/2708] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:40:53 2022] DELETE /identity/v3/users/17804273371846b7abdcbd663a06c227 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:53.639590 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5b109-a4d5-4b71-ad21-1cbefa3b103a service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:53.662681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5b109-a4d5-4b71-ad21-1cbefa3b103a service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:53.853203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82ac10-7672-464e-9ecd-d5d4182e8253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:53.854191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82ac10-7672-464e-9ecd-d5d4182e8253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:53.854653 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82ac10-7672-464e-9ecd-d5d4182e8253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:53.855087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82ac10-7672-464e-9ecd-d5d4182e8253 admin admin] PATH_INFO: `/v3/projects/ab5c8363dd3446c78e1e8b8c97fc80a9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:53.857522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82ac10-7672-464e-9ecd-d5d4182e8253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5c8363dd3446c78e1e8b8c97fc80a9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:53.861925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82ac10-7672-464e-9ecd-d5d4182e8253 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:53.976884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6b82ac10-7672-464e-9ecd-d5d4182e8253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5c8363dd3446c78e1e8b8c97fc80a9', 'request_id': 'req-6b82ac10-7672-464e-9ecd-d5d4182e8253'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:53.990441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6b82ac10-7672-464e-9ecd-d5d4182e8253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5c8363dd3446c78e1e8b8c97fc80a9', 'request_id': 'req-6b82ac10-7672-464e-9ecd-d5d4182e8253'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:53.998619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6b82ac10-7672-464e-9ecd-d5d4182e8253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5c8363dd3446c78e1e8b8c97fc80a9', 'request_id': 'req-6b82ac10-7672-464e-9ecd-d5d4182e8253'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:54.013072 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6b82ac10-7672-464e-9ecd-d5d4182e8253 admin admin] The token cache is being invalidate because project ab5c8363dd3446c78e1e8b8c97fc80a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:40:54.013712 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6b82ac10-7672-464e-9ecd-d5d4182e8253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:54.014584 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6b82ac10-7672-464e-9ecd-d5d4182e8253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:54.016682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1341/2709] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:40:53 2022] DELETE /identity/v3/projects/ab5c8363dd3446c78e1e8b8c97fc80a9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:54.022631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914b8cf-76d8-4ce7-97f0-3f9c86bd0975 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:54.023066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914b8cf-76d8-4ce7-97f0-3f9c86bd0975 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:54.023405 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914b8cf-76d8-4ce7-97f0-3f9c86bd0975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:54.045679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e914b8cf-76d8-4ce7-97f0-3f9c86bd0975 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:54.046931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e914b8cf-76d8-4ce7-97f0-3f9c86bd0975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:54.065884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:54.131940 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1369/2710] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:54.138070 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32532c-699c-4f31-8327-5912d61ebfd8 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:54.139335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32532c-699c-4f31-8327-5912d61ebfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:54.140411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32532c-699c-4f31-8327-5912d61ebfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:54.176377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-1a32532c-699c-4f31-8327-5912d61ebfd8 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:54.178018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-1a32532c-699c-4f31-8327-5912d61ebfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:54.187756 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1342/2711] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:40:54.196463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914b8cf-76d8-4ce7-97f0-3f9c86bd0975 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:54.209882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914b8cf-76d8-4ce7-97f0-3f9c86bd0975 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:54.216193 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51851bb-0b76-4c44-95a3-9f124cf7e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:54.216879 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51851bb-0b76-4c44-95a3-9f124cf7e003 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:54.217162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51851bb-0b76-4c44-95a3-9f124cf7e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:54.217446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51851bb-0b76-4c44-95a3-9f124cf7e003 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:54.218161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51851bb-0b76-4c44-95a3-9f124cf7e003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:40:54.218470 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51851bb-0b76-4c44-95a3-9f124cf7e003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:54.220800 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51851bb-0b76-4c44-95a3-9f124cf7e003 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:54.245390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32532c-699c-4f31-8327-5912d61ebfd8 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:54.248684 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1370/2712] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:40:54.260616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32532c-699c-4f31-8327-5912d61ebfd8 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:54.272421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4152d4f-898a-4ad1-9b49-4ee24a26c508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:54.273369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4152d4f-898a-4ad1-9b49-4ee24a26c508 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:54.273714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4152d4f-898a-4ad1-9b49-4ee24a26c508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:54.273991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4152d4f-898a-4ad1-9b49-4ee24a26c508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:54.274698 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4152d4f-898a-4ad1-9b49-4ee24a26c508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:54.276669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4152d4f-898a-4ad1-9b49-4ee24a26c508 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:54.293876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:54.315564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1343/2713] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:40:54 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:40:54.318810 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51851bb-0b76-4c44-95a3-9f124cf7e003 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:54.352556 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51851bb-0b76-4c44-95a3-9f124cf7e003 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:54.509057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229482c-efc1-4932-989c-5ca6c9268749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:54.509871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229482c-efc1-4932-989c-5ca6c9268749 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:54.510266 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229482c-efc1-4932-989c-5ca6c9268749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:54.510697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229482c-efc1-4932-989c-5ca6c9268749 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:54.511411 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229482c-efc1-4932-989c-5ca6c9268749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:54.514703 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229482c-efc1-4932-989c-5ca6c9268749 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:54.542070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1371/2714] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:40:54 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:40:54.546290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4152d4f-898a-4ad1-9b49-4ee24a26c508 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:54.558337 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4152d4f-898a-4ad1-9b49-4ee24a26c508 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:54.564581 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70092387-1655-4f97-a2b9-09c5b486924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:54.565225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70092387-1655-4f97-a2b9-09c5b486924f admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:54.565541 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70092387-1655-4f97-a2b9-09c5b486924f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:54.566767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70092387-1655-4f97-a2b9-09c5b486924f admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:54.568681 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70092387-1655-4f97-a2b9-09c5b486924f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:54.584143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70092387-1655-4f97-a2b9-09c5b486924f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:54.619669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1344/2715] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:40:54.626281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229482c-efc1-4932-989c-5ca6c9268749 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:54.644003 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229482c-efc1-4932-989c-5ca6c9268749 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:54.651900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdae9d-859e-4785-bc2d-b5dc747d9797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:54.651900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdae9d-859e-4785-bc2d-b5dc747d9797 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:54.651900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdae9d-859e-4785-bc2d-b5dc747d9797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:54.651900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdae9d-859e-4785-bc2d-b5dc747d9797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:54.652302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdae9d-859e-4785-bc2d-b5dc747d9797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:54.653469 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdae9d-859e-4785-bc2d-b5dc747d9797 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:54.673977 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1372/2716] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:40:54.678618 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70092387-1655-4f97-a2b9-09c5b486924f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:54.689556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70092387-1655-4f97-a2b9-09c5b486924f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:54.696964 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d19473-9812-4d4e-8fd4-17069108149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:54.697862 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d19473-9812-4d4e-8fd4-17069108149f admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:54.698171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d19473-9812-4d4e-8fd4-17069108149f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:54.698546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d19473-9812-4d4e-8fd4-17069108149f admin admin] PATH_INFO: `/v3/projects/219028bb1ef34887b5430e4b8810ad01/users/770b9d4cab094164bd638ce6ca5680ad/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:54.717743 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d19473-9812-4d4e-8fd4-17069108149f admin admin] RBAC: Authorizing `identity:create_grant(project_id=219028bb1ef34887b5430e4b8810ad01, user_id=770b9d4cab094164bd638ce6ca5680ad, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:54.721383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d19473-9812-4d4e-8fd4-17069108149f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:54.739758 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1345/2717] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:40:54 2022] PUT /identity/v3/projects/219028bb1ef34887b5430e4b8810ad01/users/770b9d4cab094164bd638ce6ca5680ad/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:54.749484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ff8ea-af8c-4499-bd94-48a063cde772 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:54.749842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ff8ea-af8c-4499-bd94-48a063cde772 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:54.750070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ff8ea-af8c-4499-bd94-48a063cde772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:54.787453 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-8d4ff8ea-af8c-4499-bd94-48a063cde772 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:54.788785 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8d4ff8ea-af8c-4499-bd94-48a063cde772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:54.911374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1373/2718] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:54.923488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d19473-9812-4d4e-8fd4-17069108149f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:54.927994 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-00d19473-9812-4d4e-8fd4-17069108149f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:55.085284 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d19473-9812-4d4e-8fd4-17069108149f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:55.089136 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8014710-e826-4b1a-aa5d-34d46020bfc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:55.089767 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014710-e826-4b1a-aa5d-34d46020bfc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:55.090054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014710-e826-4b1a-aa5d-34d46020bfc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:55.095440 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014710-e826-4b1a-aa5d-34d46020bfc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:55.107322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8014710-e826-4b1a-aa5d-34d46020bfc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:55.109937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8014710-e826-4b1a-aa5d-34d46020bfc3 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:55.130581 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1346/2719] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:55.744414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417f1ed-3e01-4414-af79-927e92f467fd None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:55.744958 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417f1ed-3e01-4414-af79-927e92f467fd None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:55.744958 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417f1ed-3e01-4414-af79-927e92f467fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:55.765120 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-4417f1ed-3e01-4414-af79-927e92f467fd None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:55.766353 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4417f1ed-3e01-4414-af79-927e92f467fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:55.792415 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:55.829635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1374/2720] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 27 16:40:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:55.843006 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8014710-e826-4b1a-aa5d-34d46020bfc3 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:55.844642 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a8014710-e826-4b1a-aa5d-34d46020bfc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:55.932261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8014710-e826-4b1a-aa5d-34d46020bfc3 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:55.937703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3239d-5e25-43a3-b3b0-a7fe40b5d0d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:55.938464 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3239d-5e25-43a3-b3b0-a7fe40b5d0d9 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:55.938853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3239d-5e25-43a3-b3b0-a7fe40b5d0d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:55.939287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3239d-5e25-43a3-b3b0-a7fe40b5d0d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:55.948680 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3239d-5e25-43a3-b3b0-a7fe40b5d0d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:55.950675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3239d-5e25-43a3-b3b0-a7fe40b5d0d9 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:55.962937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1347/2721] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:40:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 16:40:58.811146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417f1ed-3e01-4414-af79-927e92f467fd None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:58.813543 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4417f1ed-3e01-4414-af79-927e92f467fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:58.898416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3239d-5e25-43a3-b3b0-a7fe40b5d0d9 service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:58.900803 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2bc3239d-5e25-43a3-b3b0-a7fe40b5d0d9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:58.925944 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3239d-5e25-43a3-b3b0-a7fe40b5d0d9 service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:58.928953 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417f1ed-3e01-4414-af79-927e92f467fd None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:58.935453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f195cce-1522-4652-a113-cc916cf1520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:58.937595 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f195cce-1522-4652-a113-cc916cf1520b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:58.939348 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f195cce-1522-4652-a113-cc916cf1520b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:58.940162 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f195cce-1522-4652-a113-cc916cf1520b admin admin] PATH_INFO: `/v3/users/9be0c8bbbfa04c3da1c6214b618302c7` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:58.942580 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd6261-7d70-4f60-a67c-77ea7b76601b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f602decb26be477b867493429352bd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:58.944017 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd6261-7d70-4f60-a67c-77ea7b76601b service placement] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:58.944313 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd6261-7d70-4f60-a67c-77ea7b76601b service placement] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:58.944598 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd6261-7d70-4f60-a67c-77ea7b76601b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:58.944892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f195cce-1522-4652-a113-cc916cf1520b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be0c8bbbfa04c3da1c6214b618302c7)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:58.947274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f195cce-1522-4652-a113-cc916cf1520b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:58.947694 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-2abd6261-7d70-4f60-a67c-77ea7b76601b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:58.972094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd6261-7d70-4f60-a67c-77ea7b76601b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:58.974710 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd6261-7d70-4f60-a67c-77ea7b76601b service placement] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:58.990015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1375/2722] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:40:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:40:59.015660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2f195cce-1522-4652-a113-cc916cf1520b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be0c8bbbfa04c3da1c6214b618302c7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:59.017334 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:59.028054 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2f195cce-1522-4652-a113-cc916cf1520b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be0c8bbbfa04c3da1c6214b618302c7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:59.037724 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2f195cce-1522-4652-a113-cc916cf1520b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be0c8bbbfa04c3da1c6214b618302c7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:59.038606 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2f195cce-1522-4652-a113-cc916cf1520b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be0c8bbbfa04c3da1c6214b618302c7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:59.039387 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-2f195cce-1522-4652-a113-cc916cf1520b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be0c8bbbfa04c3da1c6214b618302c7'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:59.066662 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1348/2723] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:40:58 2022] DELETE /identity/v3/users/9be0c8bbbfa04c3da1c6214b618302c7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:40:59.485730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd6261-7d70-4f60-a67c-77ea7b76601b service placement] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:40:59.505390 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd6261-7d70-4f60-a67c-77ea7b76601b service placement] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:40:59.620693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06c580-a356-4307-a862-2f6af512fa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:40:59.621439 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06c580-a356-4307-a862-2f6af512fa08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:59.621838 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06c580-a356-4307-a862-2f6af512fa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:59.622114 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06c580-a356-4307-a862-2f6af512fa08 admin admin] PATH_INFO: `/v3/projects/8c04b4684b724cc4ba0921cd43aed0dd` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:59.623340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06c580-a356-4307-a862-2f6af512fa08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c04b4684b724cc4ba0921cd43aed0dd)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:40:59.625402 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06c580-a356-4307-a862-2f6af512fa08 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:40:59.729209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7d06c580-a356-4307-a862-2f6af512fa08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c04b4684b724cc4ba0921cd43aed0dd', 'request_id': 'req-7d06c580-a356-4307-a862-2f6af512fa08'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:59.742621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7d06c580-a356-4307-a862-2f6af512fa08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c04b4684b724cc4ba0921cd43aed0dd', 'request_id': 'req-7d06c580-a356-4307-a862-2f6af512fa08'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:59.750093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7d06c580-a356-4307-a862-2f6af512fa08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c04b4684b724cc4ba0921cd43aed0dd', 'request_id': 'req-7d06c580-a356-4307-a862-2f6af512fa08'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:59.753451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:40:59.776437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7d06c580-a356-4307-a862-2f6af512fa08 admin admin] The token cache is being invalidate because project 8c04b4684b724cc4ba0921cd43aed0dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:40:59.776437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7d06c580-a356-4307-a862-2f6af512fa08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:59.782942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-7d06c580-a356-4307-a862-2f6af512fa08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:40:59.792034 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9f638-c935-458d-95dc-4f2882960cd4 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:59.792699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9f638-c935-458d-95dc-4f2882960cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:59.793257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9f638-c935-458d-95dc-4f2882960cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:59.797148 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1376/2724] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:40:59 2022] DELETE /identity/v3/projects/8c04b4684b724cc4ba0921cd43aed0dd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:40:59.821957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-72e9f638-c935-458d-95dc-4f2882960cd4 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:59.823760 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-72e9f638-c935-458d-95dc-4f2882960cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:59.940386 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1349/2725] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:40:59.949128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3665f0-70d2-4ee2-b679-a4f2a3fcf763 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:40:59.949721 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3665f0-70d2-4ee2-b679-a4f2a3fcf763 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:40:59.950274 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3665f0-70d2-4ee2-b679-a4f2a3fcf763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:40:59.984718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0c3665f0-70d2-4ee2-b679-a4f2a3fcf763 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:40:59.986245 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0c3665f0-70d2-4ee2-b679-a4f2a3fcf763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:40:59.997255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1377/2726] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:00.002603 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9f638-c935-458d-95dc-4f2882960cd4 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:00.018524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9f638-c935-458d-95dc-4f2882960cd4 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:00.027191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf776104-471f-4c21-a024-f218704898c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:00.028158 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf776104-471f-4c21-a024-f218704898c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:00.028656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf776104-471f-4c21-a024-f218704898c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:00.029106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf776104-471f-4c21-a024-f218704898c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:00.031562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf776104-471f-4c21-a024-f218704898c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:41:00.032109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf776104-471f-4c21-a024-f218704898c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:00.035240 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf776104-471f-4c21-a024-f218704898c4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:00.063880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1350/2727] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:41:00.069139 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3665f0-70d2-4ee2-b679-a4f2a3fcf763 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:00.082316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3665f0-70d2-4ee2-b679-a4f2a3fcf763 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:00.091473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae1416-aff0-4bc9-93bc-296ea4711cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:00.092590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae1416-aff0-4bc9-93bc-296ea4711cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:00.093129 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae1416-aff0-4bc9-93bc-296ea4711cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:00.093682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae1416-aff0-4bc9-93bc-296ea4711cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:00.095061 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae1416-aff0-4bc9-93bc-296ea4711cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:00.098762 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae1416-aff0-4bc9-93bc-296ea4711cc7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:00.164899 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1378/2728] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:41:00 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:41:00.172189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf776104-471f-4c21-a024-f218704898c4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:00.207377 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf776104-471f-4c21-a024-f218704898c4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:00.392482 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347e79f-c2f0-4bfe-b95d-5740380c9ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:00.393198 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347e79f-c2f0-4bfe-b95d-5740380c9ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:00.393729 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347e79f-c2f0-4bfe-b95d-5740380c9ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:00.395378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347e79f-c2f0-4bfe-b95d-5740380c9ebf admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:00.396420 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347e79f-c2f0-4bfe-b95d-5740380c9ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:00.398883 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347e79f-c2f0-4bfe-b95d-5740380c9ebf admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:00.434042 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1351/2729] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:41:00 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:41:00.438118 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae1416-aff0-4bc9-93bc-296ea4711cc7 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:00.457495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae1416-aff0-4bc9-93bc-296ea4711cc7 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:00.467987 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952b12b-f842-44af-9b4c-1921ef477ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:00.468634 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952b12b-f842-44af-9b4c-1921ef477ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:00.468915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952b12b-f842-44af-9b4c-1921ef477ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:00.469189 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952b12b-f842-44af-9b4c-1921ef477ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:00.469901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952b12b-f842-44af-9b4c-1921ef477ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:00.471712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952b12b-f842-44af-9b4c-1921ef477ed8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:00.493933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347e79f-c2f0-4bfe-b95d-5740380c9ebf admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:00.498847 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1379/2730] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:41:00.507119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347e79f-c2f0-4bfe-b95d-5740380c9ebf admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:00.518551 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d5dde-997a-4c9e-ab1c-f8ebed0c6eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:00.520039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d5dde-997a-4c9e-ab1c-f8ebed0c6eca admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:00.520546 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d5dde-997a-4c9e-ab1c-f8ebed0c6eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:00.521001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d5dde-997a-4c9e-ab1c-f8ebed0c6eca admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:00.521906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d5dde-997a-4c9e-ab1c-f8ebed0c6eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:00.524143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d5dde-997a-4c9e-ab1c-f8ebed0c6eca admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:00.541341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1352/2731] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:41:00.546401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952b12b-f842-44af-9b4c-1921ef477ed8 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:00.558370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952b12b-f842-44af-9b4c-1921ef477ed8 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:00.563698 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9976f1-bcfa-4665-82cc-f0b3cbcd7876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:00.564743 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9976f1-bcfa-4665-82cc-f0b3cbcd7876 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:00.565028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9976f1-bcfa-4665-82cc-f0b3cbcd7876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:00.565307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9976f1-bcfa-4665-82cc-f0b3cbcd7876 admin admin] PATH_INFO: `/v3/projects/33b3b959501042b4b1c7d7a897a718c6/users/78d41491a3ac4da691e1b9af7150e1c1/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:00.589240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9976f1-bcfa-4665-82cc-f0b3cbcd7876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b3b959501042b4b1c7d7a897a718c6, user_id=78d41491a3ac4da691e1b9af7150e1c1, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:00.591822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9976f1-bcfa-4665-82cc-f0b3cbcd7876 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:00.612460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1380/2732] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:41:00 2022] PUT /identity/v3/projects/33b3b959501042b4b1c7d7a897a718c6/users/78d41491a3ac4da691e1b9af7150e1c1/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:41:00.629562 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5411d-c0d1-475d-b42f-7f10af099e5e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:00.629949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5411d-c0d1-475d-b42f-7f10af099e5e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:00.630303 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5411d-c0d1-475d-b42f-7f10af099e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:00.670151 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a6b5411d-c0d1-475d-b42f-7f10af099e5e None None] MFA Rules not processed for user `78d41491a3ac4da691e1b9af7150e1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:00.671669 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a6b5411d-c0d1-475d-b42f-7f10af099e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:00.730319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:00.844192 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1353/2733] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:41:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:00.852855 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9976f1-bcfa-4665-82cc-f0b3cbcd7876 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:00.854884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-4e9976f1-bcfa-4665-82cc-f0b3cbcd7876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:00.973254 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9976f1-bcfa-4665-82cc-f0b3cbcd7876 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:00.983203 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fefe3d-7c8f-4617-8e98-24a7b34bc9a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1832d9988604b81bcb075ae77db6d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:00.984184 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fefe3d-7c8f-4617-8e98-24a7b34bc9a3 service glance] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:00.984577 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fefe3d-7c8f-4617-8e98-24a7b34bc9a3 service glance] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:00.985026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fefe3d-7c8f-4617-8e98-24a7b34bc9a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:01.009712 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fefe3d-7c8f-4617-8e98-24a7b34bc9a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:01.018620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fefe3d-7c8f-4617-8e98-24a7b34bc9a3 service glance] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:01.029163 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51114ba7-c8e4-4f4a-848f-31617dca53d6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:01.029674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51114ba7-c8e4-4f4a-848f-31617dca53d6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:01.029913 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51114ba7-c8e4-4f4a-848f-31617dca53d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:01.044601 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1381/2734] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:41:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:41:01.078528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-51114ba7-c8e4-4f4a-848f-31617dca53d6 None None] MFA Rules not processed for user `770b9d4cab094164bd638ce6ca5680ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:01.080892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-51114ba7-c8e4-4f4a-848f-31617dca53d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:01.204335 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1354/2735] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:41:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:01.213626 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fefe3d-7c8f-4617-8e98-24a7b34bc9a3 service glance] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:01.215479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c2fefe3d-7c8f-4617-8e98-24a7b34bc9a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:01.321555 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fefe3d-7c8f-4617-8e98-24a7b34bc9a3 service glance] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:01.327988 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8632a7e-3868-4bce-a93a-a8df34422b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d5a8ef373ca4ed7bf31361e24e42e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:01.328680 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8632a7e-3868-4bce-a93a-a8df34422b6d service nova] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:01.329501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8632a7e-3868-4bce-a93a-a8df34422b6d service nova] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:01.329916 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8632a7e-3868-4bce-a93a-a8df34422b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:01.340958 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8632a7e-3868-4bce-a93a-a8df34422b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:01.343095 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8632a7e-3868-4bce-a93a-a8df34422b6d service nova] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:01.354065 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1382/2736] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:41:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:41:03.312393 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33057b-f46b-477a-915b-a075be69b79e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:03.313119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33057b-f46b-477a-915b-a075be69b79e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:03.313119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33057b-f46b-477a-915b-a075be69b79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:03.342834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-ab33057b-f46b-477a-915b-a075be69b79e None None] MFA Rules not processed for user `770b9d4cab094164bd638ce6ca5680ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:03.344550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ab33057b-f46b-477a-915b-a075be69b79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:03.352727 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1355/2737] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:41:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:05.437312 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8632a7e-3868-4bce-a93a-a8df34422b6d service nova] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:05.439351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d8632a7e-3868-4bce-a93a-a8df34422b6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:05.469832 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:05.535338 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8632a7e-3868-4bce-a93a-a8df34422b6d service nova] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:05.539972 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93960fa3-8072-4792-8e90-71bcc32c567d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:05.540700 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93960fa3-8072-4792-8e90-71bcc32c567d service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:05.541057 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93960fa3-8072-4792-8e90-71bcc32c567d service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:05.541409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93960fa3-8072-4792-8e90-71bcc32c567d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:05.543384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-93960fa3-8072-4792-8e90-71bcc32c567d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:05.556219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93960fa3-8072-4792-8e90-71bcc32c567d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:05.557706 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93960fa3-8072-4792-8e90-71bcc32c567d service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:05.568508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1383/2738] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:41:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:41:11.934753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33057b-f46b-477a-915b-a075be69b79e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:11.936415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ab33057b-f46b-477a-915b-a075be69b79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:12.017501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33057b-f46b-477a-915b-a075be69b79e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:12.023400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:12.024175 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:12.026557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:12.026557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] PATH_INFO: `/v3/users/c6c5d2815121493fbbcb6fea85ae1a0a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:12.027239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c5d2815121493fbbcb6fea85ae1a0a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:12.029538 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:12.104215 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:12.107184 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c5d2815121493fbbcb6fea85ae1a0a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.118199 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c5d2815121493fbbcb6fea85ae1a0a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.125921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c5d2815121493fbbcb6fea85ae1a0a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.126677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c5d2815121493fbbcb6fea85ae1a0a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.127384 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c5d2815121493fbbcb6fea85ae1a0a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.157062 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1356/2739] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:41:11 2022] DELETE /identity/v3/users/c6c5d2815121493fbbcb6fea85ae1a0a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:41:12.374246 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93960fa3-8072-4792-8e90-71bcc32c567d service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:12.398394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93960fa3-8072-4792-8e90-71bcc32c567d service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:12.463596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:12.464509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:12.465014 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:12.465460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] PATH_INFO: `/v3/projects/c944c43ba911492a827900639378d4ea` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:12.467295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c944c43ba911492a827900639378d4ea)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:12.469537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:12.529931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c944c43ba911492a827900639378d4ea', 'request_id': 'req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.538492 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c944c43ba911492a827900639378d4ea', 'request_id': 'req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.544159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c944c43ba911492a827900639378d4ea', 'request_id': 'req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.558632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] The token cache is being invalidate because project c944c43ba911492a827900639378d4ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:41:12.558929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.559679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.561322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1384/2740] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:41:12 2022] DELETE /identity/v3/projects/c944c43ba911492a827900639378d4ea => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:41:12.566048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:12.569112 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:12.591702 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f4bde-32a1-4833-8b9f-45780695218f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:12.708762 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa5712-9f09-44cc-9723-0c5585d95c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:12.710491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa5712-9f09-44cc-9723-0c5585d95c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:12.710491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa5712-9f09-44cc-9723-0c5585d95c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:12.711055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa5712-9f09-44cc-9723-0c5585d95c73 admin admin] PATH_INFO: `/v3/users/0b4c0b70d16f4188af301d44411b0979` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:12.713488 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa5712-9f09-44cc-9723-0c5585d95c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b4c0b70d16f4188af301d44411b0979)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:12.717583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa5712-9f09-44cc-9723-0c5585d95c73 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:12.786513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a9aa5712-9f09-44cc-9723-0c5585d95c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b4c0b70d16f4188af301d44411b0979'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.796192 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a9aa5712-9f09-44cc-9723-0c5585d95c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b4c0b70d16f4188af301d44411b0979'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.806535 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a9aa5712-9f09-44cc-9723-0c5585d95c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b4c0b70d16f4188af301d44411b0979'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.807961 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a9aa5712-9f09-44cc-9723-0c5585d95c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b4c0b70d16f4188af301d44411b0979'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.808834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-a9aa5712-9f09-44cc-9723-0c5585d95c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b4c0b70d16f4188af301d44411b0979'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:12.834272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1357/2741] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:41:12 2022] DELETE /identity/v3/users/0b4c0b70d16f4188af301d44411b0979 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:41:13.048905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:13.052290 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:13.089702 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db730a-9489-4ead-9b7f-ac1b4d3f42bf admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:13.186108 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:13.207097 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:13.207773 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:13.208578 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:13.209012 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6 admin admin] PATH_INFO: `/v3/projects/7dbfb140f77747e8a2f35589ccb85d6e` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:13.211332 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbfb140f77747e8a2f35589ccb85d6e)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:13.214916 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:13.290324 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbfb140f77747e8a2f35589ccb85d6e', 'request_id': 'req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:13.299059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbfb140f77747e8a2f35589ccb85d6e', 'request_id': 'req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:13.309418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbfb140f77747e8a2f35589ccb85d6e', 'request_id': 'req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:13.346845 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6 admin admin] The token cache is being invalidate because project 7dbfb140f77747e8a2f35589ccb85d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:41:13.347145 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:13.348032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-486e6c8d-cdb2-47f6-ae84-5a499cdc2dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:13.350564 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1385/2742] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:41:13 2022] DELETE /identity/v3/projects/7dbfb140f77747e8a2f35589ccb85d6e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:41:13.357272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be29200-9bf3-46ea-ad5c-c066d3c6622e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:13.357854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be29200-9bf3-46ea-ad5c-c066d3c6622e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:13.357854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be29200-9bf3-46ea-ad5c-c066d3c6622e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:13.381108 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-3be29200-9bf3-46ea-ad5c-c066d3c6622e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:13.382353 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3be29200-9bf3-46ea-ad5c-c066d3c6622e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:13.431289 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:13.456798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1358/2743] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:13.465901 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cb9a1-9f82-4f3b-99a3-61ff2787fabd None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:13.466483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cb9a1-9f82-4f3b-99a3-61ff2787fabd None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:13.466483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cb9a1-9f82-4f3b-99a3-61ff2787fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:13.488078 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-9a4cb9a1-9f82-4f3b-99a3-61ff2787fabd None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:13.491615 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9a4cb9a1-9f82-4f3b-99a3-61ff2787fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:13.503141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1386/2744] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:13.509142 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be29200-9bf3-46ea-ad5c-c066d3c6622e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:13.520863 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be29200-9bf3-46ea-ad5c-c066d3c6622e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:13.526583 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba53e2-e70a-4292-97f4-b70533dcb7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:13.527225 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba53e2-e70a-4292-97f4-b70533dcb7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:13.527509 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba53e2-e70a-4292-97f4-b70533dcb7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:13.528044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba53e2-e70a-4292-97f4-b70533dcb7d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:13.528766 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba53e2-e70a-4292-97f4-b70533dcb7d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:41:13.529077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba53e2-e70a-4292-97f4-b70533dcb7d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:13.530671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba53e2-e70a-4292-97f4-b70533dcb7d4 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:13.546039 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1359/2745] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:41:13.551141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cb9a1-9f82-4f3b-99a3-61ff2787fabd None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:13.562384 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cb9a1-9f82-4f3b-99a3-61ff2787fabd None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:13.569110 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb258394-226c-4a40-83f4-194684f1f019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:13.569926 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb258394-226c-4a40-83f4-194684f1f019 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:13.570473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb258394-226c-4a40-83f4-194684f1f019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:13.570856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb258394-226c-4a40-83f4-194684f1f019 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:13.571662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb258394-226c-4a40-83f4-194684f1f019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:13.573745 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb258394-226c-4a40-83f4-194684f1f019 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:13.616460 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1387/2746] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:41:13 2022] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:41:13.618627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba53e2-e70a-4292-97f4-b70533dcb7d4 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:13.630100 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba53e2-e70a-4292-97f4-b70533dcb7d4 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:13.694031 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257da408-cbb5-4c50-b784-08dd20f2016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:13.694671 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257da408-cbb5-4c50-b784-08dd20f2016b admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:13.694956 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257da408-cbb5-4c50-b784-08dd20f2016b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:13.695230 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257da408-cbb5-4c50-b784-08dd20f2016b admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:13.695937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257da408-cbb5-4c50-b784-08dd20f2016b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:13.698048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257da408-cbb5-4c50-b784-08dd20f2016b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:13.723988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1360/2747] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:41:13 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:41:13.728181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb258394-226c-4a40-83f4-194684f1f019 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:13.738645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb258394-226c-4a40-83f4-194684f1f019 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:13.743595 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfb7bd-ced3-4e76-862b-2746ca772bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:13.744251 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfb7bd-ced3-4e76-862b-2746ca772bef admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:13.744538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfb7bd-ced3-4e76-862b-2746ca772bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:13.744816 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfb7bd-ced3-4e76-862b-2746ca772bef admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:13.745543 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfb7bd-ced3-4e76-862b-2746ca772bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:13.747163 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfb7bd-ced3-4e76-862b-2746ca772bef admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:13.762497 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1388/2748] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:41:13.766741 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257da408-cbb5-4c50-b784-08dd20f2016b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:13.777709 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257da408-cbb5-4c50-b784-08dd20f2016b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:13.782797 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1f431-1f91-4065-ba00-0a561fa49219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:13.783416 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1f431-1f91-4065-ba00-0a561fa49219 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:13.783701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1f431-1f91-4065-ba00-0a561fa49219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:13.784014 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1f431-1f91-4065-ba00-0a561fa49219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:13.784721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1f431-1f91-4065-ba00-0a561fa49219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:13.786664 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1f431-1f91-4065-ba00-0a561fa49219 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:13.798220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1361/2749] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:41:13.804784 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfb7bd-ced3-4e76-862b-2746ca772bef admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:13.817875 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfb7bd-ced3-4e76-862b-2746ca772bef admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:13.823432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b462b91-e6ca-4441-8bac-95df3c5102de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:13.824151 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b462b91-e6ca-4441-8bac-95df3c5102de admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:13.824438 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b462b91-e6ca-4441-8bac-95df3c5102de admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:13.824720 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b462b91-e6ca-4441-8bac-95df3c5102de admin admin] PATH_INFO: `/v3/projects/0fbdb5861d4044eb9f3567a1c6c742bf/users/c49493f46c614483bde466e1029fc77a/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:13.844463 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b462b91-e6ca-4441-8bac-95df3c5102de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fbdb5861d4044eb9f3567a1c6c742bf, user_id=c49493f46c614483bde466e1029fc77a, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:13.847508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b462b91-e6ca-4441-8bac-95df3c5102de admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:13.868776 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1389/2750] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:41:13 2022] PUT /identity/v3/projects/0fbdb5861d4044eb9f3567a1c6c742bf/users/c49493f46c614483bde466e1029fc77a/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:41:13.880239 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678a46e-3d3f-4af8-b6ed-f33c87227348 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:13.880641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678a46e-3d3f-4af8-b6ed-f33c87227348 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:13.881007 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678a46e-3d3f-4af8-b6ed-f33c87227348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:13.916882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2678a46e-3d3f-4af8-b6ed-f33c87227348 None None] MFA Rules not processed for user `c49493f46c614483bde466e1029fc77a`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:13.918508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2678a46e-3d3f-4af8-b6ed-f33c87227348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:14.017171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1362/2751] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:41:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:14.032508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b462b91-e6ca-4441-8bac-95df3c5102de admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:14.034757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9b462b91-e6ca-4441-8bac-95df3c5102de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:14.105270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b462b91-e6ca-4441-8bac-95df3c5102de admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:14.109600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b440941-290e-49d7-985b-b6b3eeaf37fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:14.110244 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b440941-290e-49d7-985b-b6b3eeaf37fa service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:14.110527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b440941-290e-49d7-985b-b6b3eeaf37fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:14.110804 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b440941-290e-49d7-985b-b6b3eeaf37fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:14.120697 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b440941-290e-49d7-985b-b6b3eeaf37fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:14.122174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b440941-290e-49d7-985b-b6b3eeaf37fa service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:14.133476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1390/2752] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:41:14 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:41:24.013605 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:24.127678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:25.397921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678a46e-3d3f-4af8-b6ed-f33c87227348 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:25.399369 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2678a46e-3d3f-4af8-b6ed-f33c87227348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:25.468668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678a46e-3d3f-4af8-b6ed-f33c87227348 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:25.474106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:25.474848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:25.475133 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:25.475408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] PATH_INFO: `/v3/users/78d41491a3ac4da691e1b9af7150e1c1` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:25.476823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d41491a3ac4da691e1b9af7150e1c1)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:25.478786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:25.534227 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d41491a3ac4da691e1b9af7150e1c1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:25.542561 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d41491a3ac4da691e1b9af7150e1c1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:25.552459 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d41491a3ac4da691e1b9af7150e1c1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:25.553109 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d41491a3ac4da691e1b9af7150e1c1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:25.553830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d41491a3ac4da691e1b9af7150e1c1'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:25.573780 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1363/2753] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:41:25 2022] DELETE /identity/v3/users/78d41491a3ac4da691e1b9af7150e1c1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:41:25.580447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93ddb-862c-4326-8fa0-73f925a6ef8f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:25.581064 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93ddb-862c-4326-8fa0-73f925a6ef8f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:25.581064 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93ddb-862c-4326-8fa0-73f925a6ef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:25.602233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-69a93ddb-862c-4326-8fa0-73f925a6ef8f None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:25.603461 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-69a93ddb-862c-4326-8fa0-73f925a6ef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:25.670348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1391/2754] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:25.681491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:25.683077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:25.748310 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc84de-c8fd-4b95-ae8f-b288ab9a46b0 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:25.752211 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102b525-b454-49ce-b042-9244a6076ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:25.752859 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102b525-b454-49ce-b042-9244a6076ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:25.753143 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102b525-b454-49ce-b042-9244a6076ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:25.753419 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102b525-b454-49ce-b042-9244a6076ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:25.766192 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102b525-b454-49ce-b042-9244a6076ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:25.767660 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102b525-b454-49ce-b042-9244a6076ce2 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:25.778917 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1364/2755] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:41:26.074832 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a93ddb-862c-4326-8fa0-73f925a6ef8f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:26.077146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-69a93ddb-862c-4326-8fa0-73f925a6ef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:26.095693 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a93ddb-862c-4326-8fa0-73f925a6ef8f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:26.101382 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7edf5-3ccd-4ea2-b575-f6649904d252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:26.102062 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7edf5-3ccd-4ea2-b575-f6649904d252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:26.102355 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7edf5-3ccd-4ea2-b575-f6649904d252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:26.102729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7edf5-3ccd-4ea2-b575-f6649904d252 admin admin] PATH_INFO: `/v3/projects/33b3b959501042b4b1c7d7a897a718c6` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:26.103986 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7edf5-3ccd-4ea2-b575-f6649904d252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b3b959501042b4b1c7d7a897a718c6)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:26.106276 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7edf5-3ccd-4ea2-b575-f6649904d252 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:26.158819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ebd7edf5-3ccd-4ea2-b575-f6649904d252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b3b959501042b4b1c7d7a897a718c6', 'request_id': 'req-ebd7edf5-3ccd-4ea2-b575-f6649904d252'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:26.166407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ebd7edf5-3ccd-4ea2-b575-f6649904d252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b3b959501042b4b1c7d7a897a718c6', 'request_id': 'req-ebd7edf5-3ccd-4ea2-b575-f6649904d252'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:26.172370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ebd7edf5-3ccd-4ea2-b575-f6649904d252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b3b959501042b4b1c7d7a897a718c6', 'request_id': 'req-ebd7edf5-3ccd-4ea2-b575-f6649904d252'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:26.187196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ebd7edf5-3ccd-4ea2-b575-f6649904d252 admin admin] The token cache is being invalidate because project 33b3b959501042b4b1c7d7a897a718c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:41:26.187650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ebd7edf5-3ccd-4ea2-b575-f6649904d252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:26.189373 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ebd7edf5-3ccd-4ea2-b575-f6649904d252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:26.190739 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1392/2756] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:41:26 2022] DELETE /identity/v3/projects/33b3b959501042b4b1c7d7a897a718c6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:41:35.774028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:36.182599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:45.655770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102b525-b454-49ce-b042-9244a6076ce2 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:45.657462 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9102b525-b454-49ce-b042-9244a6076ce2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:45.671131 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102b525-b454-49ce-b042-9244a6076ce2 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:45.731336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:45.732023 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:45.732357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:45.732591 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] PATH_INFO: `/v3/users/c49493f46c614483bde466e1029fc77a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:45.733809 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49493f46c614483bde466e1029fc77a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:45.735731 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:45.783819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49493f46c614483bde466e1029fc77a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:45.790819 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49493f46c614483bde466e1029fc77a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:45.799676 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49493f46c614483bde466e1029fc77a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:45.800309 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49493f46c614483bde466e1029fc77a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:45.800916 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49493f46c614483bde466e1029fc77a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:45.819983 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1365/2757] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:41:45 2022] DELETE /identity/v3/users/c49493f46c614483bde466e1029fc77a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:41:45.824753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2363b-8e53-4163-af16-593d2ae77e1d None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:45.825366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2363b-8e53-4163-af16-593d2ae77e1d None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:45.825366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2363b-8e53-4163-af16-593d2ae77e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:45.846233 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-54e2363b-8e53-4163-af16-593d2ae77e1d None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:45.847467 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-54e2363b-8e53-4163-af16-593d2ae77e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:45.912952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1393/2758] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:45.922317 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:45.923764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:45.984730 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e965b31-c985-4c14-a4ba-d6c3f59f562c admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:45.992025 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d6d3e-8091-408a-b6b4-c1c4e9a45def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:45.992675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6d3e-8091-408a-b6b4-c1c4e9a45def service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:45.992959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6d3e-8091-408a-b6b4-c1c4e9a45def service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:45.993231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6d3e-8091-408a-b6b4-c1c4e9a45def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:46.003408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d6d3e-8091-408a-b6b4-c1c4e9a45def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:46.005786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d6d3e-8091-408a-b6b4-c1c4e9a45def service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:46.016401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1366/2759] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:41:46.309903 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2363b-8e53-4163-af16-593d2ae77e1d None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:46.311524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-54e2363b-8e53-4163-af16-593d2ae77e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:46.324888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2363b-8e53-4163-af16-593d2ae77e1d None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:46.329996 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee9013-2180-4f7b-a267-85c00a2db028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:46.330708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee9013-2180-4f7b-a267-85c00a2db028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:46.331013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee9013-2180-4f7b-a267-85c00a2db028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:46.331294 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee9013-2180-4f7b-a267-85c00a2db028 admin admin] PATH_INFO: `/v3/projects/0fbdb5861d4044eb9f3567a1c6c742bf` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:46.332548 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee9013-2180-4f7b-a267-85c00a2db028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fbdb5861d4044eb9f3567a1c6c742bf)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:46.335258 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee9013-2180-4f7b-a267-85c00a2db028 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:46.522934 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e4ee9013-2180-4f7b-a267-85c00a2db028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fbdb5861d4044eb9f3567a1c6c742bf', 'request_id': 'req-e4ee9013-2180-4f7b-a267-85c00a2db028'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:46.529685 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e4ee9013-2180-4f7b-a267-85c00a2db028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fbdb5861d4044eb9f3567a1c6c742bf', 'request_id': 'req-e4ee9013-2180-4f7b-a267-85c00a2db028'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:46.535158 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e4ee9013-2180-4f7b-a267-85c00a2db028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fbdb5861d4044eb9f3567a1c6c742bf', 'request_id': 'req-e4ee9013-2180-4f7b-a267-85c00a2db028'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:46.550484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e4ee9013-2180-4f7b-a267-85c00a2db028 admin admin] The token cache is being invalidate because project 0fbdb5861d4044eb9f3567a1c6c742bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:41:46.550779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e4ee9013-2180-4f7b-a267-85c00a2db028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:46.551473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e4ee9013-2180-4f7b-a267-85c00a2db028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:41:46.553073 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1394/2760] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:41:46 2022] DELETE /identity/v3/projects/0fbdb5861d4044eb9f3567a1c6c742bf => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:41:46.558000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8416d9-a5de-4540-bf22-c8c54c6652f3 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:46.558290 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8416d9-a5de-4540-bf22-c8c54c6652f3 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:46.558593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8416d9-a5de-4540-bf22-c8c54c6652f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:46.579880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5c8416d9-a5de-4540-bf22-c8c54c6652f3 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:46.581145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5c8416d9-a5de-4540-bf22-c8c54c6652f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:46.600988 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:46.650366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1367/2761] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:46.658256 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7854877-44d5-4410-9724-0f43e580127f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:46.658617 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7854877-44d5-4410-9724-0f43e580127f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:46.659016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7854877-44d5-4410-9724-0f43e580127f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:46.680006 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-b7854877-44d5-4410-9724-0f43e580127f None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:46.681278 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-b7854877-44d5-4410-9724-0f43e580127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:46.689174 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1395/2762] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:46.693630 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8416d9-a5de-4540-bf22-c8c54c6652f3 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:46.703697 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8416d9-a5de-4540-bf22-c8c54c6652f3 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:46.709643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b9593-a96f-4ad3-8713-32d56944ffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:46.710273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b9593-a96f-4ad3-8713-32d56944ffd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:46.710567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b9593-a96f-4ad3-8713-32d56944ffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:46.710845 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b9593-a96f-4ad3-8713-32d56944ffd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:46.711550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b9593-a96f-4ad3-8713-32d56944ffd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:41:46.711898 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b9593-a96f-4ad3-8713-32d56944ffd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:46.713493 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b9593-a96f-4ad3-8713-32d56944ffd3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:46.726112 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1368/2763] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:41:46.730582 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7854877-44d5-4410-9724-0f43e580127f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:46.741306 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7854877-44d5-4410-9724-0f43e580127f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:46.746021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb23c9-23f5-45ef-9043-374a9cfad194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:46.746645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb23c9-23f5-45ef-9043-374a9cfad194 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:46.746929 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb23c9-23f5-45ef-9043-374a9cfad194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:46.747206 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb23c9-23f5-45ef-9043-374a9cfad194 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:46.747980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb23c9-23f5-45ef-9043-374a9cfad194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:46.749877 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb23c9-23f5-45ef-9043-374a9cfad194 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:46.779396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1396/2764] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:41:46 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:41:46.783721 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b9593-a96f-4ad3-8713-32d56944ffd3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:46.794600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b9593-a96f-4ad3-8713-32d56944ffd3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:46.855340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8501b4-7c95-4a72-8039-3a36991a8fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:46.855990 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8501b4-7c95-4a72-8039-3a36991a8fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:46.856272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8501b4-7c95-4a72-8039-3a36991a8fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:46.856545 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8501b4-7c95-4a72-8039-3a36991a8fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:46.857221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8501b4-7c95-4a72-8039-3a36991a8fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:46.859130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8501b4-7c95-4a72-8039-3a36991a8fa1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:46.887904 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1369/2765] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:41:46 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:41:46.889475 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb23c9-23f5-45ef-9043-374a9cfad194 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:46.901152 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb23c9-23f5-45ef-9043-374a9cfad194 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:46.905829 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46c9b7-8bf4-4b88-8e53-00e5ae1cc910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:46.906449 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46c9b7-8bf4-4b88-8e53-00e5ae1cc910 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:46.906732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46c9b7-8bf4-4b88-8e53-00e5ae1cc910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:46.907007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46c9b7-8bf4-4b88-8e53-00e5ae1cc910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:46.907702 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46c9b7-8bf4-4b88-8e53-00e5ae1cc910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:46.909391 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46c9b7-8bf4-4b88-8e53-00e5ae1cc910 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:46.919730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1397/2766] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:41:46.923889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8501b4-7c95-4a72-8039-3a36991a8fa1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:46.934061 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8501b4-7c95-4a72-8039-3a36991a8fa1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:46.938705 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67628f-263d-4f07-ba1e-100c09248f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:46.939320 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67628f-263d-4f07-ba1e-100c09248f1d admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:46.939613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67628f-263d-4f07-ba1e-100c09248f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:46.939916 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67628f-263d-4f07-ba1e-100c09248f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:46.940614 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67628f-263d-4f07-ba1e-100c09248f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:46.942751 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67628f-263d-4f07-ba1e-100c09248f1d admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:46.953579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1370/2767] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:41:46.958842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46c9b7-8bf4-4b88-8e53-00e5ae1cc910 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:46.969030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46c9b7-8bf4-4b88-8e53-00e5ae1cc910 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:46.974900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adda74-e8e9-4d51-b31e-221a7e13eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:46.974900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adda74-e8e9-4d51-b31e-221a7e13eae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:46.975278 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adda74-e8e9-4d51-b31e-221a7e13eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:46.975534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adda74-e8e9-4d51-b31e-221a7e13eae3 admin admin] PATH_INFO: `/v3/projects/0e0fbf19bbc7488f8dae25da0fab511a/users/da789150bb404c42a1f077386ea7edc0/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:47.000281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adda74-e8e9-4d51-b31e-221a7e13eae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0fbf19bbc7488f8dae25da0fab511a, user_id=da789150bb404c42a1f077386ea7edc0, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:47.000281 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adda74-e8e9-4d51-b31e-221a7e13eae3 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:47.015271 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1398/2768] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:41:46 2022] PUT /identity/v3/projects/0e0fbf19bbc7488f8dae25da0fab511a/users/da789150bb404c42a1f077386ea7edc0/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:41:47.020962 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d52fbd-b1f3-40d4-8211-30d80fb1ec23 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:47.021248 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d52fbd-b1f3-40d4-8211-30d80fb1ec23 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:47.021529 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d52fbd-b1f3-40d4-8211-30d80fb1ec23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:47.048261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f6d52fbd-b1f3-40d4-8211-30d80fb1ec23 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:47.049405 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f6d52fbd-b1f3-40d4-8211-30d80fb1ec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:47.114232 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1371/2769] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:47.124349 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adda74-e8e9-4d51-b31e-221a7e13eae3 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:47.126083 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-10adda74-e8e9-4d51-b31e-221a7e13eae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:47.150477 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:47.188889 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adda74-e8e9-4d51-b31e-221a7e13eae3 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:47.193243 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46535f-69a3-4814-a892-9d691df1e2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:47.193876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46535f-69a3-4814-a892-9d691df1e2cb service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:47.194161 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46535f-69a3-4814-a892-9d691df1e2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:47.194440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46535f-69a3-4814-a892-9d691df1e2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:47.204895 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46535f-69a3-4814-a892-9d691df1e2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:47.206362 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46535f-69a3-4814-a892-9d691df1e2cb service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:47.216831 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1399/2770] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:41:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:41:51.637666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86a771-9151-4fa6-a529-5362084c910a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:51.638168 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86a771-9151-4fa6-a529-5362084c910a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:51.638294 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86a771-9151-4fa6-a529-5362084c910a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:51.679549 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-eb86a771-9151-4fa6-a529-5362084c910a None None] MFA Rules not processed for user `da789150bb404c42a1f077386ea7edc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:51.681274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-eb86a771-9151-4fa6-a529-5362084c910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:51.701262 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:51.767206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1372/2771] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:41:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:51.768538 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46535f-69a3-4814-a892-9d691df1e2cb service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:51.779662 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46535f-69a3-4814-a892-9d691df1e2cb service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:51.789287 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a806e36-751f-4e45-be17-b0ab678f5c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:51.790370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a806e36-751f-4e45-be17-b0ab678f5c2a admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:51.794882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a806e36-751f-4e45-be17-b0ab678f5c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:51.794882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a806e36-751f-4e45-be17-b0ab678f5c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:51.794882 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a806e36-751f-4e45-be17-b0ab678f5c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:51.803964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a806e36-751f-4e45-be17-b0ab678f5c2a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:51.850644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1400/2772] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:41:51 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:41:51.853714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86a771-9151-4fa6-a529-5362084c910a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:51.868503 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86a771-9151-4fa6-a529-5362084c910a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:51.950170 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e2e75-ce15-4284-9b9b-a2ee4ae8abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:51.950937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e2e75-ce15-4284-9b9b-a2ee4ae8abe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:51.951281 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e2e75-ce15-4284-9b9b-a2ee4ae8abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:51.951622 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e2e75-ce15-4284-9b9b-a2ee4ae8abe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:51.952414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e2e75-ce15-4284-9b9b-a2ee4ae8abe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:51.954400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e2e75-ce15-4284-9b9b-a2ee4ae8abe1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:51.990411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1373/2773] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:41:51 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:41:51.994205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a806e36-751f-4e45-be17-b0ab678f5c2a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:52.006013 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a806e36-751f-4e45-be17-b0ab678f5c2a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:52.010900 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5edc07-5f13-447e-b50d-3d2c34faf70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:52.011573 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5edc07-5f13-447e-b50d-3d2c34faf70e admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:52.011884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5edc07-5f13-447e-b50d-3d2c34faf70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:52.012165 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5edc07-5f13-447e-b50d-3d2c34faf70e admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:52.012880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5edc07-5f13-447e-b50d-3d2c34faf70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:52.014767 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5edc07-5f13-447e-b50d-3d2c34faf70e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:52.027983 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1401/2774] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:41:52.033000 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e2e75-ce15-4284-9b9b-a2ee4ae8abe1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:52.045979 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e2e75-ce15-4284-9b9b-a2ee4ae8abe1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:52.050993 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77083735-21e9-45e7-8f48-2c977cba21b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:52.051802 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77083735-21e9-45e7-8f48-2c977cba21b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:52.052121 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77083735-21e9-45e7-8f48-2c977cba21b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:52.052411 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77083735-21e9-45e7-8f48-2c977cba21b5 admin admin] PATH_INFO: `/v3/projects/1c70bed71e27418cb01cfcfbbab11076/users/8f8dfa99d54447f68d78e040b5e6ad09/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:52.081566 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77083735-21e9-45e7-8f48-2c977cba21b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c70bed71e27418cb01cfcfbbab11076, user_id=8f8dfa99d54447f68d78e040b5e6ad09, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:52.087287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77083735-21e9-45e7-8f48-2c977cba21b5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:52.110389 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1374/2775] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:41:52 2022] PUT /identity/v3/projects/1c70bed71e27418cb01cfcfbbab11076/users/8f8dfa99d54447f68d78e040b5e6ad09/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:41:52.114468 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5edc07-5f13-447e-b50d-3d2c34faf70e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:52.129005 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5edc07-5f13-447e-b50d-3d2c34faf70e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:52.218680 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f35d8-c9ad-43cd-9376-b81666cd8b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:52.219337 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f35d8-c9ad-43cd-9376-b81666cd8b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:52.219648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f35d8-c9ad-43cd-9376-b81666cd8b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:52.220511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f35d8-c9ad-43cd-9376-b81666cd8b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:52.220831 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f35d8-c9ad-43cd-9376-b81666cd8b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:52.222495 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f35d8-c9ad-43cd-9376-b81666cd8b5a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:52.238939 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1402/2776] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:41:52.244106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77083735-21e9-45e7-8f48-2c977cba21b5 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:52.259834 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77083735-21e9-45e7-8f48-2c977cba21b5 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:52.265982 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5472a7-9fed-403f-9984-70cb7a399ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:52.266876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5472a7-9fed-403f-9984-70cb7a399ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:52.267404 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5472a7-9fed-403f-9984-70cb7a399ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:52.267783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5472a7-9fed-403f-9984-70cb7a399ff1 admin admin] PATH_INFO: `/v3/projects/1c70bed71e27418cb01cfcfbbab11076/users/8f8dfa99d54447f68d78e040b5e6ad09/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:52.271049 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5472a7-9fed-403f-9984-70cb7a399ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c70bed71e27418cb01cfcfbbab11076, user_id=8f8dfa99d54447f68d78e040b5e6ad09, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:52.276889 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5472a7-9fed-403f-9984-70cb7a399ff1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:52.296139 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1375/2777] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:41:52 2022] PUT /identity/v3/projects/1c70bed71e27418cb01cfcfbbab11076/users/8f8dfa99d54447f68d78e040b5e6ad09/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:41:57.909950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aaf43-9a30-4f0f-9e21-17e281e8b566 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:57.910541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aaf43-9a30-4f0f-9e21-17e281e8b566 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:57.910541 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aaf43-9a30-4f0f-9e21-17e281e8b566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:57.940622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-ff4aaf43-9a30-4f0f-9e21-17e281e8b566 None None] MFA Rules not processed for user `8f8dfa99d54447f68d78e040b5e6ad09`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:57.941912 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ff4aaf43-9a30-4f0f-9e21-17e281e8b566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:58.023890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1403/2778] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:41:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:58.035627 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5472a7-9fed-403f-9984-70cb7a399ff1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:58.038383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-fd5472a7-9fed-403f-9984-70cb7a399ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:58.131776 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5472a7-9fed-403f-9984-70cb7a399ff1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:58.148598 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163ecb0-f1b5-420e-8d5d-1da862fbc8f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1832d9988604b81bcb075ae77db6d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:58.149342 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163ecb0-f1b5-420e-8d5d-1da862fbc8f2 service glance] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:58.149631 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163ecb0-f1b5-420e-8d5d-1da862fbc8f2 service glance] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:58.149912 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163ecb0-f1b5-420e-8d5d-1da862fbc8f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:58.187822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:58.243828 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163ecb0-f1b5-420e-8d5d-1da862fbc8f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:58.245427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163ecb0-f1b5-420e-8d5d-1da862fbc8f2 service glance] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:58.257201 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1376/2779] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:41:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:41:58.454142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c372b5-bb7a-44c5-9931-23f5fe0aec7f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:58.454440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c372b5-bb7a-44c5-9931-23f5fe0aec7f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:58.454721 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c372b5-bb7a-44c5-9931-23f5fe0aec7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:58.481876 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-23c372b5-bb7a-44c5-9931-23f5fe0aec7f None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:41:58.483137 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-23c372b5-bb7a-44c5-9931-23f5fe0aec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:58.490621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:41:58.569771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1404/2780] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:41:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:41:58.623706 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163ecb0-f1b5-420e-8d5d-1da862fbc8f2 service glance] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:41:58.625887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9163ecb0-f1b5-420e-8d5d-1da862fbc8f2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:41:58.713909 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163ecb0-f1b5-420e-8d5d-1da862fbc8f2 service glance] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:41:58.719659 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37a470-aef2-4e14-a62e-4cdcb8624db7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:41:58.722106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37a470-aef2-4e14-a62e-4cdcb8624db7 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:41:58.722106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37a470-aef2-4e14-a62e-4cdcb8624db7 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:41:58.722106 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37a470-aef2-4e14-a62e-4cdcb8624db7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:41:58.732455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37a470-aef2-4e14-a62e-4cdcb8624db7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:41:58.734221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37a470-aef2-4e14-a62e-4cdcb8624db7 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:41:58.745465 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1377/2781] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:41:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 16:42:08.135048 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc1e78-fa89-48f5-b0b6-6eac55498d7f None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:42:08.135622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc1e78-fa89-48f5-b0b6-6eac55498d7f None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:42:08.135622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc1e78-fa89-48f5-b0b6-6eac55498d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:42:08.156200 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-30cc1e78-fa89-48f5-b0b6-6eac55498d7f None None] MFA Rules not processed for user `da789150bb404c42a1f077386ea7edc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:42:08.157428 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-30cc1e78-fa89-48f5-b0b6-6eac55498d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:42:08.166517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1405/2782] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:42:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:42:08.742522 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=48 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:10.510237 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5b85b-74de-444b-b507-e88e37bff7fa None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:42:10.511287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5b85b-74de-444b-b507-e88e37bff7fa None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:42:10.511287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5b85b-74de-444b-b507-e88e37bff7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:42:10.535584 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a9c5b85b-74de-444b-b507-e88e37bff7fa None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:42:10.537884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a9c5b85b-74de-444b-b507-e88e37bff7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:42:10.545236 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1378/2783] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 16:42:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:42:10.560444 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc1e78-fa89-48f5-b0b6-6eac55498d7f None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:42:10.573792 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc1e78-fa89-48f5-b0b6-6eac55498d7f None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:42:10.579377 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24948677-f06d-4b6f-ba21-c57bc10061c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:42:10.580171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24948677-f06d-4b6f-ba21-c57bc10061c6 service swift] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:42:10.580515 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24948677-f06d-4b6f-ba21-c57bc10061c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:42:10.580855 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24948677-f06d-4b6f-ba21-c57bc10061c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:42:10.593221 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24948677-f06d-4b6f-ba21-c57bc10061c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:42:10.594950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24948677-f06d-4b6f-ba21-c57bc10061c6 service swift] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:42:10.605340 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1406/2784] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:42:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 16:42:20.529779 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:20.601370 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=29 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:30.151163 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5b85b-74de-444b-b507-e88e37bff7fa None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:42:30.152589 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a9c5b85b-74de-444b-b507-e88e37bff7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:42:30.237390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5b85b-74de-444b-b507-e88e37bff7fa None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:42:30.241623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3d24b-ac91-4c76-8421-96e46743dbf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:42:30.242241 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3d24b-ac91-4c76-8421-96e46743dbf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:42:30.242524 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3d24b-ac91-4c76-8421-96e46743dbf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:42:30.242798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3d24b-ac91-4c76-8421-96e46743dbf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:42:30.274973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3d24b-ac91-4c76-8421-96e46743dbf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:42:30.276668 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3d24b-ac91-4c76-8421-96e46743dbf6 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:42:30.286305 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1379/2785] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:42:40.282134 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=48 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:41.133333 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24948677-f06d-4b6f-ba21-c57bc10061c6 service swift] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:42:41.135547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-24948677-f06d-4b6f-ba21-c57bc10061c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:42:41.279494 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24948677-f06d-4b6f-ba21-c57bc10061c6 service swift] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:42:41.284509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7e4b5-8139-434b-8d12-74730dc41620 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f602decb26be477b867493429352bd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:42:41.285128 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7e4b5-8139-434b-8d12-74730dc41620 service placement] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:42:41.285408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7e4b5-8139-434b-8d12-74730dc41620 service placement] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:42:41.285683 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7e4b5-8139-434b-8d12-74730dc41620 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:42:41.287476 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-d8d7e4b5-8139-434b-8d12-74730dc41620 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:42:41.299922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7e4b5-8139-434b-8d12-74730dc41620 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:42:41.301511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7e4b5-8139-434b-8d12-74730dc41620 service placement] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:42:41.313481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1407/2786] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:42:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:42:49.201076 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3d24b-ac91-4c76-8421-96e46743dbf6 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:42:49.202577 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6df3d24b-ac91-4c76-8421-96e46743dbf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:42:49.310203 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3d24b-ac91-4c76-8421-96e46743dbf6 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:42:49.315075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:42:49.315729 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:42:49.316191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:42:49.316474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] PATH_INFO: `/v3/users/86648523ab484efa8d00c2ab13a8d984` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:42:49.317674 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86648523ab484efa8d00c2ab13a8d984)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:42:49.320315 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:42:49.371900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86648523ab484efa8d00c2ab13a8d984'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.379264 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86648523ab484efa8d00c2ab13a8d984'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.389786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86648523ab484efa8d00c2ab13a8d984'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.390421 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86648523ab484efa8d00c2ab13a8d984'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.391046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86648523ab484efa8d00c2ab13a8d984'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.409949 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1380/2787] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:42:49 2022] DELETE /identity/v3/users/86648523ab484efa8d00c2ab13a8d984 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:42:49.595360 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7e4b5-8139-434b-8d12-74730dc41620 service placement] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:42:49.607388 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7e4b5-8139-434b-8d12-74730dc41620 service placement] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:42:49.667924 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:42:49.668508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:42:49.668796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:42:49.669077 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] PATH_INFO: `/v3/projects/86f2c5c726ed49488b851117f96336bf` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:42:49.670260 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f2c5c726ed49488b851117f96336bf)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:42:49.672201 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:42:49.718629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:49.723352 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f2c5c726ed49488b851117f96336bf', 'request_id': 'req-90629bf9-33fa-4c9c-a949-ce4fe0022357'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.734383 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f2c5c726ed49488b851117f96336bf', 'request_id': 'req-90629bf9-33fa-4c9c-a949-ce4fe0022357'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.743400 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f2c5c726ed49488b851117f96336bf', 'request_id': 'req-90629bf9-33fa-4c9c-a949-ce4fe0022357'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.758327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] The token cache is being invalidate because project 86f2c5c726ed49488b851117f96336bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:42:49.758620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.759524 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.764529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1408/2788] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:42:49 2022] DELETE /identity/v3/projects/86f2c5c726ed49488b851117f96336bf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:42:49.765119 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:42:49.766529 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:42:49.781514 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a23a8-c95f-419e-8196-c7b87e411a93 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:42:49.829788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:42:49.841232 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2741b4-fc54-41c7-b3fc-fa2d31823519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:42:49.841903 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2741b4-fc54-41c7-b3fc-fa2d31823519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:42:49.842286 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2741b4-fc54-41c7-b3fc-fa2d31823519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:42:49.842571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2741b4-fc54-41c7-b3fc-fa2d31823519 admin admin] PATH_INFO: `/v3/users/a47757d2eecf4366a6a2daecfad83be3` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:42:49.843764 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2741b4-fc54-41c7-b3fc-fa2d31823519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47757d2eecf4366a6a2daecfad83be3)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:42:49.845699 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2741b4-fc54-41c7-b3fc-fa2d31823519 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:42:49.893229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3c2741b4-fc54-41c7-b3fc-fa2d31823519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47757d2eecf4366a6a2daecfad83be3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.900249 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3c2741b4-fc54-41c7-b3fc-fa2d31823519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47757d2eecf4366a6a2daecfad83be3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.907636 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3c2741b4-fc54-41c7-b3fc-fa2d31823519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47757d2eecf4366a6a2daecfad83be3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.908287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3c2741b4-fc54-41c7-b3fc-fa2d31823519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47757d2eecf4366a6a2daecfad83be3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.908978 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-3c2741b4-fc54-41c7-b3fc-fa2d31823519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47757d2eecf4366a6a2daecfad83be3'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:49.926135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1381/2789] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:42:49 2022] DELETE /identity/v3/users/a47757d2eecf4366a6a2daecfad83be3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:42:50.103734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:42:50.105232 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:42:50.133198 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90629bf9-33fa-4c9c-a949-ce4fe0022357 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:42:50.217366 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba53d3-670f-4df1-8e68-a470c223f89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:42:50.218039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba53d3-670f-4df1-8e68-a470c223f89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:42:50.218327 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba53d3-670f-4df1-8e68-a470c223f89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:42:50.218677 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba53d3-670f-4df1-8e68-a470c223f89d admin admin] PATH_INFO: `/v3/projects/f3eb08ab9a8d483e9f29ec6ffb55c34c` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:42:50.219931 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba53d3-670f-4df1-8e68-a470c223f89d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3eb08ab9a8d483e9f29ec6ffb55c34c)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:42:50.222039 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba53d3-670f-4df1-8e68-a470c223f89d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:42:50.286033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-49ba53d3-670f-4df1-8e68-a470c223f89d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3eb08ab9a8d483e9f29ec6ffb55c34c', 'request_id': 'req-49ba53d3-670f-4df1-8e68-a470c223f89d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:50.293437 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-49ba53d3-670f-4df1-8e68-a470c223f89d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3eb08ab9a8d483e9f29ec6ffb55c34c', 'request_id': 'req-49ba53d3-670f-4df1-8e68-a470c223f89d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:50.299553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-49ba53d3-670f-4df1-8e68-a470c223f89d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3eb08ab9a8d483e9f29ec6ffb55c34c', 'request_id': 'req-49ba53d3-670f-4df1-8e68-a470c223f89d'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:50.312860 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-49ba53d3-670f-4df1-8e68-a470c223f89d admin admin] The token cache is being invalidate because project f3eb08ab9a8d483e9f29ec6ffb55c34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:42:50.313206 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-49ba53d3-670f-4df1-8e68-a470c223f89d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:50.313749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-49ba53d3-670f-4df1-8e68-a470c223f89d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:42:50.315331 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1409/2790] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:42:50 2022] DELETE /identity/v3/projects/f3eb08ab9a8d483e9f29ec6ffb55c34c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:42:59.922600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:43:00.309707 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:43:52.530550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b957-c2c0-4376-80d6-3c8bef5fbcfb None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:43:52.531158 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b957-c2c0-4376-80d6-3c8bef5fbcfb None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:43:52.531158 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b957-c2c0-4376-80d6-3c8bef5fbcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:43:52.551365 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-a8a6b957-c2c0-4376-80d6-3c8bef5fbcfb None None] MFA Rules not processed for user `770b9d4cab094164bd638ce6ca5680ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:43:52.552641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a8a6b957-c2c0-4376-80d6-3c8bef5fbcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:43:52.609830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1382/2791] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:43:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:44:02.603128 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=25 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:44:07.614027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c86be-bae9-4cb3-bc46-a9ca1523d693 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:44:07.614534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c86be-bae9-4cb3-bc46-a9ca1523d693 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:44:07.614631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c86be-bae9-4cb3-bc46-a9ca1523d693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:44:07.647209 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c32c86be-bae9-4cb3-bc46-a9ca1523d693 None None] MFA Rules not processed for user `cf356c7ffa044fe39bb548320d2f5acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:44:07.648585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c32c86be-bae9-4cb3-bc46-a9ca1523d693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:44:07.712329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1410/2792] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 27 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:44:07.752816 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6b957-c2c0-4376-80d6-3c8bef5fbcfb None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:44:07.754536 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a8a6b957-c2c0-4376-80d6-3c8bef5fbcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:44:07.826507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6b957-c2c0-4376-80d6-3c8bef5fbcfb None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:44:07.831523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d044e37-a79e-4c35-87a0-ac8554faeba1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48ede3f01be42c39a55c1beeeb85f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:44:07.832190 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d044e37-a79e-4c35-87a0-ac8554faeba1 service swift] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:44:07.832474 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d044e37-a79e-4c35-87a0-ac8554faeba1 service swift] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:44:07.832752 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d044e37-a79e-4c35-87a0-ac8554faeba1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:44:07.841244 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d044e37-a79e-4c35-87a0-ac8554faeba1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:44:07.842825 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d044e37-a79e-4c35-87a0-ac8554faeba1 service swift] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:44:07.851055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1383/2793] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 16:44:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 16:44:14.599465 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c86be-bae9-4cb3-bc46-a9ca1523d693 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:44:14.601347 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c32c86be-bae9-4cb3-bc46-a9ca1523d693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:44:14.679640 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c86be-bae9-4cb3-bc46-a9ca1523d693 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:44:14.684415 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:44:14.685055 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:44:14.685339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:44:14.685616 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] PATH_INFO: `/v3/users/da789150bb404c42a1f077386ea7edc0` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:44:14.686798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=da789150bb404c42a1f077386ea7edc0)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:44:14.688833 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:44:14.738777 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da789150bb404c42a1f077386ea7edc0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:14.747517 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da789150bb404c42a1f077386ea7edc0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:14.754957 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da789150bb404c42a1f077386ea7edc0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:14.755566 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da789150bb404c42a1f077386ea7edc0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:14.756199 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da789150bb404c42a1f077386ea7edc0'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:14.775733 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1411/2794] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:44:14 2022] DELETE /identity/v3/users/da789150bb404c42a1f077386ea7edc0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:44:14.953922 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d044e37-a79e-4c35-87a0-ac8554faeba1 service swift] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:44:14.967130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d044e37-a79e-4c35-87a0-ac8554faeba1 service swift] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:44:15.030853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:44:15.031427 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:44:15.031717 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:44:15.032029 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] PATH_INFO: `/v3/projects/0e0fbf19bbc7488f8dae25da0fab511a` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:44:15.033226 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0fbf19bbc7488f8dae25da0fab511a)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:44:15.035131 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:44:15.082294 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0fbf19bbc7488f8dae25da0fab511a', 'request_id': 'req-6ee11058-879d-4f1c-b572-8b431049d4be'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.090983 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0fbf19bbc7488f8dae25da0fab511a', 'request_id': 'req-6ee11058-879d-4f1c-b572-8b431049d4be'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.097380 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0fbf19bbc7488f8dae25da0fab511a', 'request_id': 'req-6ee11058-879d-4f1c-b572-8b431049d4be'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.109158 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] The token cache is being invalidate because project 0e0fbf19bbc7488f8dae25da0fab511a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:44:15.109449 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.110113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.111639 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1384/2795] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:44:14 2022] DELETE /identity/v3/projects/0e0fbf19bbc7488f8dae25da0fab511a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:44:15.116030 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:44:15.117498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:44:15.130631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32812d8d-dfa7-4e53-9c26-0560779054fe admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:44:15.136076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:44:15.192404 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:44:15.193021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:44:15.193304 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:44:15.193580 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] PATH_INFO: `/v3/users/8f8dfa99d54447f68d78e040b5e6ad09` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:44:15.194772 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f8dfa99d54447f68d78e040b5e6ad09)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:44:15.197830 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:44:15.246588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f8dfa99d54447f68d78e040b5e6ad09'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.254052 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f8dfa99d54447f68d78e040b5e6ad09'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.261871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f8dfa99d54447f68d78e040b5e6ad09'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.262542 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f8dfa99d54447f68d78e040b5e6ad09'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.263236 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f8dfa99d54447f68d78e040b5e6ad09'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.281399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1412/2796] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:44:15 2022] DELETE /identity/v3/users/8f8dfa99d54447f68d78e040b5e6ad09 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:44:15.480916 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:44:15.482492 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:44:15.498707 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee11058-879d-4f1c-b572-8b431049d4be admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:44:15.519358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:44:15.562021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:44:15.562575 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:44:15.562856 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:44:15.563132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] PATH_INFO: `/v3/projects/1c70bed71e27418cb01cfcfbbab11076` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:44:15.564313 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c70bed71e27418cb01cfcfbbab11076)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:44:15.566210 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:44:15.613001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c70bed71e27418cb01cfcfbbab11076', 'request_id': 'req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.621065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c70bed71e27418cb01cfcfbbab11076', 'request_id': 'req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.627501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c70bed71e27418cb01cfcfbbab11076', 'request_id': 'req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.639033 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] The token cache is being invalidate because project 1c70bed71e27418cb01cfcfbbab11076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:44:15.639326 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.640257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:44:15.641788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1385/2797] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:44:15 2022] DELETE /identity/v3/projects/1c70bed71e27418cb01cfcfbbab11076 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:44:25.277754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:44:25.635952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:44:40.922872 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:44:40.924443 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:44:41.003368 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395fede-ae16-40a6-af8f-c80f75734fe7 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:44:41.060644 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f15ab-d375-4bb5-8988-c8887fd9cd7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:44:41.061273 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f15ab-d375-4bb5-8988-c8887fd9cd7a service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:44:41.061558 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f15ab-d375-4bb5-8988-c8887fd9cd7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:44:41.061835 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f15ab-d375-4bb5-8988-c8887fd9cd7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:44:41.064473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fb9f15ab-d375-4bb5-8988-c8887fd9cd7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:44:41.147409 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f15ab-d375-4bb5-8988-c8887fd9cd7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:44:41.148892 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f15ab-d375-4bb5-8988-c8887fd9cd7a service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:44:41.169783 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1413/2798] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:44:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:44:45.138245 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:44:45.139774 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:44:45.153900 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbfa7e-5a17-4be6-a74f-8710c70fe4d5 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:44:45.157842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa57e6-4d77-4d86-946f-d7e71f393e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:44:45.158661 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa57e6-4d77-4d86-946f-d7e71f393e77 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:44:45.158947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa57e6-4d77-4d86-946f-d7e71f393e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:44:45.159221 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa57e6-4d77-4d86-946f-d7e71f393e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:44:45.161137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-88fa57e6-4d77-4d86-946f-d7e71f393e77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:44:45.176113 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa57e6-4d77-4d86-946f-d7e71f393e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:44:45.177567 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa57e6-4d77-4d86-946f-d7e71f393e77 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:44:45.190432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1386/2799] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:44:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:44:51.167192 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=92 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:44:55.184854 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=6 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:03.323513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f15ab-d375-4bb5-8988-c8887fd9cd7a service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:03.325635 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-fb9f15ab-d375-4bb5-8988-c8887fd9cd7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:03.398471 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f15ab-d375-4bb5-8988-c8887fd9cd7a service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:03.403576 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb0923-231a-44b0-84b8-768211f86fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:03.404258 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb0923-231a-44b0-84b8-768211f86fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:03.404540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb0923-231a-44b0-84b8-768211f86fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:03.404822 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb0923-231a-44b0-84b8-768211f86fe8 admin admin] PATH_INFO: `/v3/users/770b9d4cab094164bd638ce6ca5680ad` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:03.406009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb0923-231a-44b0-84b8-768211f86fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=770b9d4cab094164bd638ce6ca5680ad)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:03.407984 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb0923-231a-44b0-84b8-768211f86fe8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:03.456763 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7fb0923-231a-44b0-84b8-768211f86fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '770b9d4cab094164bd638ce6ca5680ad'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:03.465771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7fb0923-231a-44b0-84b8-768211f86fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '770b9d4cab094164bd638ce6ca5680ad'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:03.473844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7fb0923-231a-44b0-84b8-768211f86fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '770b9d4cab094164bd638ce6ca5680ad'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:03.474528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7fb0923-231a-44b0-84b8-768211f86fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '770b9d4cab094164bd638ce6ca5680ad'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:03.475123 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e7fb0923-231a-44b0-84b8-768211f86fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '770b9d4cab094164bd638ce6ca5680ad'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:03.494817 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1414/2800] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:45:03 2022] DELETE /identity/v3/users/770b9d4cab094164bd638ce6ca5680ad => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:03.681283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa57e6-4d77-4d86-946f-d7e71f393e77 service cinder] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:03.695252 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa57e6-4d77-4d86-946f-d7e71f393e77 service cinder] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:03.768540 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7df532-e374-46e9-9300-fb4d67d4393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:03.768785 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7df532-e374-46e9-9300-fb4d67d4393a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:03.768975 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7df532-e374-46e9-9300-fb4d67d4393a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:03.769189 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7df532-e374-46e9-9300-fb4d67d4393a admin admin] PATH_INFO: `/v3/projects/219028bb1ef34887b5430e4b8810ad01` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:03.770388 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7df532-e374-46e9-9300-fb4d67d4393a admin admin] RBAC: Authorizing `identity:delete_project(project_id=219028bb1ef34887b5430e4b8810ad01)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:03.772327 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7df532-e374-46e9-9300-fb4d67d4393a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:03.820959 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd7df532-e374-46e9-9300-fb4d67d4393a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219028bb1ef34887b5430e4b8810ad01', 'request_id': 'req-dd7df532-e374-46e9-9300-fb4d67d4393a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:03.829703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd7df532-e374-46e9-9300-fb4d67d4393a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219028bb1ef34887b5430e4b8810ad01', 'request_id': 'req-dd7df532-e374-46e9-9300-fb4d67d4393a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:03.836358 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd7df532-e374-46e9-9300-fb4d67d4393a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219028bb1ef34887b5430e4b8810ad01', 'request_id': 'req-dd7df532-e374-46e9-9300-fb4d67d4393a'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:03.847144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd7df532-e374-46e9-9300-fb4d67d4393a admin admin] The token cache is being invalidate because project 219028bb1ef34887b5430e4b8810ad01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:45:03.847418 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd7df532-e374-46e9-9300-fb4d67d4393a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:03.848149 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-dd7df532-e374-46e9-9300-fb4d67d4393a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:03.849695 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1387/2801] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:45:03 2022] DELETE /identity/v3/projects/219028bb1ef34887b5430e4b8810ad01 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:03.854955 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dde9e-059f-4cfb-a6a1-4d149190c9aa None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:03.855483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dde9e-059f-4cfb-a6a1-4d149190c9aa None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:03.855841 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dde9e-059f-4cfb-a6a1-4d149190c9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:03.921368 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c11dde9e-059f-4cfb-a6a1-4d149190c9aa None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:03.922600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c11dde9e-059f-4cfb-a6a1-4d149190c9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:03.968967 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:03.985666 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1415/2802] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:03.993556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e84c9-c31a-474a-9041-d594f7ca26e6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:03.993853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e84c9-c31a-474a-9041-d594f7ca26e6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:03.994647 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e84c9-c31a-474a-9041-d594f7ca26e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.015809 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-f60e84c9-c31a-474a-9041-d594f7ca26e6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:04.017171 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-f60e84c9-c31a-474a-9041-d594f7ca26e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:04.025917 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1388/2803] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:04.030880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dde9e-059f-4cfb-a6a1-4d149190c9aa None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:04.041173 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dde9e-059f-4cfb-a6a1-4d149190c9aa None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:04.049496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c228c24-ce14-4386-8d78-29b99e7c9401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:04.050134 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c228c24-ce14-4386-8d78-29b99e7c9401 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.050424 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c228c24-ce14-4386-8d78-29b99e7c9401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.050708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c228c24-ce14-4386-8d78-29b99e7c9401 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.051451 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c228c24-ce14-4386-8d78-29b99e7c9401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:45:04.051767 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c228c24-ce14-4386-8d78-29b99e7c9401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:04.053417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c228c24-ce14-4386-8d78-29b99e7c9401 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:04.066187 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1416/2804] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:45:04.071617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e84c9-c31a-474a-9041-d594f7ca26e6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:04.082195 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e84c9-c31a-474a-9041-d594f7ca26e6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:04.086937 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78a0aa-18ab-4f5b-a68e-63e441d437d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:04.087558 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78a0aa-18ab-4f5b-a68e-63e441d437d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.087846 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78a0aa-18ab-4f5b-a68e-63e441d437d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.088164 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78a0aa-18ab-4f5b-a68e-63e441d437d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.089095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78a0aa-18ab-4f5b-a68e-63e441d437d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:04.090991 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78a0aa-18ab-4f5b-a68e-63e441d437d0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:04.129732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1389/2805] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:45:04 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:45:04.134142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c228c24-ce14-4386-8d78-29b99e7c9401 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:04.144960 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c228c24-ce14-4386-8d78-29b99e7c9401 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:04.210537 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4eaa4-2fa6-404d-bd21-eb36b2ebfcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:04.211195 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4eaa4-2fa6-404d-bd21-eb36b2ebfcdf admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.211478 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4eaa4-2fa6-404d-bd21-eb36b2ebfcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.211815 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4eaa4-2fa6-404d-bd21-eb36b2ebfcdf admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.212534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4eaa4-2fa6-404d-bd21-eb36b2ebfcdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:04.214722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4eaa4-2fa6-404d-bd21-eb36b2ebfcdf admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:04.240704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1417/2806] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:45:04 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:45:04.244692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78a0aa-18ab-4f5b-a68e-63e441d437d0 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:04.260632 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78a0aa-18ab-4f5b-a68e-63e441d437d0 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:04.265650 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44e17d-10b8-4d77-874f-9c6d66cf0d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:04.266279 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44e17d-10b8-4d77-874f-9c6d66cf0d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.266570 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44e17d-10b8-4d77-874f-9c6d66cf0d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.266848 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44e17d-10b8-4d77-874f-9c6d66cf0d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.267852 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44e17d-10b8-4d77-874f-9c6d66cf0d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:04.269678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44e17d-10b8-4d77-874f-9c6d66cf0d3f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:04.285718 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1390/2807] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:04.289778 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4eaa4-2fa6-404d-bd21-eb36b2ebfcdf admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:04.302046 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4eaa4-2fa6-404d-bd21-eb36b2ebfcdf admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:04.307658 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d5f00-3be6-4680-adbf-22bafcf716c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:04.308316 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d5f00-3be6-4680-adbf-22bafcf716c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.308599 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d5f00-3be6-4680-adbf-22bafcf716c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.308880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d5f00-3be6-4680-adbf-22bafcf716c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.309607 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d5f00-3be6-4680-adbf-22bafcf716c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:04.311219 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d5f00-3be6-4680-adbf-22bafcf716c7 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:04.322068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1418/2808] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:04.330231 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44e17d-10b8-4d77-874f-9c6d66cf0d3f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:04.341298 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44e17d-10b8-4d77-874f-9c6d66cf0d3f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:04.346478 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd927b1f-00ef-4190-9a97-28362a2b67e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:04.347147 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd927b1f-00ef-4190-9a97-28362a2b67e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.347432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd927b1f-00ef-4190-9a97-28362a2b67e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.347701 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd927b1f-00ef-4190-9a97-28362a2b67e8 admin admin] PATH_INFO: `/v3/projects/ae5584fbbf004ec7b31793851e2b8f7b/users/ef74afd84b214d158294946eb52b4088/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.363400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd927b1f-00ef-4190-9a97-28362a2b67e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5584fbbf004ec7b31793851e2b8f7b, user_id=ef74afd84b214d158294946eb52b4088, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:04.366044 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd927b1f-00ef-4190-9a97-28362a2b67e8 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:04.385360 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1391/2809] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:45:04 2022] PUT /identity/v3/projects/ae5584fbbf004ec7b31793851e2b8f7b/users/ef74afd84b214d158294946eb52b4088/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:04.396240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab5a4d-c5b9-4d08-a5b2-da731d75cc44 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.396802 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab5a4d-c5b9-4d08-a5b2-da731d75cc44 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.396802 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab5a4d-c5b9-4d08-a5b2-da731d75cc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.424793 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-12ab5a4d-c5b9-4d08-a5b2-da731d75cc44 None None] MFA Rules not processed for user `ef74afd84b214d158294946eb52b4088`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:04.426009 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-12ab5a4d-c5b9-4d08-a5b2-da731d75cc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:04.495892 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1419/2810] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:04.500563 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd927b1f-00ef-4190-9a97-28362a2b67e8 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:04.521058 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:04.567715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd927b1f-00ef-4190-9a97-28362a2b67e8 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:04.572877 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afb47b-7214-44fc-a6ca-dfff6af61b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:04.573692 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afb47b-7214-44fc-a6ca-dfff6af61b44 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.574067 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afb47b-7214-44fc-a6ca-dfff6af61b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.574868 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afb47b-7214-44fc-a6ca-dfff6af61b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.575645 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afb47b-7214-44fc-a6ca-dfff6af61b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:04.577573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afb47b-7214-44fc-a6ca-dfff6af61b44 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:04.606690 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1392/2811] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:45:04 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:45:04.611263 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab5a4d-c5b9-4d08-a5b2-da731d75cc44 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:04.622622 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab5a4d-c5b9-4d08-a5b2-da731d75cc44 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:04.674592 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:04.702584 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5045e-2eea-4df7-986b-2db56f55925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:04.703357 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5045e-2eea-4df7-986b-2db56f55925a admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.703740 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5045e-2eea-4df7-986b-2db56f55925a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.704146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5045e-2eea-4df7-986b-2db56f55925a admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.704923 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5045e-2eea-4df7-986b-2db56f55925a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:04.707293 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5045e-2eea-4df7-986b-2db56f55925a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:04.731704 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1420/2812] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:45:04 2022] POST /identity/v3/users => generated 309 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:45:04.736105 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afb47b-7214-44fc-a6ca-dfff6af61b44 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:04.747695 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afb47b-7214-44fc-a6ca-dfff6af61b44 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:04.752419 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2e1da-f942-4f89-bd31-6898873fb6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:04.753045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2e1da-f942-4f89-bd31-6898873fb6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.753322 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2e1da-f942-4f89-bd31-6898873fb6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.753602 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2e1da-f942-4f89-bd31-6898873fb6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.754301 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2e1da-f942-4f89-bd31-6898873fb6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:04.755925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2e1da-f942-4f89-bd31-6898873fb6a6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:04.771603 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1393/2813] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:04.776842 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5045e-2eea-4df7-986b-2db56f55925a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:04.787026 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5045e-2eea-4df7-986b-2db56f55925a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:04.792465 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b132a-d0c9-41dc-84e7-7ec4033f0d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:04.793212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b132a-d0c9-41dc-84e7-7ec4033f0d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.793500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b132a-d0c9-41dc-84e7-7ec4033f0d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.793779 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b132a-d0c9-41dc-84e7-7ec4033f0d68 admin admin] PATH_INFO: `/v3/projects/65e0fc13431b4f8c9e24bb8a8c5270a9/users/d18868c8e10f4839a406b158fece351e/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.809910 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b132a-d0c9-41dc-84e7-7ec4033f0d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e0fc13431b4f8c9e24bb8a8c5270a9, user_id=d18868c8e10f4839a406b158fece351e, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:04.812610 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b132a-d0c9-41dc-84e7-7ec4033f0d68 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:04.826932 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1421/2814] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:45:04 2022] PUT /identity/v3/projects/65e0fc13431b4f8c9e24bb8a8c5270a9/users/d18868c8e10f4839a406b158fece351e/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:04.831273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2e1da-f942-4f89-bd31-6898873fb6a6 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:04.844884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2e1da-f942-4f89-bd31-6898873fb6a6 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:04.917896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd0fff-6344-4322-aba6-7f934fd41d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:04.918519 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd0fff-6344-4322-aba6-7f934fd41d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.918808 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd0fff-6344-4322-aba6-7f934fd41d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.919087 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd0fff-6344-4322-aba6-7f934fd41d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.919784 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd0fff-6344-4322-aba6-7f934fd41d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:04.921423 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd0fff-6344-4322-aba6-7f934fd41d34 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:04.932464 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1394/2815] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:04.937875 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b132a-d0c9-41dc-84e7-7ec4033f0d68 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:04.949501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b132a-d0c9-41dc-84e7-7ec4033f0d68 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:04.954629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d13c3-936a-490d-b899-506df9b41cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:04.955299 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d13c3-936a-490d-b899-506df9b41cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.955585 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d13c3-936a-490d-b899-506df9b41cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.955952 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d13c3-936a-490d-b899-506df9b41cb6 admin admin] PATH_INFO: `/v3/projects/65e0fc13431b4f8c9e24bb8a8c5270a9/users/d18868c8e10f4839a406b158fece351e/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:04.957856 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d13c3-936a-490d-b899-506df9b41cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e0fc13431b4f8c9e24bb8a8c5270a9, user_id=d18868c8e10f4839a406b158fece351e, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:04.960559 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d13c3-936a-490d-b899-506df9b41cb6 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:04.971830 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1422/2816] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:45:04 2022] PUT /identity/v3/projects/65e0fc13431b4f8c9e24bb8a8c5270a9/users/d18868c8e10f4839a406b158fece351e/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:04.984833 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fd116-0c3c-4849-820a-5b03c0bd2238 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:04.985125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fd116-0c3c-4849-820a-5b03c0bd2238 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:04.985406 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fd116-0c3c-4849-820a-5b03c0bd2238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:05.015765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-678fd116-0c3c-4849-820a-5b03c0bd2238 None None] MFA Rules not processed for user `d18868c8e10f4839a406b158fece351e`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:05.016948 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-678fd116-0c3c-4849-820a-5b03c0bd2238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:05.087341 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1395/2817] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:04 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:45:05.098738 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d13c3-936a-490d-b899-506df9b41cb6 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:05.100502 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-341d13c3-936a-490d-b899-506df9b41cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:05.172767 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d13c3-936a-490d-b899-506df9b41cb6 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:05.176884 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e591f-5e44-496a-8044-8b07b485a234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:05.177514 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e591f-5e44-496a-8044-8b07b485a234 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:05.177798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e591f-5e44-496a-8044-8b07b485a234 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:05.178076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e591f-5e44-496a-8044-8b07b485a234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:05.190604 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e591f-5e44-496a-8044-8b07b485a234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:05.192090 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e591f-5e44-496a-8044-8b07b485a234 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:05.204440 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1423/2818] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:45:05 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:45:05.369593 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fd116-0c3c-4849-820a-5b03c0bd2238 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:05.385652 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:05.450869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fd116-0c3c-4849-820a-5b03c0bd2238 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:05.455578 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:05.456266 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:05.456542 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:05.456815 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] PATH_INFO: `/v3/users/ef74afd84b214d158294946eb52b4088` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:05.458116 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef74afd84b214d158294946eb52b4088)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:05.460118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:05.516028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef74afd84b214d158294946eb52b4088'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:05.523580 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef74afd84b214d158294946eb52b4088'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:05.536501 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef74afd84b214d158294946eb52b4088'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:05.537265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef74afd84b214d158294946eb52b4088'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:05.537896 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef74afd84b214d158294946eb52b4088'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:05.556032 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1396/2819] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:45:05 2022] DELETE /identity/v3/users/ef74afd84b214d158294946eb52b4088 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:05.560832 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d95c56-4e63-4217-8933-f553f9f1e5e7 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:05.561321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d95c56-4e63-4217-8933-f553f9f1e5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:05.561446 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d95c56-4e63-4217-8933-f553f9f1e5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:05.582596 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-e4d95c56-4e63-4217-8933-f553f9f1e5e7 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:05.583815 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e4d95c56-4e63-4217-8933-f553f9f1e5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:05.652171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1424/2820] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:05.664600 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:05.666291 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:05.765287 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37420ad2-168b-494a-a796-36a3b54b7e45 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:05.769616 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103b53f-cf8a-48fe-aeb4-e9c847c81655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:05.770248 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103b53f-cf8a-48fe-aeb4-e9c847c81655 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:05.770530 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103b53f-cf8a-48fe-aeb4-e9c847c81655 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:05.770806 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103b53f-cf8a-48fe-aeb4-e9c847c81655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:05.781219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103b53f-cf8a-48fe-aeb4-e9c847c81655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:05.782564 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103b53f-cf8a-48fe-aeb4-e9c847c81655 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:05.792295 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1397/2821] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:45:06.090657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d95c56-4e63-4217-8933-f553f9f1e5e7 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:06.093218 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-e4d95c56-4e63-4217-8933-f553f9f1e5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:06.110529 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d95c56-4e63-4217-8933-f553f9f1e5e7 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:06.123042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:06.123718 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:06.124042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:06.124317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] PATH_INFO: `/v3/projects/ae5584fbbf004ec7b31793851e2b8f7b` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:06.125493 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5584fbbf004ec7b31793851e2b8f7b)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:06.127733 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:06.175569 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:06.190097 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5584fbbf004ec7b31793851e2b8f7b', 'request_id': 'req-68f86804-593f-44b7-a586-a20f5222db8f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.196880 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5584fbbf004ec7b31793851e2b8f7b', 'request_id': 'req-68f86804-593f-44b7-a586-a20f5222db8f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.203692 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5584fbbf004ec7b31793851e2b8f7b', 'request_id': 'req-68f86804-593f-44b7-a586-a20f5222db8f'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.216432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] The token cache is being invalidate because project ae5584fbbf004ec7b31793851e2b8f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:45:06.216955 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.217604 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.219142 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1425/2822] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:45:06 2022] DELETE /identity/v3/projects/ae5584fbbf004ec7b31793851e2b8f7b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:06.223409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103b53f-cf8a-48fe-aeb4-e9c847c81655 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:06.233429 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103b53f-cf8a-48fe-aeb4-e9c847c81655 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:06.245938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:06.296499 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ec801-353e-495e-afe8-5421fd341ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:06.297145 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec801-353e-495e-afe8-5421fd341ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:06.297433 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec801-353e-495e-afe8-5421fd341ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:06.297708 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec801-353e-495e-afe8-5421fd341ca0 admin admin] PATH_INFO: `/v3/users/d18868c8e10f4839a406b158fece351e` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:06.298906 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ec801-353e-495e-afe8-5421fd341ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18868c8e10f4839a406b158fece351e)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:06.300856 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ec801-353e-495e-afe8-5421fd341ca0 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:06.350763 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-de2ec801-353e-495e-afe8-5421fd341ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18868c8e10f4839a406b158fece351e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.358831 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-de2ec801-353e-495e-afe8-5421fd341ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18868c8e10f4839a406b158fece351e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.366641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-de2ec801-353e-495e-afe8-5421fd341ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18868c8e10f4839a406b158fece351e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.367428 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-de2ec801-353e-495e-afe8-5421fd341ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18868c8e10f4839a406b158fece351e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.368088 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-de2ec801-353e-495e-afe8-5421fd341ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18868c8e10f4839a406b158fece351e'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.386938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1398/2823] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:45:06 2022] DELETE /identity/v3/users/d18868c8e10f4839a406b158fece351e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:06.679680 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:06.681279 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:06.702937 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f86804-593f-44b7-a586-a20f5222db8f admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:06.768056 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4644ee-f33f-47f3-a17d-445e561221bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:06.768708 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4644ee-f33f-47f3-a17d-445e561221bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:06.768992 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4644ee-f33f-47f3-a17d-445e561221bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:06.769269 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4644ee-f33f-47f3-a17d-445e561221bb admin admin] PATH_INFO: `/v3/projects/65e0fc13431b4f8c9e24bb8a8c5270a9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:06.770442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4644ee-f33f-47f3-a17d-445e561221bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e0fc13431b4f8c9e24bb8a8c5270a9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:06.772399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4644ee-f33f-47f3-a17d-445e561221bb admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:06.824305 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cd4644ee-f33f-47f3-a17d-445e561221bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e0fc13431b4f8c9e24bb8a8c5270a9', 'request_id': 'req-cd4644ee-f33f-47f3-a17d-445e561221bb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.830679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cd4644ee-f33f-47f3-a17d-445e561221bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e0fc13431b4f8c9e24bb8a8c5270a9', 'request_id': 'req-cd4644ee-f33f-47f3-a17d-445e561221bb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.836453 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cd4644ee-f33f-47f3-a17d-445e561221bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e0fc13431b4f8c9e24bb8a8c5270a9', 'request_id': 'req-cd4644ee-f33f-47f3-a17d-445e561221bb'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.851027 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cd4644ee-f33f-47f3-a17d-445e561221bb admin admin] The token cache is being invalidate because project 65e0fc13431b4f8c9e24bb8a8c5270a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:45:06.851323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cd4644ee-f33f-47f3-a17d-445e561221bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.852002 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-cd4644ee-f33f-47f3-a17d-445e561221bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:06.854149 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1426/2824] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:45:06 2022] DELETE /identity/v3/projects/65e0fc13431b4f8c9e24bb8a8c5270a9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:06.866528 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ec8c9-e68f-4c5e-8992-11492133426c None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:06.867046 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ec8c9-e68f-4c5e-8992-11492133426c None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:06.867197 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ec8c9-e68f-4c5e-8992-11492133426c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:06.891886 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-762ec8c9-e68f-4c5e-8992-11492133426c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:06.893396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-762ec8c9-e68f-4c5e-8992-11492133426c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:06.955045 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1399/2825] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:06.963768 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad681-bfe3-4e6c-b107-074030839266 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:06.964078 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad681-bfe3-4e6c-b107-074030839266 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:06.964323 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad681-bfe3-4e6c-b107-074030839266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:06.985799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-cc1ad681-bfe3-4e6c-b107-074030839266 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:06.987020 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-cc1ad681-bfe3-4e6c-b107-074030839266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:06.995369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1427/2826] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:07.000001 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ec8c9-e68f-4c5e-8992-11492133426c None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:07.009944 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ec8c9-e68f-4c5e-8992-11492133426c None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:07.014654 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa683635-ab05-4c4b-83a0-c2a7e7e6a6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:07.015285 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa683635-ab05-4c4b-83a0-c2a7e7e6a6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.015573 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa683635-ab05-4c4b-83a0-c2a7e7e6a6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.015850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa683635-ab05-4c4b-83a0-c2a7e7e6a6e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.016581 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa683635-ab05-4c4b-83a0-c2a7e7e6a6e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:45:07.016888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa683635-ab05-4c4b-83a0-c2a7e7e6a6e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:07.018757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa683635-ab05-4c4b-83a0-c2a7e7e6a6e6 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:07.031924 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1400/2827] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:45:07.036547 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad681-bfe3-4e6c-b107-074030839266 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:07.047295 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad681-bfe3-4e6c-b107-074030839266 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:07.052268 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7117bc-a52b-4bb4-bc01-045c1f7e9186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:07.052887 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7117bc-a52b-4bb4-bc01-045c1f7e9186 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.053170 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7117bc-a52b-4bb4-bc01-045c1f7e9186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.053447 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7117bc-a52b-4bb4-bc01-045c1f7e9186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.054111 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7117bc-a52b-4bb4-bc01-045c1f7e9186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:07.056075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7117bc-a52b-4bb4-bc01-045c1f7e9186 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:07.085038 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1428/2828] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:45:07 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:45:07.090645 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa683635-ab05-4c4b-83a0-c2a7e7e6a6e6 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:07.101496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa683635-ab05-4c4b-83a0-c2a7e7e6a6e6 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:07.120984 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:07.162828 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897c735-8f97-4225-ae12-66970211cfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:07.163398 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897c735-8f97-4225-ae12-66970211cfbd admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.163682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897c735-8f97-4225-ae12-66970211cfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.164018 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897c735-8f97-4225-ae12-66970211cfbd admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.164732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897c735-8f97-4225-ae12-66970211cfbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:07.167141 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897c735-8f97-4225-ae12-66970211cfbd admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:07.188678 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1401/2829] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:45:07 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:45:07.193834 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7117bc-a52b-4bb4-bc01-045c1f7e9186 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:07.205600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7117bc-a52b-4bb4-bc01-045c1f7e9186 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:07.210335 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f6152-8c88-4a8f-8987-6884e66ef6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:07.210960 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6152-8c88-4a8f-8987-6884e66ef6ab admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.212241 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6152-8c88-4a8f-8987-6884e66ef6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.212535 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6152-8c88-4a8f-8987-6884e66ef6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.213865 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f6152-8c88-4a8f-8987-6884e66ef6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:07.215531 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f6152-8c88-4a8f-8987-6884e66ef6ab admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:07.226466 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1429/2830] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:45:07.230773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897c735-8f97-4225-ae12-66970211cfbd admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:07.241021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897c735-8f97-4225-ae12-66970211cfbd admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:07.246892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6c6e6-7cf9-4e29-99f9-6b921d7dd16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:07.247513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c6e6-7cf9-4e29-99f9-6b921d7dd16a admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.247796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c6e6-7cf9-4e29-99f9-6b921d7dd16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.248102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c6e6-7cf9-4e29-99f9-6b921d7dd16a admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.248796 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6c6e6-7cf9-4e29-99f9-6b921d7dd16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:07.250375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6c6e6-7cf9-4e29-99f9-6b921d7dd16a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:07.272677 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1402/2831] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:07.277540 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f6152-8c88-4a8f-8987-6884e66ef6ab admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:07.288873 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f6152-8c88-4a8f-8987-6884e66ef6ab admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:07.294240 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625858a2-074c-43f7-811e-15349a205813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:07.294921 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625858a2-074c-43f7-811e-15349a205813 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.295212 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625858a2-074c-43f7-811e-15349a205813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.295496 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625858a2-074c-43f7-811e-15349a205813 admin admin] PATH_INFO: `/v3/projects/2ecda616bcaf44d89794b995dd762f4c/users/47d00e7b02fe4cf8b3132a44375106f1/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.307593 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:07.312918 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625858a2-074c-43f7-811e-15349a205813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ecda616bcaf44d89794b995dd762f4c, user_id=47d00e7b02fe4cf8b3132a44375106f1, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:07.316136 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625858a2-074c-43f7-811e-15349a205813 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:07.332956 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1430/2832] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:45:07 2022] PUT /identity/v3/projects/2ecda616bcaf44d89794b995dd762f4c/users/47d00e7b02fe4cf8b3132a44375106f1/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:07.344579 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484acfb4-f9d0-49b4-b3d5-faa4a561eded None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.344986 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484acfb4-f9d0-49b4-b3d5-faa4a561eded None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.345468 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484acfb4-f9d0-49b4-b3d5-faa4a561eded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.375544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-484acfb4-f9d0-49b4-b3d5-faa4a561eded None None] MFA Rules not processed for user `47d00e7b02fe4cf8b3132a44375106f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:07.376817 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-484acfb4-f9d0-49b4-b3d5-faa4a561eded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:07.444200 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1403/2833] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:07.449910 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625858a2-074c-43f7-811e-15349a205813 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:07.521847 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625858a2-074c-43f7-811e-15349a205813 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:07.526721 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5608e6-6b20-4fd4-a6d6-5d672ea2d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:07.527588 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5608e6-6b20-4fd4-a6d6-5d672ea2d4ee admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.527890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5608e6-6b20-4fd4-a6d6-5d672ea2d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.528171 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5608e6-6b20-4fd4-a6d6-5d672ea2d4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.528839 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5608e6-6b20-4fd4-a6d6-5d672ea2d4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:07.530730 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5608e6-6b20-4fd4-a6d6-5d672ea2d4ee admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:07.563744 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1431/2834] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:45:07 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:45:07.564953 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484acfb4-f9d0-49b4-b3d5-faa4a561eded None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:07.576850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484acfb4-f9d0-49b4-b3d5-faa4a561eded None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:07.635768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54fbdc-b2d6-4bdd-bd00-356fde7e95fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:07.636434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54fbdc-b2d6-4bdd-bd00-356fde7e95fb admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.636700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54fbdc-b2d6-4bdd-bd00-356fde7e95fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.636977 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54fbdc-b2d6-4bdd-bd00-356fde7e95fb admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.637641 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54fbdc-b2d6-4bdd-bd00-356fde7e95fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:07.639544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54fbdc-b2d6-4bdd-bd00-356fde7e95fb admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:07.664839 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1404/2835] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:45:07 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:45:07.669648 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5608e6-6b20-4fd4-a6d6-5d672ea2d4ee admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:07.680661 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5608e6-6b20-4fd4-a6d6-5d672ea2d4ee admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:07.686382 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce4c29-1ffd-4a1b-a687-8be1e92c9935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:07.687014 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce4c29-1ffd-4a1b-a687-8be1e92c9935 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.687302 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce4c29-1ffd-4a1b-a687-8be1e92c9935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.687611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce4c29-1ffd-4a1b-a687-8be1e92c9935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.688348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce4c29-1ffd-4a1b-a687-8be1e92c9935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:07.689958 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce4c29-1ffd-4a1b-a687-8be1e92c9935 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:07.702213 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1432/2836] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:45:07.706306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54fbdc-b2d6-4bdd-bd00-356fde7e95fb admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:07.717132 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54fbdc-b2d6-4bdd-bd00-356fde7e95fb admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:07.721882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008bc8a-b4c7-41f2-a3a4-7ec110db582b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:07.722552 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008bc8a-b4c7-41f2-a3a4-7ec110db582b admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.722838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008bc8a-b4c7-41f2-a3a4-7ec110db582b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.723118 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008bc8a-b4c7-41f2-a3a4-7ec110db582b admin admin] PATH_INFO: `/v3/projects/1b5fb445fb6e40d0aac2bcddb3001d76/users/4bddf7c52d51427785f6721583fca995/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.740188 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008bc8a-b4c7-41f2-a3a4-7ec110db582b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5fb445fb6e40d0aac2bcddb3001d76, user_id=4bddf7c52d51427785f6721583fca995, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:07.742755 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008bc8a-b4c7-41f2-a3a4-7ec110db582b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:07.747155 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:07.758732 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1405/2837] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:45:07 2022] PUT /identity/v3/projects/1b5fb445fb6e40d0aac2bcddb3001d76/users/4bddf7c52d51427785f6721583fca995/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:07.763980 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce4c29-1ffd-4a1b-a687-8be1e92c9935 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:07.774679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce4c29-1ffd-4a1b-a687-8be1e92c9935 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:07.832849 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177033b-b866-4521-bee1-6e109b554253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:07.833473 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177033b-b866-4521-bee1-6e109b554253 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.833760 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177033b-b866-4521-bee1-6e109b554253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.834037 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177033b-b866-4521-bee1-6e109b554253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.834736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177033b-b866-4521-bee1-6e109b554253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:07.836434 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177033b-b866-4521-bee1-6e109b554253 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:07.847007 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1433/2838] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:07.851682 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008bc8a-b4c7-41f2-a3a4-7ec110db582b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:07.867218 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008bc8a-b4c7-41f2-a3a4-7ec110db582b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:07.875590 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c0e28-0d11-4c27-a403-2d9d81c14ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:07.876656 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c0e28-0d11-4c27-a403-2d9d81c14ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.877082 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c0e28-0d11-4c27-a403-2d9d81c14ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.877533 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c0e28-0d11-4c27-a403-2d9d81c14ab7 admin admin] PATH_INFO: `/v3/projects/1b5fb445fb6e40d0aac2bcddb3001d76/users/4bddf7c52d51427785f6721583fca995/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.879820 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c0e28-0d11-4c27-a403-2d9d81c14ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5fb445fb6e40d0aac2bcddb3001d76, user_id=4bddf7c52d51427785f6721583fca995, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:07.882454 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c0e28-0d11-4c27-a403-2d9d81c14ab7 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:07.893830 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1406/2839] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:45:07 2022] PUT /identity/v3/projects/1b5fb445fb6e40d0aac2bcddb3001d76/users/4bddf7c52d51427785f6721583fca995/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:07.907763 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934dd7e-b715-4284-a408-2f50889df339 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:07.908286 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934dd7e-b715-4284-a408-2f50889df339 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:07.908600 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934dd7e-b715-4284-a408-2f50889df339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:07.937744 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-9934dd7e-b715-4284-a408-2f50889df339 None None] MFA Rules not processed for user `4bddf7c52d51427785f6721583fca995`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:07.938976 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-9934dd7e-b715-4284-a408-2f50889df339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:07.997216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:08.027919 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1434/2840] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:08.039521 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c0e28-0d11-4c27-a403-2d9d81c14ab7 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:08.041841 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-661c0e28-0d11-4c27-a403-2d9d81c14ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:08.109588 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c0e28-0d11-4c27-a403-2d9d81c14ab7 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:08.113235 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbae43b-05da-4f8a-b877-4110a2b2244e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:08.113850 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbae43b-05da-4f8a-b877-4110a2b2244e service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:08.114130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbae43b-05da-4f8a-b877-4110a2b2244e service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:08.114401 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbae43b-05da-4f8a-b877-4110a2b2244e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:08.125649 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbae43b-05da-4f8a-b877-4110a2b2244e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:08.127068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbae43b-05da-4f8a-b877-4110a2b2244e service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:08.137302 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1407/2841] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:45:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:45:08.582725 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934dd7e-b715-4284-a408-2f50889df339 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:08.649102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934dd7e-b715-4284-a408-2f50889df339 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:08.658751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:08.659418 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:08.659702 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:08.660018 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] PATH_INFO: `/v3/users/47d00e7b02fe4cf8b3132a44375106f1` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:08.661216 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d00e7b02fe4cf8b3132a44375106f1)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:08.663158 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:08.723754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d00e7b02fe4cf8b3132a44375106f1'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:08.732397 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d00e7b02fe4cf8b3132a44375106f1'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:08.741442 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d00e7b02fe4cf8b3132a44375106f1'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:08.742120 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d00e7b02fe4cf8b3132a44375106f1'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:08.742732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d00e7b02fe4cf8b3132a44375106f1'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:08.764860 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1435/2842] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:45:08 2022] DELETE /identity/v3/users/47d00e7b02fe4cf8b3132a44375106f1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:08.772737 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5d650-9977-4880-91c4-73f8e39f05a6 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:08.773077 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5d650-9977-4880-91c4-73f8e39f05a6 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:08.773395 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5d650-9977-4880-91c4-73f8e39f05a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:08.795424 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-93b5d650-9977-4880-91c4-73f8e39f05a6 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:08.796733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-93b5d650-9977-4880-91c4-73f8e39f05a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:08.859251 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1408/2843] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:08.869335 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:08.871146 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:08.931678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483540-bb0c-4927-98f6-80e55bf9eb00 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:08.936392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ec3a3-da75-4c13-b4d9-4c6543be2766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:08.937053 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ec3a3-da75-4c13-b4d9-4c6543be2766 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:08.937348 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ec3a3-da75-4c13-b4d9-4c6543be2766 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:08.937630 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ec3a3-da75-4c13-b4d9-4c6543be2766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:08.951196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ec3a3-da75-4c13-b4d9-4c6543be2766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:08.951196 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ec3a3-da75-4c13-b4d9-4c6543be2766 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:08.960008 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1436/2844] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:45:09.260009 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5d650-9977-4880-91c4-73f8e39f05a6 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:09.262915 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-93b5d650-9977-4880-91c4-73f8e39f05a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:09.285028 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5d650-9977-4880-91c4-73f8e39f05a6 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:09.292303 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:09.293206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:09.293625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:09.294066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] PATH_INFO: `/v3/projects/2ecda616bcaf44d89794b995dd762f4c` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:09.295874 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ecda616bcaf44d89794b995dd762f4c)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:09.297432 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:09.355217 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ecda616bcaf44d89794b995dd762f4c', 'request_id': 'req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:09.363842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ecda616bcaf44d89794b995dd762f4c', 'request_id': 'req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:09.373571 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ecda616bcaf44d89794b995dd762f4c', 'request_id': 'req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:09.385213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] The token cache is being invalidate because project 2ecda616bcaf44d89794b995dd762f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:45:09.385507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:09.386310 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:09.387985 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1409/2845] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:45:09 2022] DELETE /identity/v3/projects/2ecda616bcaf44d89794b995dd762f4c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:09.392509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ec3a3-da75-4c13-b4d9-4c6543be2766 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:09.403351 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ec3a3-da75-4c13-b4d9-4c6543be2766 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:09.407483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:09.467066 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0629ece-ea0a-4217-a958-1b6c79f93b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:09.467716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0629ece-ea0a-4217-a958-1b6c79f93b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:09.468025 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0629ece-ea0a-4217-a958-1b6c79f93b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:09.468307 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0629ece-ea0a-4217-a958-1b6c79f93b53 admin admin] PATH_INFO: `/v3/users/4bddf7c52d51427785f6721583fca995` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:09.469523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0629ece-ea0a-4217-a958-1b6c79f93b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bddf7c52d51427785f6721583fca995)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:09.471519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0629ece-ea0a-4217-a958-1b6c79f93b53 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:09.521159 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e0629ece-ea0a-4217-a958-1b6c79f93b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bddf7c52d51427785f6721583fca995'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:09.528748 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e0629ece-ea0a-4217-a958-1b6c79f93b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bddf7c52d51427785f6721583fca995'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:09.536462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e0629ece-ea0a-4217-a958-1b6c79f93b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bddf7c52d51427785f6721583fca995'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:09.537132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e0629ece-ea0a-4217-a958-1b6c79f93b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bddf7c52d51427785f6721583fca995'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:09.537747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-e0629ece-ea0a-4217-a958-1b6c79f93b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bddf7c52d51427785f6721583fca995'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:09.555273 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1437/2846] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:45:09 2022] DELETE /identity/v3/users/4bddf7c52d51427785f6721583fca995 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:09.856390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:09.858059 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:09.873663 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033b36d-a8a8-4aa3-ad58-eb8bd9448b6b admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:09.879822 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:09.941260 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b5b5c-e214-46db-821d-620b3255e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:09.941823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b5b5c-e214-46db-821d-620b3255e2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:09.942103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b5b5c-e214-46db-821d-620b3255e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:09.942378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b5b5c-e214-46db-821d-620b3255e2f9 admin admin] PATH_INFO: `/v3/projects/1b5fb445fb6e40d0aac2bcddb3001d76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:09.943560 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b5b5c-e214-46db-821d-620b3255e2f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5fb445fb6e40d0aac2bcddb3001d76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:09.945505 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b5b5c-e214-46db-821d-620b3255e2f9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:09.992754 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-611b5b5c-e214-46db-821d-620b3255e2f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5fb445fb6e40d0aac2bcddb3001d76', 'request_id': 'req-611b5b5c-e214-46db-821d-620b3255e2f9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:10.002933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-611b5b5c-e214-46db-821d-620b3255e2f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5fb445fb6e40d0aac2bcddb3001d76', 'request_id': 'req-611b5b5c-e214-46db-821d-620b3255e2f9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:10.009306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-611b5b5c-e214-46db-821d-620b3255e2f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5fb445fb6e40d0aac2bcddb3001d76', 'request_id': 'req-611b5b5c-e214-46db-821d-620b3255e2f9'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:10.020224 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-611b5b5c-e214-46db-821d-620b3255e2f9 admin admin] The token cache is being invalidate because project 1b5fb445fb6e40d0aac2bcddb3001d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:45:10.020513 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-611b5b5c-e214-46db-821d-620b3255e2f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:10.021156 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-611b5b5c-e214-46db-821d-620b3255e2f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:10.022711 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1410/2847] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:45:09 2022] DELETE /identity/v3/projects/1b5fb445fb6e40d0aac2bcddb3001d76 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:10.028432 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071374f7-c446-45d1-9893-e95430701733 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:10.029815 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071374f7-c446-45d1-9893-e95430701733 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:10.029815 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071374f7-c446-45d1-9893-e95430701733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:10.049781 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-071374f7-c446-45d1-9893-e95430701733 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:10.050991 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-071374f7-c446-45d1-9893-e95430701733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:10.114243 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1438/2848] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:10.122300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978b2e6-0fe3-488c-966e-48d38ea2895a None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:10.122586 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978b2e6-0fe3-488c-966e-48d38ea2895a None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:10.122882 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978b2e6-0fe3-488c-966e-48d38ea2895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:10.143628 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4978b2e6-0fe3-488c-966e-48d38ea2895a None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:10.144888 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4978b2e6-0fe3-488c-966e-48d38ea2895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:10.153798 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1411/2849] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:10.158675 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071374f7-c446-45d1-9893-e95430701733 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:10.171248 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071374f7-c446-45d1-9893-e95430701733 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:10.175898 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17789d-97d2-4b4a-9571-709537b63325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:10.176511 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17789d-97d2-4b4a-9571-709537b63325 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:10.176797 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17789d-97d2-4b4a-9571-709537b63325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:10.177068 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17789d-97d2-4b4a-9571-709537b63325 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:10.177756 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17789d-97d2-4b4a-9571-709537b63325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:45:10.178059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17789d-97d2-4b4a-9571-709537b63325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:10.179653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17789d-97d2-4b4a-9571-709537b63325 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:10.193227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1439/2850] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:45:10.198272 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978b2e6-0fe3-488c-966e-48d38ea2895a None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:10.209089 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978b2e6-0fe3-488c-966e-48d38ea2895a None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:10.214675 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67babc-ca0e-46d3-98d5-19b797b82406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:10.215306 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67babc-ca0e-46d3-98d5-19b797b82406 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:10.215617 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67babc-ca0e-46d3-98d5-19b797b82406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:10.215921 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67babc-ca0e-46d3-98d5-19b797b82406 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:10.216625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67babc-ca0e-46d3-98d5-19b797b82406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:10.218508 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67babc-ca0e-46d3-98d5-19b797b82406 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:10.253932 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1412/2851] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:45:10 2022] POST /identity/v3/projects => generated 355 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:45:10.257458 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17789d-97d2-4b4a-9571-709537b63325 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:10.267687 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17789d-97d2-4b4a-9571-709537b63325 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:10.277374 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:10.335505 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b08f2-06bd-41e2-9955-0cb355be7839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:10.336162 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b08f2-06bd-41e2-9955-0cb355be7839 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:10.336454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b08f2-06bd-41e2-9955-0cb355be7839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:10.336731 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b08f2-06bd-41e2-9955-0cb355be7839 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:10.337407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b08f2-06bd-41e2-9955-0cb355be7839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:10.339329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b08f2-06bd-41e2-9955-0cb355be7839 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:10.362993 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1440/2852] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:45:10 2022] POST /identity/v3/users => generated 278 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:45:10.367344 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67babc-ca0e-46d3-98d5-19b797b82406 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:10.379442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67babc-ca0e-46d3-98d5-19b797b82406 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:10.384264 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e1b18-26e7-4825-8e33-74f811cc3aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:10.384884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e1b18-26e7-4825-8e33-74f811cc3aab admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:10.385172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e1b18-26e7-4825-8e33-74f811cc3aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:10.385449 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e1b18-26e7-4825-8e33-74f811cc3aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:10.386284 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e1b18-26e7-4825-8e33-74f811cc3aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:10.387893 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e1b18-26e7-4825-8e33-74f811cc3aab admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:10.398441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1413/2853] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:10.403515 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b08f2-06bd-41e2-9955-0cb355be7839 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:10.413974 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b08f2-06bd-41e2-9955-0cb355be7839 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:10.419754 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a9783-8402-45dd-943a-0dc019c5e938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:10.420406 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a9783-8402-45dd-943a-0dc019c5e938 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:10.420695 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a9783-8402-45dd-943a-0dc019c5e938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:10.420970 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a9783-8402-45dd-943a-0dc019c5e938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:10.421669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a9783-8402-45dd-943a-0dc019c5e938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:10.423260 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a9783-8402-45dd-943a-0dc019c5e938 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:10.435417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1441/2854] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:10.440002 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e1b18-26e7-4825-8e33-74f811cc3aab admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:10.450858 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e1b18-26e7-4825-8e33-74f811cc3aab admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:10.455544 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52e710-a52a-4e33-9b42-91264227a981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:10.456267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e710-a52a-4e33-9b42-91264227a981 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:10.456557 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e710-a52a-4e33-9b42-91264227a981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:10.456838 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e710-a52a-4e33-9b42-91264227a981 admin admin] PATH_INFO: `/v3/projects/fe22749d6e4148ccbf1ff4a551d02edf/users/ac07cfe9a7344b9f9c6350b85549b165/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:10.476505 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52e710-a52a-4e33-9b42-91264227a981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe22749d6e4148ccbf1ff4a551d02edf, user_id=ac07cfe9a7344b9f9c6350b85549b165, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:10.479788 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52e710-a52a-4e33-9b42-91264227a981 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:10.494673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1414/2855] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:45:10 2022] PUT /identity/v3/projects/fe22749d6e4148ccbf1ff4a551d02edf/users/ac07cfe9a7344b9f9c6350b85549b165/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:45:10.564102 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f4437-6d6a-4b0e-a334-16aa71d19bb2 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:10.564397 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f4437-6d6a-4b0e-a334-16aa71d19bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:10.564682 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f4437-6d6a-4b0e-a334-16aa71d19bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:10.595132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-bc3f4437-6d6a-4b0e-a334-16aa71d19bb2 None None] MFA Rules not processed for user `ac07cfe9a7344b9f9c6350b85549b165`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:10.596412 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-bc3f4437-6d6a-4b0e-a334-16aa71d19bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:10.663462 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1442/2856] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:10.668901 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52e710-a52a-4e33-9b42-91264227a981 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:10.718651 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:10.743999 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52e710-a52a-4e33-9b42-91264227a981 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:10.749236 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c9f78-7092-442c-b356-536e60fc53f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:10.749869 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c9f78-7092-442c-b356-536e60fc53f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:10.750156 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c9f78-7092-442c-b356-536e60fc53f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:10.750441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c9f78-7092-442c-b356-536e60fc53f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:10.751125 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c9f78-7092-442c-b356-536e60fc53f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:10.753085 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c9f78-7092-442c-b356-536e60fc53f9 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:10.783925 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1415/2857] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:45:10 2022] POST /identity/v3/projects => generated 355 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:45:10.788689 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f4437-6d6a-4b0e-a334-16aa71d19bb2 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:10.800920 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f4437-6d6a-4b0e-a334-16aa71d19bb2 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:10.861322 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4d2de-7326-4460-aeb8-32c9490cb627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:10.861946 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4d2de-7326-4460-aeb8-32c9490cb627 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:10.862230 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4d2de-7326-4460-aeb8-32c9490cb627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:10.862513 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4d2de-7326-4460-aeb8-32c9490cb627 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:10.863181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4d2de-7326-4460-aeb8-32c9490cb627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:10.865147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4d2de-7326-4460-aeb8-32c9490cb627 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:10.888032 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1443/2858] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:45:10 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:45:10.892152 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c9f78-7092-442c-b356-536e60fc53f9 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:10.903625 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c9f78-7092-442c-b356-536e60fc53f9 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:10.908372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58dc4e-9bee-4a9e-9ff0-925e97981333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:10.908995 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58dc4e-9bee-4a9e-9ff0-925e97981333 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:10.909278 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58dc4e-9bee-4a9e-9ff0-925e97981333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:10.909556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58dc4e-9bee-4a9e-9ff0-925e97981333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:10.910257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58dc4e-9bee-4a9e-9ff0-925e97981333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:10.911892 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58dc4e-9bee-4a9e-9ff0-925e97981333 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:10.929973 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1416/2859] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:10.934561 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4d2de-7326-4460-aeb8-32c9490cb627 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:10.944825 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4d2de-7326-4460-aeb8-32c9490cb627 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:10.953603 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044298e-f5bc-40a0-805f-7341cded32f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:10.954510 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044298e-f5bc-40a0-805f-7341cded32f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:10.954806 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044298e-f5bc-40a0-805f-7341cded32f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:10.955221 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044298e-f5bc-40a0-805f-7341cded32f8 admin admin] PATH_INFO: `/v3/projects/32e4d7ed927a4b7c9743d0aab8a65197/users/92b077338c9c4c7b8b0f96ec412931e8/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:10.964647 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:10.973757 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044298e-f5bc-40a0-805f-7341cded32f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e4d7ed927a4b7c9743d0aab8a65197, user_id=92b077338c9c4c7b8b0f96ec412931e8, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:10.976753 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044298e-f5bc-40a0-805f-7341cded32f8 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:10.993878 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1444/2860] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:45:10 2022] PUT /identity/v3/projects/32e4d7ed927a4b7c9743d0aab8a65197/users/92b077338c9c4c7b8b0f96ec412931e8/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:45:11.000047 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58dc4e-9bee-4a9e-9ff0-925e97981333 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:11.010933 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58dc4e-9bee-4a9e-9ff0-925e97981333 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:11.068120 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fdc78-024d-44a9-a76e-260e880fae5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:11.068954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fdc78-024d-44a9-a76e-260e880fae5b admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:11.069307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fdc78-024d-44a9-a76e-260e880fae5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:11.069578 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fdc78-024d-44a9-a76e-260e880fae5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:11.070523 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fdc78-024d-44a9-a76e-260e880fae5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:11.073111 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fdc78-024d-44a9-a76e-260e880fae5b admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:11.083191 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1417/2861] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:11.089303 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044298e-f5bc-40a0-805f-7341cded32f8 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:11.109553 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044298e-f5bc-40a0-805f-7341cded32f8 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:11.115483 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140c252-ed6a-455f-805e-f2cb4c13bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:11.116191 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140c252-ed6a-455f-805e-f2cb4c13bb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:11.116472 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140c252-ed6a-455f-805e-f2cb4c13bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:11.116751 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140c252-ed6a-455f-805e-f2cb4c13bb7a admin admin] PATH_INFO: `/v3/projects/32e4d7ed927a4b7c9743d0aab8a65197/users/92b077338c9c4c7b8b0f96ec412931e8/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:11.118734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140c252-ed6a-455f-805e-f2cb4c13bb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e4d7ed927a4b7c9743d0aab8a65197, user_id=92b077338c9c4c7b8b0f96ec412931e8, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:11.121519 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140c252-ed6a-455f-805e-f2cb4c13bb7a admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:11.136857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1445/2862] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:45:11 2022] PUT /identity/v3/projects/32e4d7ed927a4b7c9743d0aab8a65197/users/92b077338c9c4c7b8b0f96ec412931e8/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:45:11.147928 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b207-be6a-4569-884c-bf960cf5de45 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:11.148409 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b207-be6a-4569-884c-bf960cf5de45 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:11.148877 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b207-be6a-4569-884c-bf960cf5de45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:11.184352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-d9e1b207-be6a-4569-884c-bf960cf5de45 None None] MFA Rules not processed for user `92b077338c9c4c7b8b0f96ec412931e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:11.185615 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-d9e1b207-be6a-4569-884c-bf960cf5de45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:11.269392 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1418/2863] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:11 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:11.283015 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140c252-ed6a-455f-805e-f2cb4c13bb7a admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:11.284796 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-3140c252-ed6a-455f-805e-f2cb4c13bb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:11.348076 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140c252-ed6a-455f-805e-f2cb4c13bb7a admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:11.355922 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f504ba-bd88-4def-8824-c623926591f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:11.356657 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f504ba-bd88-4def-8824-c623926591f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:11.356944 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f504ba-bd88-4def-8824-c623926591f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:11.357291 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f504ba-bd88-4def-8824-c623926591f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:11.368846 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f504ba-bd88-4def-8824-c623926591f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:11.370942 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f504ba-bd88-4def-8824-c623926591f6 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:11.381623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1446/2864] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:45:11 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:45:11.473633 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b207-be6a-4569-884c-bf960cf5de45 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:11.486597 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b207-be6a-4569-884c-bf960cf5de45 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:11.490397 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa45cf3-2912-4d11-823e-c3e179af1404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:11.491102 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45cf3-2912-4d11-823e-c3e179af1404 service cinder] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:11.491307 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45cf3-2912-4d11-823e-c3e179af1404 service cinder] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:11.491576 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45cf3-2912-4d11-823e-c3e179af1404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:11.526169 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:11.560081 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa45cf3-2912-4d11-823e-c3e179af1404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:11.561744 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa45cf3-2912-4d11-823e-c3e179af1404 service cinder] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:11.571870 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1419/2865] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:45:11 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 16:45:21.376961 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=36,keystone:INSERT=2 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:21.567283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=14 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:26.617956 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f504ba-bd88-4def-8824-c623926591f6 service cinder] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:26.687346 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f504ba-bd88-4def-8824-c623926591f6 service cinder] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:26.691979 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:26.692623 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:26.692966 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:26.693255 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] PATH_INFO: `/v3/users/ac07cfe9a7344b9f9c6350b85549b165` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:26.694456 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac07cfe9a7344b9f9c6350b85549b165)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:26.696399 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:26.743408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac07cfe9a7344b9f9c6350b85549b165'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:26.751678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac07cfe9a7344b9f9c6350b85549b165'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:26.758394 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac07cfe9a7344b9f9c6350b85549b165'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:26.759021 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac07cfe9a7344b9f9c6350b85549b165'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:26.759621 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac07cfe9a7344b9f9c6350b85549b165'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:26.776691 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1447/2866] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:45:26 2022] DELETE /identity/v3/users/ac07cfe9a7344b9f9c6350b85549b165 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:26.781770 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb952583-f412-4df8-8c92-f72bf138940e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:26.782357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb952583-f412-4df8-8c92-f72bf138940e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:26.782357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb952583-f412-4df8-8c92-f72bf138940e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:26.801425 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-eb952583-f412-4df8-8c92-f72bf138940e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:26.802607 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-eb952583-f412-4df8-8c92-f72bf138940e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:26.860463 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1420/2867] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:26.869985 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:26.871401 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:26.927634 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cea539-598e-47c2-82fb-d532d4c92cd2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:26.931214 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329b513-d2bf-4b8a-808f-ff1241f45fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:26.931823 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329b513-d2bf-4b8a-808f-ff1241f45fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:26.932132 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329b513-d2bf-4b8a-808f-ff1241f45fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:26.932408 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329b513-d2bf-4b8a-808f-ff1241f45fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:26.941627 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329b513-d2bf-4b8a-808f-ff1241f45fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:26.943070 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329b513-d2bf-4b8a-808f-ff1241f45fe6 service neutron] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:26.953508 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1448/2868] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:45:27.253220 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb952583-f412-4df8-8c92-f72bf138940e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:27.254673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-eb952583-f412-4df8-8c92-f72bf138940e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:27.270265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb952583-f412-4df8-8c92-f72bf138940e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:27.276036 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:27.276865 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:27.277920 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:27.278400 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] PATH_INFO: `/v3/projects/fe22749d6e4148ccbf1ff4a551d02edf` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:27.280069 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe22749d6e4148ccbf1ff4a551d02edf)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:27.283283 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:27.340415 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe22749d6e4148ccbf1ff4a551d02edf', 'request_id': 'req-6f4ba98f-04b4-4b72-add2-0f749a039812'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.347823 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe22749d6e4148ccbf1ff4a551d02edf', 'request_id': 'req-6f4ba98f-04b4-4b72-add2-0f749a039812'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.354375 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe22749d6e4148ccbf1ff4a551d02edf', 'request_id': 'req-6f4ba98f-04b4-4b72-add2-0f749a039812'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.365055 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] The token cache is being invalidate because project fe22749d6e4148ccbf1ff4a551d02edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:45:27.365349 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.366011 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.367585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1421/2869] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:45:27 2022] DELETE /identity/v3/projects/fe22749d6e4148ccbf1ff4a551d02edf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:27.372638 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329b513-d2bf-4b8a-808f-ff1241f45fe6 service neutron] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:27.382204 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329b513-d2bf-4b8a-808f-ff1241f45fe6 service neutron] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:27.401314 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:27.443403 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebc342-f0e5-4a24-9a3b-81aca1c590b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:27.444089 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebc342-f0e5-4a24-9a3b-81aca1c590b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:27.444375 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebc342-f0e5-4a24-9a3b-81aca1c590b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:27.444650 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebc342-f0e5-4a24-9a3b-81aca1c590b0 admin admin] PATH_INFO: `/v3/users/92b077338c9c4c7b8b0f96ec412931e8` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:27.445840 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebc342-f0e5-4a24-9a3b-81aca1c590b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b077338c9c4c7b8b0f96ec412931e8)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:27.447750 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebc342-f0e5-4a24-9a3b-81aca1c590b0 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:27.495078 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0ebc342-f0e5-4a24-9a3b-81aca1c590b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b077338c9c4c7b8b0f96ec412931e8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.504545 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0ebc342-f0e5-4a24-9a3b-81aca1c590b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b077338c9c4c7b8b0f96ec412931e8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.512282 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0ebc342-f0e5-4a24-9a3b-81aca1c590b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b077338c9c4c7b8b0f96ec412931e8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.513071 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0ebc342-f0e5-4a24-9a3b-81aca1c590b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b077338c9c4c7b8b0f96ec412931e8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.513686 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-a0ebc342-f0e5-4a24-9a3b-81aca1c590b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b077338c9c4c7b8b0f96ec412931e8'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.532722 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1449/2870] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:45:27 2022] DELETE /identity/v3/users/92b077338c9c4c7b8b0f96ec412931e8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:27.809749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:27.811340 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:27.827192 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ba98f-04b4-4b72-add2-0f749a039812 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:27.885960 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f5711-3953-4c92-b731-393b9caccb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:27.887068 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f5711-3953-4c92-b731-393b9caccb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:27.887357 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f5711-3953-4c92-b731-393b9caccb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:27.887684 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f5711-3953-4c92-b731-393b9caccb1c admin admin] PATH_INFO: `/v3/projects/32e4d7ed927a4b7c9743d0aab8a65197` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:27.888847 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f5711-3953-4c92-b731-393b9caccb1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e4d7ed927a4b7c9743d0aab8a65197)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:27.890773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f5711-3953-4c92-b731-393b9caccb1c admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:27.922319 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:27.941711 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-831f5711-3953-4c92-b731-393b9caccb1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e4d7ed927a4b7c9743d0aab8a65197', 'request_id': 'req-831f5711-3953-4c92-b731-393b9caccb1c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.949957 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-831f5711-3953-4c92-b731-393b9caccb1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e4d7ed927a4b7c9743d0aab8a65197', 'request_id': 'req-831f5711-3953-4c92-b731-393b9caccb1c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.956634 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-831f5711-3953-4c92-b731-393b9caccb1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e4d7ed927a4b7c9743d0aab8a65197', 'request_id': 'req-831f5711-3953-4c92-b731-393b9caccb1c'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.968079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-831f5711-3953-4c92-b731-393b9caccb1c admin admin] The token cache is being invalidate because project 32e4d7ed927a4b7c9743d0aab8a65197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80206) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:45:27.968372 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-831f5711-3953-4c92-b731-393b9caccb1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.969038 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-831f5711-3953-4c92-b731-393b9caccb1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:27.970587 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1422/2871] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:45:27 2022] DELETE /identity/v3/projects/32e4d7ed927a4b7c9743d0aab8a65197 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:27.976669 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3233da4-64e4-43c4-a12a-b776e6853f90 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:27.977181 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3233da4-64e4-43c4-a12a-b776e6853f90 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:27.977283 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3233da4-64e4-43c4-a12a-b776e6853f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:27.998093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f3233da4-64e4-43c4-a12a-b776e6853f90 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:27.999303 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f3233da4-64e4-43c4-a12a-b776e6853f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:28.059084 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1450/2872] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:28.067582 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6b660-5d2d-4559-a35a-ca324f1daa4e None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.067928 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6b660-5d2d-4559-a35a-ca324f1daa4e None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.068363 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6b660-5d2d-4559-a35a-ca324f1daa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.088773 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-5ef6b660-5d2d-4559-a35a-ca324f1daa4e None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:28.090786 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-5ef6b660-5d2d-4559-a35a-ca324f1daa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:28.099124 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1423/2873] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:28.103523 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3233da4-64e4-43c4-a12a-b776e6853f90 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:28.113407 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3233da4-64e4-43c4-a12a-b776e6853f90 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:28.118202 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e8ee6-19e9-4293-9fee-293951ecd986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:28.118819 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8ee6-19e9-4293-9fee-293951ecd986 admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.119107 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8ee6-19e9-4293-9fee-293951ecd986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.119387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8ee6-19e9-4293-9fee-293951ecd986 admin admin] PATH_INFO: `/v3/domains` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.120112 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e8ee6-19e9-4293-9fee-293951ecd986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:45:28.120425 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e8ee6-19e9-4293-9fee-293951ecd986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:28.122945 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e8ee6-19e9-4293-9fee-293951ecd986 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:28.135321 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1451/2874] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:45:28.140815 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6b660-5d2d-4559-a35a-ca324f1daa4e None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:28.150471 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6b660-5d2d-4559-a35a-ca324f1daa4e None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:28.155434 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fc79f-ad48-4e4d-acd4-0c60f128bb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:28.156103 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fc79f-ad48-4e4d-acd4-0c60f128bb25 admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.156390 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fc79f-ad48-4e4d-acd4-0c60f128bb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.156667 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fc79f-ad48-4e4d-acd4-0c60f128bb25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.157352 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7fc79f-ad48-4e4d-acd4-0c60f128bb25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:28.159266 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7fc79f-ad48-4e4d-acd4-0c60f128bb25 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:28.194386 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1424/2875] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:45:28 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:45:28.195484 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e8ee6-19e9-4293-9fee-293951ecd986 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:28.206627 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e8ee6-19e9-4293-9fee-293951ecd986 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:28.232590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:28.264734 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e3941-54ca-48ba-8fa0-e3922a67bab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:28.265359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e3941-54ca-48ba-8fa0-e3922a67bab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.265639 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e3941-54ca-48ba-8fa0-e3922a67bab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.265915 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e3941-54ca-48ba-8fa0-e3922a67bab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.266590 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e3941-54ca-48ba-8fa0-e3922a67bab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:28.268526 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e3941-54ca-48ba-8fa0-e3922a67bab4 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:28.289871 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1452/2876] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:45:28 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 16:45:28.294623 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fc79f-ad48-4e4d-acd4-0c60f128bb25 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:28.304899 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fc79f-ad48-4e4d-acd4-0c60f128bb25 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:28.310688 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9d9da-50f1-4a7e-bbfb-14f0dbe38ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:28.311338 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9d9da-50f1-4a7e-bbfb-14f0dbe38ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.311628 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9d9da-50f1-4a7e-bbfb-14f0dbe38ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.311938 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9d9da-50f1-4a7e-bbfb-14f0dbe38ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.312640 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9d9da-50f1-4a7e-bbfb-14f0dbe38ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:28.314219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9d9da-50f1-4a7e-bbfb-14f0dbe38ae2 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:28.325853 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1425/2877] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:28.331188 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e3941-54ca-48ba-8fa0-e3922a67bab4 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:28.341868 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e3941-54ca-48ba-8fa0-e3922a67bab4 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:28.346802 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f1c13-2e6e-4979-a62d-99417b3ccffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:28.347431 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f1c13-2e6e-4979-a62d-99417b3ccffe admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.347774 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f1c13-2e6e-4979-a62d-99417b3ccffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.348088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f1c13-2e6e-4979-a62d-99417b3ccffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.348798 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f1c13-2e6e-4979-a62d-99417b3ccffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:28.350525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f1c13-2e6e-4979-a62d-99417b3ccffe admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:28.361732 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1453/2878] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:28.366095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9d9da-50f1-4a7e-bbfb-14f0dbe38ae2 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:28.377431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9d9da-50f1-4a7e-bbfb-14f0dbe38ae2 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:28.382208 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320a944-9edb-441c-b4d8-e586ea52f8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:28.382954 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320a944-9edb-441c-b4d8-e586ea52f8b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.383236 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320a944-9edb-441c-b4d8-e586ea52f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.383507 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320a944-9edb-441c-b4d8-e586ea52f8b1 admin admin] PATH_INFO: `/v3/projects/45f92ff443b64d529a4b063c8d464cf9/users/1522855d0eb74f0c8a51c7cdce0177ef/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.400026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320a944-9edb-441c-b4d8-e586ea52f8b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f92ff443b64d529a4b063c8d464cf9, user_id=1522855d0eb74f0c8a51c7cdce0177ef, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:28.402648 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320a944-9edb-441c-b4d8-e586ea52f8b1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:28.415738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1426/2879] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:45:28 2022] PUT /identity/v3/projects/45f92ff443b64d529a4b063c8d464cf9/users/1522855d0eb74f0c8a51c7cdce0177ef/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:28.427729 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0adeb-7f58-4ff2-a056-ac7e9255df25 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.428042 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0adeb-7f58-4ff2-a056-ac7e9255df25 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.428317 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0adeb-7f58-4ff2-a056-ac7e9255df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.457392 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-c1e0adeb-7f58-4ff2-a056-ac7e9255df25 None None] MFA Rules not processed for user `1522855d0eb74f0c8a51c7cdce0177ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:28.458632 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-c1e0adeb-7f58-4ff2-a056-ac7e9255df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:28.532714 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1454/2880] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:28.537373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320a944-9edb-441c-b4d8-e586ea52f8b1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:28.601453 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320a944-9edb-441c-b4d8-e586ea52f8b1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:28.607015 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e508a3-0a0f-4eef-ab50-61d4a6f0c05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:28.607635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e508a3-0a0f-4eef-ab50-61d4a6f0c05f admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.607947 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e508a3-0a0f-4eef-ab50-61d4a6f0c05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.608219 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e508a3-0a0f-4eef-ab50-61d4a6f0c05f admin admin] PATH_INFO: `/v3/projects` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.608887 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e508a3-0a0f-4eef-ab50-61d4a6f0c05f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:28.610769 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e508a3-0a0f-4eef-ab50-61d4a6f0c05f admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:28.643100 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1427/2881] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:45:28 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:45:28.647769 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0adeb-7f58-4ff2-a056-ac7e9255df25 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:28.659140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0adeb-7f58-4ff2-a056-ac7e9255df25 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:28.715653 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a7874-a731-4cde-a333-2dd183f79e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:28.716339 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a7874-a731-4cde-a333-2dd183f79e48 admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.716620 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a7874-a731-4cde-a333-2dd183f79e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.716894 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a7874-a731-4cde-a333-2dd183f79e48 admin admin] PATH_INFO: `/v3/users` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.717586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a7874-a731-4cde-a333-2dd183f79e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:28.719521 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a7874-a731-4cde-a333-2dd183f79e48 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:28.742051 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1455/2882] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:45:28 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:45:28.746783 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e508a3-0a0f-4eef-ab50-61d4a6f0c05f admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:28.757431 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e508a3-0a0f-4eef-ab50-61d4a6f0c05f admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:28.762463 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c6a77-7cdb-4fb1-a80e-3243b00ff668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:28.763098 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c6a77-7cdb-4fb1-a80e-3243b00ff668 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.763366 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c6a77-7cdb-4fb1-a80e-3243b00ff668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.763635 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c6a77-7cdb-4fb1-a80e-3243b00ff668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.764373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c6a77-7cdb-4fb1-a80e-3243b00ff668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:28.765952 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c6a77-7cdb-4fb1-a80e-3243b00ff668 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:28.777534 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1428/2883] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 16:45:28.782093 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a7874-a731-4cde-a333-2dd183f79e48 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:28.792616 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a7874-a731-4cde-a333-2dd183f79e48 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:28.798131 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b603bc5-ae25-45d3-a7dd-bff177d32cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:28.798799 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b603bc5-ae25-45d3-a7dd-bff177d32cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.799081 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b603bc5-ae25-45d3-a7dd-bff177d32cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.799353 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b603bc5-ae25-45d3-a7dd-bff177d32cc5 admin admin] PATH_INFO: `/v3/projects/fcd4f674d2ac4b769cb46320b6e261a6/users/8a7a4c5aab7a41c7b5efd9c4321f6e5d/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.815387 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b603bc5-ae25-45d3-a7dd-bff177d32cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd4f674d2ac4b769cb46320b6e261a6, user_id=8a7a4c5aab7a41c7b5efd9c4321f6e5d, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:28.818059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b603bc5-ae25-45d3-a7dd-bff177d32cc5 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:28.831654 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1456/2884] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:45:28 2022] PUT /identity/v3/projects/fcd4f674d2ac4b769cb46320b6e261a6/users/8a7a4c5aab7a41c7b5efd9c4321f6e5d/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:28.835715 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c6a77-7cdb-4fb1-a80e-3243b00ff668 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:28.846599 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c6a77-7cdb-4fb1-a80e-3243b00ff668 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:28.867137 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:28.906383 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5383e32-9f5f-4adc-ba7f-86f5e5fb4942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:28.907065 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5383e32-9f5f-4adc-ba7f-86f5e5fb4942 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.907296 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5383e32-9f5f-4adc-ba7f-86f5e5fb4942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.907568 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5383e32-9f5f-4adc-ba7f-86f5e5fb4942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.908304 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5383e32-9f5f-4adc-ba7f-86f5e5fb4942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:28.909884 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5383e32-9f5f-4adc-ba7f-86f5e5fb4942 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:28.920849 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1429/2885] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:28.925261 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b603bc5-ae25-45d3-a7dd-bff177d32cc5 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:28.930747 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:28.937303 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b603bc5-ae25-45d3-a7dd-bff177d32cc5 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:28.942318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee718c68-0cf3-4f81-8a29-36a3897dd86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:28.942982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee718c68-0cf3-4f81-8a29-36a3897dd86d admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.943270 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee718c68-0cf3-4f81-8a29-36a3897dd86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.943539 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee718c68-0cf3-4f81-8a29-36a3897dd86d admin admin] PATH_INFO: `/v3/projects/fcd4f674d2ac4b769cb46320b6e261a6/users/8a7a4c5aab7a41c7b5efd9c4321f6e5d/roles/83f21a1ed4e846b7a920b79671b52db9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:28.945501 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee718c68-0cf3-4f81-8a29-36a3897dd86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd4f674d2ac4b769cb46320b6e261a6, user_id=8a7a4c5aab7a41c7b5efd9c4321f6e5d, role_id=83f21a1ed4e846b7a920b79671b52db9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:28.948147 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee718c68-0cf3-4f81-8a29-36a3897dd86d admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:28.958736 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1457/2886] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:45:28 2022] PUT /identity/v3/projects/fcd4f674d2ac4b769cb46320b6e261a6/users/8a7a4c5aab7a41c7b5efd9c4321f6e5d/roles/83f21a1ed4e846b7a920b79671b52db9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 16:45:28.969862 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5427da-3cb6-4cf1-b754-78d4bbd85240 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:28.970131 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5427da-3cb6-4cf1-b754-78d4bbd85240 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:28.970408 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5427da-3cb6-4cf1-b754-78d4bbd85240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:29.001337 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-2d5427da-3cb6-4cf1-b754-78d4bbd85240 None None] MFA Rules not processed for user `8a7a4c5aab7a41c7b5efd9c4321f6e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:29.002589 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-2d5427da-3cb6-4cf1-b754-78d4bbd85240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:29.073099 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1430/2887] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:29.084534 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee718c68-0cf3-4f81-8a29-36a3897dd86d admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:29.086515 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-ee718c68-0cf3-4f81-8a29-36a3897dd86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:29.146343 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee718c68-0cf3-4f81-8a29-36a3897dd86d admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:29.150059 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5cb85-80b2-44cb-93d0-1df5418652e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c5238a91b540b7ba3921a9d561e255', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:29.150679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5cb85-80b2-44cb-93d0-1df5418652e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:29.150964 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5cb85-80b2-44cb-93d0-1df5418652e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:29.151242 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5cb85-80b2-44cb-93d0-1df5418652e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:29.208528 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5cb85-80b2-44cb-93d0-1df5418652e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:29.209890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5cb85-80b2-44cb-93d0-1df5418652e4 service cinder] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:29.219749 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1458/2888] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:45:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:45:31.794598 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5427da-3cb6-4cf1-b754-78d4bbd85240 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:31.863030 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5427da-3cb6-4cf1-b754-78d4bbd85240 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:31.867757 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:31.868436 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:31.868765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:31.868999 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] PATH_INFO: `/v3/users/1522855d0eb74f0c8a51c7cdce0177ef` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:31.870267 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1522855d0eb74f0c8a51c7cdce0177ef)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:31.872734 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:31.925135 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1522855d0eb74f0c8a51c7cdce0177ef'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:31.926556 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:31.935703 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1522855d0eb74f0c8a51c7cdce0177ef'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:31.944880 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1522855d0eb74f0c8a51c7cdce0177ef'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:31.945643 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1522855d0eb74f0c8a51c7cdce0177ef'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:31.946328 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1522855d0eb74f0c8a51c7cdce0177ef'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:31.969477 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1431/2889] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:45:31 2022] DELETE /identity/v3/users/1522855d0eb74f0c8a51c7cdce0177ef => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:31.975140 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca906b-4b60-488d-9081-e3dadf10c423 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:31.975645 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca906b-4b60-488d-9081-e3dadf10c423 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:31.975917 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca906b-4b60-488d-9081-e3dadf10c423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:31.999117 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-0bca906b-4b60-488d-9081-e3dadf10c423 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:32.000363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0bca906b-4b60-488d-9081-e3dadf10c423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:32.061267 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1459/2890] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:32.071274 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:32.073161 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:32.132626 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb43319-59c4-4a47-b731-4cdbd4d418f1 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:32.136229 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa52a04-8b3f-4fdd-ae93-658e7c3eb6f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:32.136855 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa52a04-8b3f-4fdd-ae93-658e7c3eb6f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:32.137139 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa52a04-8b3f-4fdd-ae93-658e7c3eb6f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:32.137414 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa52a04-8b3f-4fdd-ae93-658e7c3eb6f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:32.146807 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa52a04-8b3f-4fdd-ae93-658e7c3eb6f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:32.148265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa52a04-8b3f-4fdd-ae93-658e7c3eb6f2 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:32.158611 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1432/2891] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:45:32.443771 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca906b-4b60-488d-9081-e3dadf10c423 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:32.445500 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-0bca906b-4b60-488d-9081-e3dadf10c423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:32.461504 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca906b-4b60-488d-9081-e3dadf10c423 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:32.467107 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:32.468017 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:32.468125 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:32.468363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] PATH_INFO: `/v3/projects/45f92ff443b64d529a4b063c8d464cf9` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:32.469888 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f92ff443b64d529a4b063c8d464cf9)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:32.472231 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:32.515982 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:32.529681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f92ff443b64d529a4b063c8d464cf9', 'request_id': 'req-60e0d62f-b254-45a7-a9b5-48f5a0778f42'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:32.536678 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f92ff443b64d529a4b063c8d464cf9', 'request_id': 'req-60e0d62f-b254-45a7-a9b5-48f5a0778f42'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:32.542300 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f92ff443b64d529a4b063c8d464cf9', 'request_id': 'req-60e0d62f-b254-45a7-a9b5-48f5a0778f42'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:32.555721 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] The token cache is being invalidate because project 45f92ff443b64d529a4b063c8d464cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:45:32.556049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:32.556679 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:32.558205 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1460/2892] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:45:32 2022] DELETE /identity/v3/projects/45f92ff443b64d529a4b063c8d464cf9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:32.562465 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa52a04-8b3f-4fdd-ae93-658e7c3eb6f2 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:32.572256 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa52a04-8b3f-4fdd-ae93-658e7c3eb6f2 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:32.628356 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f686d-7dfe-4c94-bb87-24548d262729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:32.629026 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f686d-7dfe-4c94-bb87-24548d262729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:32.629309 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f686d-7dfe-4c94-bb87-24548d262729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:32.629585 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f686d-7dfe-4c94-bb87-24548d262729 admin admin] PATH_INFO: `/v3/users/8a7a4c5aab7a41c7b5efd9c4321f6e5d` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:32.630738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f686d-7dfe-4c94-bb87-24548d262729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a7a4c5aab7a41c7b5efd9c4321f6e5d)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:32.632673 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f686d-7dfe-4c94-bb87-24548d262729 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:32.683021 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0b0f686d-7dfe-4c94-bb87-24548d262729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a7a4c5aab7a41c7b5efd9c4321f6e5d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:32.690520 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0b0f686d-7dfe-4c94-bb87-24548d262729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a7a4c5aab7a41c7b5efd9c4321f6e5d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:32.697945 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0b0f686d-7dfe-4c94-bb87-24548d262729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a7a4c5aab7a41c7b5efd9c4321f6e5d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:32.698596 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0b0f686d-7dfe-4c94-bb87-24548d262729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a7a4c5aab7a41c7b5efd9c4321f6e5d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:32.700095 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-0b0f686d-7dfe-4c94-bb87-24548d262729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a7a4c5aab7a41c7b5efd9c4321f6e5d'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:32.706266 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:32.721441 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1433/2893] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:45:32 2022] DELETE /identity/v3/users/8a7a4c5aab7a41c7b5efd9c4321f6e5d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:33.005486 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:33.007091 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:33.021141 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0d62f-b254-45a7-a9b5-48f5a0778f42 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:33.085955 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f9943-511d-4c58-858f-ad0806e62352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:33.086608 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f9943-511d-4c58-858f-ad0806e62352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:33.086890 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f9943-511d-4c58-858f-ad0806e62352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:33.087175 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f9943-511d-4c58-858f-ad0806e62352 admin admin] PATH_INFO: `/v3/projects/fcd4f674d2ac4b769cb46320b6e261a6` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:33.088369 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f9943-511d-4c58-858f-ad0806e62352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd4f674d2ac4b769cb46320b6e261a6)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:33.090847 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f9943-511d-4c58-858f-ad0806e62352 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:33.144121 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bc4f9943-511d-4c58-858f-ad0806e62352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd4f674d2ac4b769cb46320b6e261a6', 'request_id': 'req-bc4f9943-511d-4c58-858f-ad0806e62352'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:33.151222 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bc4f9943-511d-4c58-858f-ad0806e62352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd4f674d2ac4b769cb46320b6e261a6', 'request_id': 'req-bc4f9943-511d-4c58-858f-ad0806e62352'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:33.157028 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bc4f9943-511d-4c58-858f-ad0806e62352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd4f674d2ac4b769cb46320b6e261a6', 'request_id': 'req-bc4f9943-511d-4c58-858f-ad0806e62352'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:33.177509 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bc4f9943-511d-4c58-858f-ad0806e62352 admin admin] The token cache is being invalidate because project fcd4f674d2ac4b769cb46320b6e261a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:45:33.177885 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bc4f9943-511d-4c58-858f-ad0806e62352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:33.178787 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-bc4f9943-511d-4c58-858f-ad0806e62352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:33.180561 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1461/2894] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:45:33 2022] DELETE /identity/v3/projects/fcd4f674d2ac4b769cb46320b6e261a6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:33.186438 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b931b13-d3cb-4508-bc13-9a1c5e65dce5 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:33.186992 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b931b13-d3cb-4508-bc13-9a1c5e65dce5 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:33.187130 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b931b13-d3cb-4508-bc13-9a1c5e65dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:33.208179 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-9b931b13-d3cb-4508-bc13-9a1c5e65dce5 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:33.209405 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-9b931b13-d3cb-4508-bc13-9a1c5e65dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:33.272066 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1434/2895] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:45:33.281115 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03f7e-8e4e-48a1-9c52-181e0e5c4c9c None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:33.281402 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03f7e-8e4e-48a1-9c52-181e0e5c4c9c None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:33.281681 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03f7e-8e4e-48a1-9c52-181e0e5c4c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:33.314173 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-f4e03f7e-8e4e-48a1-9c52-181e0e5c4c9c None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:33.315414 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-f4e03f7e-8e4e-48a1-9c52-181e0e5c4c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:33.335466 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1462/2896] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:33.340490 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b931b13-d3cb-4508-bc13-9a1c5e65dce5 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:33.350666 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b931b13-d3cb-4508-bc13-9a1c5e65dce5 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:33.355496 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c345d1-ce7b-4de3-8e1a-cc3544c69d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:33.356172 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c345d1-ce7b-4de3-8e1a-cc3544c69d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:33.356455 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c345d1-ce7b-4de3-8e1a-cc3544c69d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:33.356733 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c345d1-ce7b-4de3-8e1a-cc3544c69d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:33.357445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c345d1-ce7b-4de3-8e1a-cc3544c69d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80206) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 16:45:33.357753 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c345d1-ce7b-4de3-8e1a-cc3544c69d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:33.359378 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c345d1-ce7b-4de3-8e1a-cc3544c69d50 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:33.372613 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1435/2897] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 16:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 16:45:33.377435 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e03f7e-8e4e-48a1-9c52-181e0e5c4c9c None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:33.387363 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e03f7e-8e4e-48a1-9c52-181e0e5c4c9c None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:33.392050 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82c71e-d87d-4ae4-b7c7-9c5c6b2b583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:33.392667 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82c71e-d87d-4ae4-b7c7-9c5c6b2b583c admin admin] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:33.392950 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82c71e-d87d-4ae4-b7c7-9c5c6b2b583c admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:33.393227 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82c71e-d87d-4ae4-b7c7-9c5c6b2b583c admin admin] PATH_INFO: `/v3/projects` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:33.393905 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82c71e-d87d-4ae4-b7c7-9c5c6b2b583c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:33.396098 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82c71e-d87d-4ae4-b7c7-9c5c6b2b583c admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:33.426857 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1463/2898] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 16:45:33 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:45:33.431071 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c345d1-ce7b-4de3-8e1a-cc3544c69d50 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:33.442336 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c345d1-ce7b-4de3-8e1a-cc3544c69d50 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:33.509619 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beb97c-6996-4028-a8fd-003b1596602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:33.510247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beb97c-6996-4028-a8fd-003b1596602a admin admin] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:33.510550 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beb97c-6996-4028-a8fd-003b1596602a admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:33.510799 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beb97c-6996-4028-a8fd-003b1596602a admin admin] PATH_INFO: `/v3/users` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:33.511481 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30beb97c-6996-4028-a8fd-003b1596602a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:33.514180 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30beb97c-6996-4028-a8fd-003b1596602a admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:33.536035 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1436/2899] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 16:45:33 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 16:45:33.540033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82c71e-d87d-4ae4-b7c7-9c5c6b2b583c admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:33.550382 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82c71e-d87d-4ae4-b7c7-9c5c6b2b583c admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:33.555016 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9240b1-ef5d-4663-b096-a74af284e05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:33.555631 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9240b1-ef5d-4663-b096-a74af284e05e admin admin] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:33.555943 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9240b1-ef5d-4663-b096-a74af284e05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:33.556220 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9240b1-ef5d-4663-b096-a74af284e05e admin admin] PATH_INFO: `/v3/roles` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:33.556908 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9240b1-ef5d-4663-b096-a74af284e05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:33.559072 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9240b1-ef5d-4663-b096-a74af284e05e admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:33.570396 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1464/2900] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:33.574491 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beb97c-6996-4028-a8fd-003b1596602a admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:33.585578 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beb97c-6996-4028-a8fd-003b1596602a admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:33.590257 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fb974-c56a-4de2-8605-08ff9aa1afe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:33.590876 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fb974-c56a-4de2-8605-08ff9aa1afe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:33.591167 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fb974-c56a-4de2-8605-08ff9aa1afe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:33.591445 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fb974-c56a-4de2-8605-08ff9aa1afe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:33.592181 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fb974-c56a-4de2-8605-08ff9aa1afe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:33.593765 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fb974-c56a-4de2-8605-08ff9aa1afe3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:33.604504 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1437/2901] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 16:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 16:45:33.608774 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9240b1-ef5d-4663-b096-a74af284e05e admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:33.618745 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9240b1-ef5d-4663-b096-a74af284e05e admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:33.624498 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdbbff-c936-4799-81da-48e5c9e31ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:33.625197 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdbbff-c936-4799-81da-48e5c9e31ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:33.625479 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdbbff-c936-4799-81da-48e5c9e31ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:33.625756 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdbbff-c936-4799-81da-48e5c9e31ac2 admin admin] PATH_INFO: `/v3/projects/da7985863ca64270803df253ef5bd99b/users/c85a058786674de6893deacb50456f45/roles/19570429b77848d998cb882f8b16aa76` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:33.643094 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdbbff-c936-4799-81da-48e5c9e31ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7985863ca64270803df253ef5bd99b, user_id=c85a058786674de6893deacb50456f45, role_id=19570429b77848d998cb882f8b16aa76)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:33.646036 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdbbff-c936-4799-81da-48e5c9e31ac2 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:33.648329 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:33.661318 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1465/2902] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 16:45:33 2022] PUT /identity/v3/projects/da7985863ca64270803df253ef5bd99b/users/c85a058786674de6893deacb50456f45/roles/19570429b77848d998cb882f8b16aa76 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:33.671881 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b92e3-5d05-4d72-84b1-36fb2bcc19c0 None None] REQUEST_METHOD: `POST` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:33.672183 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b92e3-5d05-4d72-84b1-36fb2bcc19c0 None None] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:33.672463 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b92e3-5d05-4d72-84b1-36fb2bcc19c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:33.701097 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.auth.core [None req-4e9b92e3-5d05-4d72-84b1-36fb2bcc19c0 None None] MFA Rules not processed for user `c85a058786674de6893deacb50456f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80206) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:33.702396 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-4e9b92e3-5d05-4d72-84b1-36fb2bcc19c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:33.744494 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:33.769206 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1438/2903] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 16:45:33.781088 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdbbff-c936-4799-81da-48e5c9e31ac2 admin admin] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:33.782814 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-8cbdbbff-c936-4799-81da-48e5c9e31ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:33.861359 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdbbff-c936-4799-81da-48e5c9e31ac2 admin admin] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:33.865049 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beeeef-7af8-42bd-b1e7-61cb3b3b8849 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1832d9988604b81bcb075ae77db6d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:33.865674 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beeeef-7af8-42bd-b1e7-61cb3b3b8849 service glance] REQUEST_METHOD: `GET` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:33.865960 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beeeef-7af8-42bd-b1e7-61cb3b3b8849 service glance] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:33.866239 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beeeef-7af8-42bd-b1e7-61cb3b3b8849 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:33.876079 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5beeeef-7af8-42bd-b1e7-61cb3b3b8849 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:33.877525 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5beeeef-7af8-42bd-b1e7-61cb3b3b8849 service glance] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:33.886716 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1466/2904] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:45:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:45:43.766247 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=8 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:43.882649 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:INSERT=1,keystone:SELECT=37 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:45:58.999826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b92e3-5d05-4d72-84b1-36fb2bcc19c0 None None] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:59.067263 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b92e3-5d05-4d72-84b1-36fb2bcc19c0 None None] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:59.071878 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:59.072543 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:59.072826 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:59.073101 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] PATH_INFO: `/v3/users/c85a058786674de6893deacb50456f45` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:59.074273 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85a058786674de6893deacb50456f45)` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:59.076213 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:59.128114 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85a058786674de6893deacb50456f45'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:59.135048 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85a058786674de6893deacb50456f45'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:59.144079 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85a058786674de6893deacb50456f45'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:59.144693 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85a058786674de6893deacb50456f45'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:59.145300 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.notifications [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85a058786674de6893deacb50456f45'} {{(pid=80206) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:59.164261 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1439/2905] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 16:45:58 2022] DELETE /identity/v3/users/c85a058786674de6893deacb50456f45 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:45:59.168907 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4409f82-49c3-4dc0-a016-3cd5895c0956 None None] REQUEST_METHOD: `POST` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:59.169417 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4409f82-49c3-4dc0-a016-3cd5895c0956 None None] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:59.169527 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4409f82-49c3-4dc0-a016-3cd5895c0956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:59.191234 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.auth.core [None req-a4409f82-49c3-4dc0-a016-3cd5895c0956 None None] MFA Rules not processed for user `fa3cd04e53bd44eeabd80a82ed088455`. Rule list: `[]` (Enabled: `True`). {{(pid=80205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 16:45:59.192481 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a4409f82-49c3-4dc0-a016-3cd5895c0956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:59.257033 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1467/2906] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 16:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 16:45:59.267144 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:59.268714 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:59.330963 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44a00d-2ac5-412a-a52a-d95f5b53c5c3 admin admin] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:59.334789 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec892a30-0898-4d14-927a-777d284a55d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73325bdd109749ad92a66e600fd61a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:59.335419 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec892a30-0898-4d14-927a-777d284a55d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:59.335700 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec892a30-0898-4d14-927a-777d284a55d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:59.336005 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec892a30-0898-4d14-927a-777d284a55d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:59.345749 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec892a30-0898-4d14-927a-777d284a55d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:59.347265 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec892a30-0898-4d14-927a-777d284a55d8 service neutron] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:59.357373 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1440/2907] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:45:59.647597 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4409f82-49c3-4dc0-a016-3cd5895c0956 None None] Authenticating user token {{(pid=80205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:45:59.654075 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.fernet_utils [None req-a4409f82-49c3-4dc0-a016-3cd5895c0956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:45:59.662943 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4409f82-49c3-4dc0-a016-3cd5895c0956 None None] Validating token access rules against request {{(pid=80205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:45:59.669454 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d953fe1-36b0-4d93-b948-3dc252446913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3cd04e53bd44eeabd80a82ed088455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe6d635a22f4f83acd22dcb2e804bfc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:45:59.670124 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d953fe1-36b0-4d93-b948-3dc252446913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:45:59.670557 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d953fe1-36b0-4d93-b948-3dc252446913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:45:59.670844 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d953fe1-36b0-4d93-b948-3dc252446913 admin admin] PATH_INFO: `/v3/projects/da7985863ca64270803df253ef5bd99b` {{(pid=80205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:45:59.672097 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d953fe1-36b0-4d93-b948-3dc252446913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da7985863ca64270803df253ef5bd99b)` {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:45:59.674586 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d953fe1-36b0-4d93-b948-3dc252446913 admin admin] RBAC: Authorization granted {{(pid=80205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:45:59.736925 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9d953fe1-36b0-4d93-b948-3dc252446913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da7985863ca64270803df253ef5bd99b', 'request_id': 'req-9d953fe1-36b0-4d93-b948-3dc252446913'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:59.743821 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9d953fe1-36b0-4d93-b948-3dc252446913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da7985863ca64270803df253ef5bd99b', 'request_id': 'req-9d953fe1-36b0-4d93-b948-3dc252446913'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:59.749611 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9d953fe1-36b0-4d93-b948-3dc252446913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da7985863ca64270803df253ef5bd99b', 'request_id': 'req-9d953fe1-36b0-4d93-b948-3dc252446913'} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:59.762858 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9d953fe1-36b0-4d93-b948-3dc252446913 admin admin] The token cache is being invalidate because project da7985863ca64270803df253ef5bd99b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 16:45:59.763073 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9d953fe1-36b0-4d93-b948-3dc252446913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:59.763692 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG keystone.notifications [None req-9d953fe1-36b0-4d93-b948-3dc252446913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 16:45:59.765629 dv-cinder-849690-6-smb devstack@keystone.service[80205]: [pid: 80205|app: 0|req: 1468/2908] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 16:45:59 2022] DELETE /identity/v3/projects/da7985863ca64270803df253ef5bd99b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 16:46:09.352851 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:46:09.759758 dv-cinder-849690-6-smb devstack@keystone.service[80205]: DEBUG dbcounter [-] [80205] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 16:48:24.872442 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec892a30-0898-4d14-927a-777d284a55d8 service neutron] Authenticating user token {{(pid=80206) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 16:48:24.873842 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-ec892a30-0898-4d14-927a-777d284a55d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:48:24.942950 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec892a30-0898-4d14-927a-777d284a55d8 service neutron] Validating token access rules against request {{(pid=80206) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 16:48:25.001738 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7079b44-ea0f-4789-b0b5-8086b93667d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f602decb26be477b867493429352bd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01ef9cd2ffc4edd94cbf0017a720a57', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80206) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 16:48:25.002359 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7079b44-ea0f-4789-b0b5-8086b93667d1 service placement] REQUEST_METHOD: `GET` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 16:48:25.002638 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7079b44-ea0f-4789-b0b5-8086b93667d1 service placement] SCRIPT_NAME: `/identity` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 16:48:25.002908 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7079b44-ea0f-4789-b0b5-8086b93667d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80206) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 16:48:25.005439 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.fernet_utils [None req-a7079b44-ea0f-4789-b0b5-8086b93667d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80206) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 16:48:25.016520 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7079b44-ea0f-4789-b0b5-8086b93667d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 16:48:25.018075 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7079b44-ea0f-4789-b0b5-8086b93667d1 service placement] RBAC: Authorization granted {{(pid=80206) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 16:48:25.027970 dv-cinder-849690-6-smb devstack@keystone.service[80206]: [pid: 80206|app: 0|req: 1441/2909] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 16:48:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 16:48:35.023768 dv-cinder-849690-6-smb devstack@keystone.service[80206]: DEBUG dbcounter [-] [80206] Writing DB stats keystone:SELECT=58 {{(pid=80206) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}